Skip to content

Commit

Permalink
git subrepo clone https://github.com/Narsil/rdev
Browse files Browse the repository at this point in the history
subrepo:
  subdir:   "rdev"
  merged:   "fd0ca96"
upstream:
  origin:   "https://github.com/Narsil/rdev"
  branch:   "master"
  commit:   "fd0ca96"
git-subrepo:
  version:  "0.4.1"
  origin:   "https://github.com/ingydotnet/git-subrepo"
  commit:   "a04d8c2"
  • Loading branch information
jersou committed May 22, 2022
1 parent a6b7bb3 commit 9262903
Show file tree
Hide file tree
Showing 44 changed files with 4,255 additions and 0 deletions.
48 changes: 48 additions & 0 deletions rdev/.github/workflows/rust.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
name: build

on: [push, pull_request]

jobs:
build:

runs-on: ${{matrix.os}}
env:
DISPLAY: ':99'
strategy:
fail-fast: false
matrix:
os: [macos-latest, ubuntu-latest, windows-latest]
include:
- os: ubuntu-latest
headless: Xvfb :99 -screen 0 1024x768x24 > /dev/null 2>&1 &
- os: ubuntu-latest
dependencies: sudo apt-get install libxtst-dev libevdev-dev --assume-yes
- os: macos-latest
# TODO: We can't test this on github, we can't set accessibility yet.
test: cargo test --verbose --all-features -- --skip test_listen_and_simulate --skip test_grab
- os: ubuntu-latest
# TODO unstable_grab feature is not supported on Linux.
test: cargo test --verbose --features=serialize
- os: windows-latest
test: cargo test --verbose --all-features

steps:
- uses: actions/checkout@v2
- name: CargoFmt
run: rustup component add rustfmt
- name: Dependencies
run: ${{matrix.dependencies}}
- name: Setup headless environment
run: ${{matrix.headless}}
- name: Check formatting
run: |
rustup component add rustfmt
cargo fmt -- --check
- name: Build
run: cargo build --verbose
- name: Run tests
run: ${{matrix.test}}
- name: Linter
run: |
rustup component add clippy
cargo clippy --all-features --verbose -- -Dwarnings
2 changes: 2 additions & 0 deletions rdev/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
/target
Cargo.lock
12 changes: 12 additions & 0 deletions rdev/.gitrepo
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
; DO NOT EDIT (unless you know what you are doing)
;
; This subdirectory is a git "subrepo", and this file is maintained by the
; git-subrepo command. See https://github.com/git-commands/git-subrepo#readme
;
[subrepo]
remote = https://github.com/Narsil/rdev
branch = master
commit = fd0ca9670f3de294e2de16fbe0398e1538af1782
parent = a6b7bb3bb28fda03be6c50c261da1c46762388d8
method = merge
cmdver = 0.4.1
64 changes: 64 additions & 0 deletions rdev/Cargo.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
[package]
name = "rdev"
version = "0.5.0"
authors = ["Nicolas Patry <patry.nicolas@protonmail.com>"]
edition = "2018"

description = "Listen and send keyboard and mouse events on Windows, Linux and MacOS."
documentation = "https://docs.rs/rdev/"
homepage = "https://github.com/Narsil/rdev"
repository = "https://github.com/Narsil/rdev"
readme = "README.md"
keywords = ["input", "mouse", "testing", "keyboard", "automation"]
categories = ["development-tools::testing", "api-bindings", "hardware-support"]
license = "MIT"

[dependencies]
serde = {version = "1.0", features = ["derive"], optional=true}
lazy_static = "1.4"

[features]
serialize = ["serde"]
unstable_grab = ["evdev-rs", "epoll", "inotify"]

[target.'cfg(target_os = "macos")'.dependencies]
cocoa = "0.22"
core-graphics = {version = "0.19.0", features = ["highsierra"]}
core-foundation = {version = "0.7"}
core-foundation-sys = {version = "0.7"}


[target.'cfg(target_os = "linux")'.dependencies]
libc = "0.2"
x11 = {version = "2.18", features = ["xlib", "xrecord", "xinput"]}
evdev-rs = {version = "0.4.0", optional=true}
epoll = {version = "4.1.0", optional=true}
inotify = {version = "0.8.2", default-features=false, optional=true}

[target.'cfg(target_os = "windows")'.dependencies]
winapi = { version = "0.3", features = ["winuser", "errhandlingapi", "processthreadsapi"] }

[dev-dependencies]
serde_json = "1.0"
# Some tests interact with the real OS. We can't hit the OS in parallel
# because that leads to unexpected behavior and flaky tests, so we need
# to run thoses tests in sequence instead.
serial_test = "0.4"
tokio = {version = "1.5", features=["sync", "macros", "rt-multi-thread"]}

[[example]]
name = "serialize"
required-features = ["serialize"]

[[example]]
name = "grab"
required-features = ["unstable_grab"]

[[example]]
name = "tokio_channel"
required-features = ["unstable_grab"]

[[test]]
name = "grab"
path = "tests/grab.rs"
required-features = ["unstable_grab"]
21 changes: 21 additions & 0 deletions rdev/LICENSE
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
MIT License

Copyright (c) 2020 Nicolas Patry

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
223 changes: 223 additions & 0 deletions rdev/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,223 @@
![](https://github.com/Narsil/rdev/workflows/build/badge.svg)
[![Crate](https://img.shields.io/crates/v/rdev.svg)](https://crates.io/crates/rdev)
[![API](https://docs.rs/rdev/badge.svg)](https://docs.rs/rdev)

# rdev

Simple library to listen and send events **globally** to keyboard and mouse on MacOS, Windows and Linux
(x11).

You can also check out [Enigo](https://github.com/Enigo-rs/Enigo) which is another
crate which helped me write this one.

This crate is so far a pet project for me to understand the rust ecosystem.

## Listening to global events

```rust
use rdev::{listen, Event};

// This will block.
if let Err(error) = listen(callback) {
println!("Error: {:?}", error)
}

fn callback(event: Event) {
println!("My callback {:?}", event);
match event.name {
Some(string) => println!("User wrote {:?}", string),
None => (),
}
}
```

### OS Caveats:
When using the `listen` function, the following caveats apply:

### Mac OS
The process running the blocking `listen` function (loop) needs to be the parent process (no fork before).
The process needs to be granted access to the Accessibility API (ie. if you're running your process
inside Terminal.app, then Terminal.app needs to be added in
System Preferences > Security & Privacy > Privacy > Accessibility)
If the process is not granted access to the Accessibility API, MacOS will silently ignore rdev's
`listen` calleback and will not trigger it with events. No error will be generated.

### Linux
The `listen` function uses X11 APIs, and so will not work in Wayland or in the linux kernel virtual console

## Sending some events

```rust
use rdev::{simulate, Button, EventType, Key, SimulateError};
use std::{thread, time};

fn send(event_type: &EventType) {
let delay = time::Duration::from_millis(20);
match simulate(event_type) {
Ok(()) => (),
Err(SimulateError) => {
println!("We could not send {:?}", event_type);
}
}
// Let ths OS catchup (at least MacOS)
thread::sleep(delay);
}

send(&EventType::KeyPress(Key::KeyS));
send(&EventType::KeyRelease(Key::KeyS));

send(&EventType::MouseMove { x: 0.0, y: 0.0 });
send(&EventType::MouseMove { x: 400.0, y: 400.0 });
send(&EventType::ButtonPress(Button::Left));
send(&EventType::ButtonRelease(Button::Right));
send(&EventType::Wheel {
delta_x: 0,
delta_y: 1,
});
```
## Main structs
### Event

In order to detect what a user types, we need to plug to the OS level management
of keyboard state (modifiers like shift, ctrl, but also dead keys if they exist).

`EventType` corresponds to a *physical* event, corresponding to QWERTY layout
`Event` corresponds to an actual event that was received and `Event.name` reflects
what key was interpreted by the OS at that time, it will respect the layout.

```rust
/// When events arrive from the system we can add some information
/// time is when the event was received.
#[derive(Debug)]
pub struct Event {
pub time: SystemTime,
pub name: Option<String>,
pub event_type: EventType,
}
```

Be careful, Event::name, might be None, but also String::from(""), and might contain
not displayable unicode characters. We send exactly what the OS sends us so do some sanity checking
before using it.
Caveat: Dead keys don't function yet on Linux

### EventType

In order to manage different OS, the current EventType choices is a mix&match
to account for all possible events.
There is a safe mechanism to detect events no matter what, which are the
Unknown() variant of the enum which will contain some OS specific value.
Also not that not all keys are mapped to an OS code, so simulate might fail if you
try to send an unmapped key. Sending Unknown() variants will always work (the OS might
still reject it).

```rust
/// In order to manage different OS, the current EventType choices is a mix&match
/// to account for all possible events.
#[derive(Debug)]
pub enum EventType {
/// The keys correspond to a standard qwerty layout, they don't correspond
/// To the actual letter a user would use, that requires some layout logic to be added.
KeyPress(Key),
KeyRelease(Key),
/// Some mouse will have more than 3 buttons, these are not defined, and different OS will
/// give different Unknown code.
ButtonPress(Button),
ButtonRelease(Button),
/// Values in pixels
MouseMove {
x: f64,
y: f64,
},
/// Note: On Linux, there is no actual delta the actual values are ignored for delta_x
/// and we only look at the sign of delta_y to simulate wheelup or wheeldown.
Wheel {
delta_x: i64,
delta_y: i64,
},
}
```


## Getting the main screen size

```rust
use rdev::{display_size};

let (w, h) = display_size().unwrap();
assert!(w > 0);
assert!(h > 0);
```

## Keyboard state

We can define a dummy Keyboard, that we will use to detect
what kind of EventType trigger some String. We get the currently used
layout for now !
Caveat : This is layout dependent. If your app needs to support
layout switching don't use this !
Caveat: On Linux, the dead keys mechanism is not implemented.
Caveat: Only shift and dead keys are implemented, Alt+unicode code on windows
won't work.

```rust
use rdev::{Keyboard, EventType, Key, KeyboardState};

let mut keyboard = Keyboard::new().unwrap();
let string = keyboard.add(&EventType::KeyPress(Key::KeyS));
// string == Some("s")
```

## Grabbing global events. (Requires `unstable_grab` feature)

Installing this library with the `unstable_grab` feature adds the `grab` function
which hooks into the global input device event stream.
by suppling this function with a callback, you can intercept
all keyboard and mouse events before they are delivered to applications / window managers.
In the callback, returning None ignores the event and returning the event let's it pass.
There is no modification of the event possible here (yet).

Note: the use of the word `unstable` here refers specifically to the fact that the `grab` API is unstable and subject to change

```rust
#[cfg(feature = "unstable_grab")]
use rdev::{grab, Event, EventType, Key};

#[cfg(feature = "unstable_grab")]
let callback = |event: Event| -> Option<Event> {
if let EventType::KeyPress(Key::CapsLock) = event.event_type {
println!("Consuming and cancelling CapsLock");
None // CapsLock is now effectively disabled
}
else { Some(event) }
};
// This will block.
#[cfg(feature = "unstable_grab")]
if let Err(error) = grab(callback) {
println!("Error: {:?}", error)
}
```

### OS Caveats:
When using the `listen` and/or `grab` functions, the following caveats apply:

#### Mac OS
The process running the blocking `grab` function (loop) needs to be the parent process (no fork before).
The process needs to be granted access to the Accessibility API (ie. if you're running your process
inside Terminal.app, then Terminal.app needs to be added in
System Preferences > Security & Privacy > Privacy > Accessibility)
If the process is not granted access to the Accessibility API, the `grab` call will fail with an
EventTapError (at least in MacOS 10.15, possibly other versions as well)

#### Linux
The `grab` function use the `evdev` library to intercept events, so they will work with both X11 and Wayland
In order for this to work, the process runnign the `listen` or `grab` loop needs to either run as root (not recommended),
or run as a user who's a member of the `input` group (recommended)
Note: on some distros, the group name for evdev access is called `plugdev`, and on some systems, both groups can exist.
When in doubt, add your user to both groups if they exist.

## Serialization

Event data returned by the `listen` and `grab` functions can be serialized and de-serialized with
Serde if you install this library with the `serialize` feature.

8 changes: 8 additions & 0 deletions rdev/README.tpl
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
![](https://github.com/Narsil/rdev/workflows/build/badge.svg)
[![Crate](https://img.shields.io/crates/v/rdev.svg)](https://crates.io/crates/rdev)
[![API](https://docs.rs/rdev/badge.svg)](https://docs.rs/rdev)

# {{crate}}

{{readme}}

Loading

0 comments on commit 9262903

Please sign in to comment.