-
Notifications
You must be signed in to change notification settings - Fork 6
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
git subrepo clone https://github.com/Narsil/rdev
subrepo: subdir: "rdev" merged: "fd0ca96" upstream: origin: "https://github.com/Narsil/rdev" branch: "master" commit: "fd0ca96" git-subrepo: version: "0.4.1" origin: "https://github.com/ingydotnet/git-subrepo" commit: "a04d8c2"
- Loading branch information
Showing
44 changed files
with
4,255 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,48 @@ | ||
name: build | ||
|
||
on: [push, pull_request] | ||
|
||
jobs: | ||
build: | ||
|
||
runs-on: ${{matrix.os}} | ||
env: | ||
DISPLAY: ':99' | ||
strategy: | ||
fail-fast: false | ||
matrix: | ||
os: [macos-latest, ubuntu-latest, windows-latest] | ||
include: | ||
- os: ubuntu-latest | ||
headless: Xvfb :99 -screen 0 1024x768x24 > /dev/null 2>&1 & | ||
- os: ubuntu-latest | ||
dependencies: sudo apt-get install libxtst-dev libevdev-dev --assume-yes | ||
- os: macos-latest | ||
# TODO: We can't test this on github, we can't set accessibility yet. | ||
test: cargo test --verbose --all-features -- --skip test_listen_and_simulate --skip test_grab | ||
- os: ubuntu-latest | ||
# TODO unstable_grab feature is not supported on Linux. | ||
test: cargo test --verbose --features=serialize | ||
- os: windows-latest | ||
test: cargo test --verbose --all-features | ||
|
||
steps: | ||
- uses: actions/checkout@v2 | ||
- name: CargoFmt | ||
run: rustup component add rustfmt | ||
- name: Dependencies | ||
run: ${{matrix.dependencies}} | ||
- name: Setup headless environment | ||
run: ${{matrix.headless}} | ||
- name: Check formatting | ||
run: | | ||
rustup component add rustfmt | ||
cargo fmt -- --check | ||
- name: Build | ||
run: cargo build --verbose | ||
- name: Run tests | ||
run: ${{matrix.test}} | ||
- name: Linter | ||
run: | | ||
rustup component add clippy | ||
cargo clippy --all-features --verbose -- -Dwarnings |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
/target | ||
Cargo.lock |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,12 @@ | ||
; DO NOT EDIT (unless you know what you are doing) | ||
; | ||
; This subdirectory is a git "subrepo", and this file is maintained by the | ||
; git-subrepo command. See https://github.com/git-commands/git-subrepo#readme | ||
; | ||
[subrepo] | ||
remote = https://github.com/Narsil/rdev | ||
branch = master | ||
commit = fd0ca9670f3de294e2de16fbe0398e1538af1782 | ||
parent = a6b7bb3bb28fda03be6c50c261da1c46762388d8 | ||
method = merge | ||
cmdver = 0.4.1 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,64 @@ | ||
[package] | ||
name = "rdev" | ||
version = "0.5.0" | ||
authors = ["Nicolas Patry <patry.nicolas@protonmail.com>"] | ||
edition = "2018" | ||
|
||
description = "Listen and send keyboard and mouse events on Windows, Linux and MacOS." | ||
documentation = "https://docs.rs/rdev/" | ||
homepage = "https://github.com/Narsil/rdev" | ||
repository = "https://github.com/Narsil/rdev" | ||
readme = "README.md" | ||
keywords = ["input", "mouse", "testing", "keyboard", "automation"] | ||
categories = ["development-tools::testing", "api-bindings", "hardware-support"] | ||
license = "MIT" | ||
|
||
[dependencies] | ||
serde = {version = "1.0", features = ["derive"], optional=true} | ||
lazy_static = "1.4" | ||
|
||
[features] | ||
serialize = ["serde"] | ||
unstable_grab = ["evdev-rs", "epoll", "inotify"] | ||
|
||
[target.'cfg(target_os = "macos")'.dependencies] | ||
cocoa = "0.22" | ||
core-graphics = {version = "0.19.0", features = ["highsierra"]} | ||
core-foundation = {version = "0.7"} | ||
core-foundation-sys = {version = "0.7"} | ||
|
||
|
||
[target.'cfg(target_os = "linux")'.dependencies] | ||
libc = "0.2" | ||
x11 = {version = "2.18", features = ["xlib", "xrecord", "xinput"]} | ||
evdev-rs = {version = "0.4.0", optional=true} | ||
epoll = {version = "4.1.0", optional=true} | ||
inotify = {version = "0.8.2", default-features=false, optional=true} | ||
|
||
[target.'cfg(target_os = "windows")'.dependencies] | ||
winapi = { version = "0.3", features = ["winuser", "errhandlingapi", "processthreadsapi"] } | ||
|
||
[dev-dependencies] | ||
serde_json = "1.0" | ||
# Some tests interact with the real OS. We can't hit the OS in parallel | ||
# because that leads to unexpected behavior and flaky tests, so we need | ||
# to run thoses tests in sequence instead. | ||
serial_test = "0.4" | ||
tokio = {version = "1.5", features=["sync", "macros", "rt-multi-thread"]} | ||
|
||
[[example]] | ||
name = "serialize" | ||
required-features = ["serialize"] | ||
|
||
[[example]] | ||
name = "grab" | ||
required-features = ["unstable_grab"] | ||
|
||
[[example]] | ||
name = "tokio_channel" | ||
required-features = ["unstable_grab"] | ||
|
||
[[test]] | ||
name = "grab" | ||
path = "tests/grab.rs" | ||
required-features = ["unstable_grab"] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,21 @@ | ||
MIT License | ||
|
||
Copyright (c) 2020 Nicolas Patry | ||
|
||
Permission is hereby granted, free of charge, to any person obtaining a copy | ||
of this software and associated documentation files (the "Software"), to deal | ||
in the Software without restriction, including without limitation the rights | ||
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell | ||
copies of the Software, and to permit persons to whom the Software is | ||
furnished to do so, subject to the following conditions: | ||
|
||
The above copyright notice and this permission notice shall be included in all | ||
copies or substantial portions of the Software. | ||
|
||
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR | ||
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, | ||
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE | ||
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER | ||
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, | ||
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE | ||
SOFTWARE. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,223 @@ | ||
![](https://github.com/Narsil/rdev/workflows/build/badge.svg) | ||
[![Crate](https://img.shields.io/crates/v/rdev.svg)](https://crates.io/crates/rdev) | ||
[![API](https://docs.rs/rdev/badge.svg)](https://docs.rs/rdev) | ||
|
||
# rdev | ||
|
||
Simple library to listen and send events **globally** to keyboard and mouse on MacOS, Windows and Linux | ||
(x11). | ||
|
||
You can also check out [Enigo](https://github.com/Enigo-rs/Enigo) which is another | ||
crate which helped me write this one. | ||
|
||
This crate is so far a pet project for me to understand the rust ecosystem. | ||
|
||
## Listening to global events | ||
|
||
```rust | ||
use rdev::{listen, Event}; | ||
|
||
// This will block. | ||
if let Err(error) = listen(callback) { | ||
println!("Error: {:?}", error) | ||
} | ||
|
||
fn callback(event: Event) { | ||
println!("My callback {:?}", event); | ||
match event.name { | ||
Some(string) => println!("User wrote {:?}", string), | ||
None => (), | ||
} | ||
} | ||
``` | ||
|
||
### OS Caveats: | ||
When using the `listen` function, the following caveats apply: | ||
|
||
### Mac OS | ||
The process running the blocking `listen` function (loop) needs to be the parent process (no fork before). | ||
The process needs to be granted access to the Accessibility API (ie. if you're running your process | ||
inside Terminal.app, then Terminal.app needs to be added in | ||
System Preferences > Security & Privacy > Privacy > Accessibility) | ||
If the process is not granted access to the Accessibility API, MacOS will silently ignore rdev's | ||
`listen` calleback and will not trigger it with events. No error will be generated. | ||
|
||
### Linux | ||
The `listen` function uses X11 APIs, and so will not work in Wayland or in the linux kernel virtual console | ||
|
||
## Sending some events | ||
|
||
```rust | ||
use rdev::{simulate, Button, EventType, Key, SimulateError}; | ||
use std::{thread, time}; | ||
|
||
fn send(event_type: &EventType) { | ||
let delay = time::Duration::from_millis(20); | ||
match simulate(event_type) { | ||
Ok(()) => (), | ||
Err(SimulateError) => { | ||
println!("We could not send {:?}", event_type); | ||
} | ||
} | ||
// Let ths OS catchup (at least MacOS) | ||
thread::sleep(delay); | ||
} | ||
|
||
send(&EventType::KeyPress(Key::KeyS)); | ||
send(&EventType::KeyRelease(Key::KeyS)); | ||
|
||
send(&EventType::MouseMove { x: 0.0, y: 0.0 }); | ||
send(&EventType::MouseMove { x: 400.0, y: 400.0 }); | ||
send(&EventType::ButtonPress(Button::Left)); | ||
send(&EventType::ButtonRelease(Button::Right)); | ||
send(&EventType::Wheel { | ||
delta_x: 0, | ||
delta_y: 1, | ||
}); | ||
``` | ||
## Main structs | ||
### Event | ||
|
||
In order to detect what a user types, we need to plug to the OS level management | ||
of keyboard state (modifiers like shift, ctrl, but also dead keys if they exist). | ||
|
||
`EventType` corresponds to a *physical* event, corresponding to QWERTY layout | ||
`Event` corresponds to an actual event that was received and `Event.name` reflects | ||
what key was interpreted by the OS at that time, it will respect the layout. | ||
|
||
```rust | ||
/// When events arrive from the system we can add some information | ||
/// time is when the event was received. | ||
#[derive(Debug)] | ||
pub struct Event { | ||
pub time: SystemTime, | ||
pub name: Option<String>, | ||
pub event_type: EventType, | ||
} | ||
``` | ||
|
||
Be careful, Event::name, might be None, but also String::from(""), and might contain | ||
not displayable unicode characters. We send exactly what the OS sends us so do some sanity checking | ||
before using it. | ||
Caveat: Dead keys don't function yet on Linux | ||
|
||
### EventType | ||
|
||
In order to manage different OS, the current EventType choices is a mix&match | ||
to account for all possible events. | ||
There is a safe mechanism to detect events no matter what, which are the | ||
Unknown() variant of the enum which will contain some OS specific value. | ||
Also not that not all keys are mapped to an OS code, so simulate might fail if you | ||
try to send an unmapped key. Sending Unknown() variants will always work (the OS might | ||
still reject it). | ||
|
||
```rust | ||
/// In order to manage different OS, the current EventType choices is a mix&match | ||
/// to account for all possible events. | ||
#[derive(Debug)] | ||
pub enum EventType { | ||
/// The keys correspond to a standard qwerty layout, they don't correspond | ||
/// To the actual letter a user would use, that requires some layout logic to be added. | ||
KeyPress(Key), | ||
KeyRelease(Key), | ||
/// Some mouse will have more than 3 buttons, these are not defined, and different OS will | ||
/// give different Unknown code. | ||
ButtonPress(Button), | ||
ButtonRelease(Button), | ||
/// Values in pixels | ||
MouseMove { | ||
x: f64, | ||
y: f64, | ||
}, | ||
/// Note: On Linux, there is no actual delta the actual values are ignored for delta_x | ||
/// and we only look at the sign of delta_y to simulate wheelup or wheeldown. | ||
Wheel { | ||
delta_x: i64, | ||
delta_y: i64, | ||
}, | ||
} | ||
``` | ||
|
||
|
||
## Getting the main screen size | ||
|
||
```rust | ||
use rdev::{display_size}; | ||
|
||
let (w, h) = display_size().unwrap(); | ||
assert!(w > 0); | ||
assert!(h > 0); | ||
``` | ||
|
||
## Keyboard state | ||
|
||
We can define a dummy Keyboard, that we will use to detect | ||
what kind of EventType trigger some String. We get the currently used | ||
layout for now ! | ||
Caveat : This is layout dependent. If your app needs to support | ||
layout switching don't use this ! | ||
Caveat: On Linux, the dead keys mechanism is not implemented. | ||
Caveat: Only shift and dead keys are implemented, Alt+unicode code on windows | ||
won't work. | ||
|
||
```rust | ||
use rdev::{Keyboard, EventType, Key, KeyboardState}; | ||
|
||
let mut keyboard = Keyboard::new().unwrap(); | ||
let string = keyboard.add(&EventType::KeyPress(Key::KeyS)); | ||
// string == Some("s") | ||
``` | ||
|
||
## Grabbing global events. (Requires `unstable_grab` feature) | ||
|
||
Installing this library with the `unstable_grab` feature adds the `grab` function | ||
which hooks into the global input device event stream. | ||
by suppling this function with a callback, you can intercept | ||
all keyboard and mouse events before they are delivered to applications / window managers. | ||
In the callback, returning None ignores the event and returning the event let's it pass. | ||
There is no modification of the event possible here (yet). | ||
|
||
Note: the use of the word `unstable` here refers specifically to the fact that the `grab` API is unstable and subject to change | ||
|
||
```rust | ||
#[cfg(feature = "unstable_grab")] | ||
use rdev::{grab, Event, EventType, Key}; | ||
|
||
#[cfg(feature = "unstable_grab")] | ||
let callback = |event: Event| -> Option<Event> { | ||
if let EventType::KeyPress(Key::CapsLock) = event.event_type { | ||
println!("Consuming and cancelling CapsLock"); | ||
None // CapsLock is now effectively disabled | ||
} | ||
else { Some(event) } | ||
}; | ||
// This will block. | ||
#[cfg(feature = "unstable_grab")] | ||
if let Err(error) = grab(callback) { | ||
println!("Error: {:?}", error) | ||
} | ||
``` | ||
|
||
### OS Caveats: | ||
When using the `listen` and/or `grab` functions, the following caveats apply: | ||
|
||
#### Mac OS | ||
The process running the blocking `grab` function (loop) needs to be the parent process (no fork before). | ||
The process needs to be granted access to the Accessibility API (ie. if you're running your process | ||
inside Terminal.app, then Terminal.app needs to be added in | ||
System Preferences > Security & Privacy > Privacy > Accessibility) | ||
If the process is not granted access to the Accessibility API, the `grab` call will fail with an | ||
EventTapError (at least in MacOS 10.15, possibly other versions as well) | ||
|
||
#### Linux | ||
The `grab` function use the `evdev` library to intercept events, so they will work with both X11 and Wayland | ||
In order for this to work, the process runnign the `listen` or `grab` loop needs to either run as root (not recommended), | ||
or run as a user who's a member of the `input` group (recommended) | ||
Note: on some distros, the group name for evdev access is called `plugdev`, and on some systems, both groups can exist. | ||
When in doubt, add your user to both groups if they exist. | ||
|
||
## Serialization | ||
|
||
Event data returned by the `listen` and `grab` functions can be serialized and de-serialized with | ||
Serde if you install this library with the `serialize` feature. | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,8 @@ | ||
![](https://github.com/Narsil/rdev/workflows/build/badge.svg) | ||
[![Crate](https://img.shields.io/crates/v/rdev.svg)](https://crates.io/crates/rdev) | ||
[![API](https://docs.rs/rdev/badge.svg)](https://docs.rs/rdev) | ||
|
||
# {{crate}} | ||
|
||
{{readme}} | ||
|
Oops, something went wrong.