Better and more seamless mouse/pointer and keyboard control from computer to phone

[ShapeShifter499]

Describe your request

I'm not sure if I'm experiencing a bug in software. Right now in GSConnect I have to click to even show a pointer on the phone side, this makes it pretty useless to figure out where and when to click. And makes swipe gestures impossible. The issue is it doesn't work well and it doesn't always register as a swipe.

It would be nice if you could have it simulate a connected bluetooth or wired mouse on the phone. If I connect a mouse directly to my android phone it will show a pointer and I can use that to click and drag to simulate swipes or just click on things to simulate touches.

Proposed solution

Ideas I would love to see.

Have the mouse/touch feature simulate how connecting a mouse directly to the phone would work. The area that you would click in GSConnect would just instead detect the pointer and a pointer would appear on the phone, clicking and dragging inside the window then would end up working as if you had the mouse directly connected.

Allow one to "pin" gsconnect to a screen edge so that you could seamlessly have the pointer appear to go off screen from the computer to the phone. Basically a multipoint keyboard and mouse control feature with only one keyboard and mouse. Useful if you have your phone (or other mobile device) next to your main laptop or computer.

Alternatives

If there are alternatives that would work, I'd love to know them.

GSConnect version

56

Installed from

OS package manager

GNOME Shell version

45.4

Linux distribution/release

Arch Linux

Additional context

No response

[andyholmes]

This issue seems like it needs a little discussion to narrow down to scope, so moving to discussions.

[ShapeShifter499]

fair enough.

Maybe it's just me but the issue is that in it's current form it's so clunky to use the same keyboard and mouse between a computer and phone (or other android device). It's harder to use since you have to click the mouse or trackpad of your main computer just to get the pointer to show up on the connected device. If it detected your mouse inside of the active area of the window and sent that to the phone, like how the pointer would act if you direct connected a mouse to said device, would work better I think.

I guess kinda like a "headless" VNC connection, no screen streaming but just sending pointer or stylus inputs over.

The use case I have in mind is you could have both a regular computer or laptop and a android device to the side in a "multi monitor" type setup. Being able to use the same keyboard and mouse for both in a more seamless way.