Alexander Radzhabov

AbleMouse - Now works everywhere + MouseCommander: a gesture-driven tool

AbleMouse expands support to Unix, iOS, & iPadOS, making it compatible with all major OSes. A new 3D-printable case for the board is available. The project also introduces MouseCommander (win), a new open-source component. It solves a key problem: how to use keyboard shortcuts and system tools without a physical keyboard or standart mouse. It opens a customizable menu via a gesture, enabling features like instant cursor "teleportation" via a screen preview, an on-screen keyboard and more.

Add a comment

Replies

Best
Alexander Radzhabov
1) Expanded System Support: AbleMouse has now been tested and verified to work on Unix (Ubuntu), iOS, and iPadOS. This means AbleMouse is fully compatible with all major operating systems: macOS, Windows, Android, Unix (Ubuntu), iOS, and iPadOS. 2) The core components of AbleMouse now have a home of their own. The 3D-printable enclosure (in STL format), designed to house an ESP32 development board along with its adapter, was generously contributed by an anonymous supporter of the project: https://github.com/aradzhabov/Ab... 3) Introducing MouseCommander. Imagine this scenario: you can control the cursor, but only in non-standard ways (for example, with your eyes) – WITHOUT a classic mouse, keyboard, or other familiar input devices. In such conditions, Windows' built-in tools turn out to be not very convenient. For instance, to move the cursor from one corner of the screen to the opposite, you still have to "drag" it along the entire path – there is no quick way to "teleport" the cursor. At the same time, the system has many useful keyboard shortcuts and auxiliary utilities that could significantly simplify the task. But how do you activate them if you can't use a keyboard or other standard input methods? MouseCommander solves this problem by bringing up a fully customizable menu, triggered by recognizing a gesture (a predefined sequence of mouse movements). The source code is simply a text file that requires no compilation. The core code enables system-level functions and extensions that facilitate rapid cursor movement by allowing the user to select a target point on a miniature preview of the screen—triggering an immediate jump to the corresponding location on the main display. It also supports instant invocation of the on-screen keyboard (OSK), crosshair-assisted targeting for improved click accuracy, and on-demand screen magnification at the point of interaction. MouseCommander is now a component of the open-source AbleMouse project, distributed under the MIT license. https://github.com/aradzhabov/Ab... P.S. The next product update will introduce the AbleMouse AI Edition. While the current AbleMouse DIY Edition supports users with complete paralysis and other severe motor impairments, the upcoming AbleMouse AI Edition is tailored for individuals who can, at a minimum, turn their head. It introduces an intelligent layer of features designed to significantly accelerate and streamline interaction.
Youssef Abdelwahed

Congrats for the launch, seems that could be useful for many! maybe next AI voice commands for navigations?

Alexander Radzhabov

@youssef_abdelwahed Youssef, thank you for your comment and suggestion.
Actually, built-in functions like those in Windows are already quite convenient and allow for decent computer control by voice.

And yes, voice functions could be further improved for faster cursor positioning, similar to what modern AI agents can do, like booking tickets with a single command. Essentially, these agents can "see the screen" and click where needed. In theory, this same logic could be applied to enable faster voice-controlled mouse positioning.

The thing is, a great many people are unable to speak and have severe mobility impairments, for example in cases of ALS. I am focusing my efforts in areas where existing support tools for such individuals are insufficient or where available solutions are very expensive, in order to provide them with the most accessible alternatives possible.

Currently, I'm working on an AI module for AbleMouse that will enable cursor positioning for people with slightly more mobility, and it will include one particular feature that, to the best of my knowledge, hasn't been implemented by anyone else yet.

Alexander Radzhabov

This Thanksgiving, I'm grateful for the chance to create technology that empowers everyone. I'm especially thankful for this community that believes in a more accessible and independent digital world for all. Happy Thanksgiving!

Evgenii Zaitsev

This is seriously impressive - love seeing accessible tech that doesn’t require expensive hardware or closed systems. Huge respect for making it DIY and open-source. Curious: how hard is the initial setup for someone without technical experience? Could a caregiver get AbleMouse running in minutes?

Alexander Radzhabov

@evgenii_zaitsev1 Evgenii, thank you for your question.

You can view the assembly instructions at this link:
https://github.com/aradzhabov/AbleMouse/blob/main/docs/en/assemble-guide.md

The guide assumes that the user has minimal technical experience, as it will require uploading the firmware to the controller. However, the process itself is essentially copy-and-paste. In my opinion, even a school student with very basic technical skills can perform all the steps.

The idea is that a person in need, or those assisting them, can easily find someone in their immediate circle who can help assemble the device.

Once the device is assembled, anyone can start using it. It's as simple as connecting a new Bluetooth device.