็ฎไฝไธญๆ | For Simplified Chinese version, please click here
Ayase is a tool which can help you to control everything by keyboard. This is specifically designed for lazy people like me and blind people. It is known to all that in the most cases, we have to control the computer by both mouse and keyboard. However, the frequent switch for our hand between mice and keyboards would severely threaten the health of our wrists. Meanwhile, for blind people, though in most cases, it is convenient enough to use the screen readers to control elements on screen, most softwares cannot control both precisely and swiftly. You have to wait for the element or switch many times to find the element you want to control. With Ayase, these problems are all solved.
Use Ayase to control Netease Music UWP:
Use Ayase to surf on the Internet:
I love Mitsukasa Ayase forever!
https://zh.moegirl.org.cn/ไธๅธ็ปซๆฟ
- Support high DPI, different DPI across multiple monitors, cross monitor display
- Support Chrome-based Apps (e.g. Github Desktop)
- Support Electron Apps (e.g. Visual Studio Code)
- Support WinForms, WPF, UWP (e.g. Netease Music UWP)
- Support the self-developed UI frameworks (e.g. Wechat & QQ of Tencent Inc.)
- Scanning of UI tree with high speed
- Support pinyin for Chinese (e.g. ็ฝๆไบ โ wyy / wangyiyun)
- Ignore upper and lower case
For the discussion on accessibility development and speed optimization, please refer to my following articles. Finally, the implementation scheme I adopted is to use C++
to invoke Win32API / uiautomation.h
and compile into dll
(dynamic link library). Then, I used P/Invoke
in the C# / WPF
project to use the library. In most cases, the performance was improved for about 80%.
- .NET C# AutomationElement ่ทๅๆก้ขUIๅ ็ด
- .NET C# ๆๆ็บฟ็จๆฑ | ๅฟๅๆ่ฃ่
- .NET C# AutomationElement ๅ ้ๆข็ดข
- .NET C# UIAutomationElement ่ทๅๆก้ขๅ ็ด
- .NET C# ้่ฟWin32API่ทๅ็ชๅฃๅๆงไปถ็ไฟกๆฏ
- .NET C# ่ทๅๆก้ขUIๅ ็ด ๆป็ป
- .NET C# MSAA ่ทๅๆก้ขUIๅ ็ด
- .NET C# C++ ๆทท็ผ้ฎ้ข
Note that I do not have additional time and effort to translate those articles into English. Using translators can also understand the articles well. If you still have any questions or advice, you can contact me directly. You can find ways to contact me in my GitHub homepage. This is the first time I write WPF / C#
this formally, so if you have any advice, please don't hesitate to raise issues or pull requests.
.
โโโ Ayase # Ayase Project
โ โโโ AccessibilityBridge # P/Invoke bridge for .dll
โ โ โโโ GNativeIUIAutomationManager.cs
โ โ โโโ GNativeUIElement.cs
โ โโโ App.xaml
โ โโโ App.xaml.cs # Entrance
โ โโโ AssemblyInfo.cs
โ โโโ AutomationLib # Most of them are no longer used. Serve as alternatives
โ โ โโโ GAutomationManager.cs
โ โ โโโ GIUIAutomationManager.cs
โ โ โโโ GMSAAManager.cs
โ โ โโโ GRawUIManager.cs
โ โ โโโ GUIElement.cs
โ โ โโโ Wrapper # Wrapper for Win32API used in this section
โ โ โโโ ObjectIdentifiers.cs
โ โ โโโ RECT.cs
โ โ โโโ ReferenceIdentifiers.cs
โ โ โโโ Win32API.cs
โ โโโ Ayase.csproj
โ โโโ Ayase.csproj.user
โ โโโ HotkeyLib # Global hotkey wrapping
โ โ โโโ GHotKey.cs
โ โ โโโ GKeybdEvent.cs
โ โ โโโ VirtualKeys.cs
โ โโโ MouseLib # Mouse control wrapping
โ โ โโโ GMouse.cs
โ โโโ Properties
โ โ โโโ launchSettings.json
โ โโโ ScreenLib # Screen library wrapping
โ โ โโโ PrimaryScreen.cs
โ โโโ ThreadLib # Private thread pool
โ โ โโโ GThreadPool.cs
โ โโโ UI # UI
โ โโโ FormMaskWindow.xaml
โ โโโ FormMaskWindow.xaml.cs
โ โโโ MaskWindow.cs
โ โโโ NotationLabel.cs
โ โโโ ReuseWindow.cs
โ โโโ ScreenMaskWindow.xaml
โ โโโ ScreenMaskWindow.xaml.cs
โ โโโ SearchWindow.xaml
โ โโโ SearchWindow.xaml.cs
โ โโโ SettingsWindow.xaml
โ โโโ SettingsWindow.xaml.cs
โ โโโ WindowManager.cs # Windows scheduling
โโโ Ayase.Accessibility # dll project
โ โโโ Ayase.Accessibility.vcxproj
โ โโโ Ayase.Accessibility.vcxproj.filters
โ โโโ Ayase.Accessibility.vcxproj.user
โ โโโ GConstant.h # Some constants
โ โโโ GIUIAutomationManager.cpp # Main implementation
โ โโโ GIUIAutomationManager.h
โ โโโ GUIElement.cpp # Wrapping for data structure
โ โโโ GUIElement.h
โ โโโ dllmain.cpp
โ โโโ framework.h
โ โโโ pch.cpp
โ โโโ pch.h
โโโ Ayase.sln
The TOC for generated project:
.
โโโ ...
โโโ Ayase.Accessibility.dll
โโโ <.net target>
โโโ ...
โโโ Ayase.exe
Microsoft.Toolkit.Uwp.Notifications
Notifications.Wpf
ToolGood.Words
- Start UI Scanning:
Alt + CapLocks
(We would adjust the status ofCapLocks
automatically) - Exit UI Scanning:
Esc
- Next Element:
Tab
- Previous Element:
Shift + Tab
- Click the Selected Element:
Enter
- Move the mouse to the Selected Element:
Shift + Enter
Note: most modules have been completed but not released here due to license issues. I am now making effort to crafting new alternatives that are compatible with MIT license.
- Add voice module
- Add settings module
- Add support for control by
AWSD
- Add pure mouse mode