CHANNELS

Aerospace

Automotive

Automated & Autonomous Vehicles

Battery & Electrification Technology

Defense

Drone TV

Electronics

Manufacturing & Prototyping

Materials

Medical

Motion Control

RF & Microwave Technology

Robotics & Automation

Sensors & IoT

Test & Measurement

Aerospace
Automotive
Automated & Autonomous Vehicles
Battery & Electrification Technology
Defense
Drone TV
Electronics
Manufacturing & Prototyping
Materials
Medical
Motion Control
RF & Microwave Technology
Robotics & Automation
Sensors & IoT
Test & Measurement
Aerospace & Defense
Search Results

BrushLens: Accessible Touchscreen Interface Actuation

Watch this video to learn more about BrushLens, a hardware interaction proxy that performs physical interactions on behalf of users while allowing them to continue utilizing accessible interfaces for interface exploration and command input. BrushLens maintains an interface model for accurate target localization and utilizes exchangeable actuators for physical actuation across a variety of device types, effectively reducing user workload and minimizing the risk of mistouch.

“So many technologies around us require some assumptions about users’ abilities, but seemingly intuitive interactions can actually be challenging for people,” said Chen Liang  , a doctoral student in computer science and engineering.

Topics:
Electronics Electronics & Computers

More From SAE Media Group

    Transcript

    00:00:03 touchscreen devices are often designed with ability assumptions including the ability to perceive video information locate the target button and precisely perform the predefined gestures which make these devices inaccessible for users with diverse abilities such as visual or motor impairments we introduce brush lens a hardware interaction proxy designed to make touch

    00:00:26 screen devices more accessible for people with diverse abilities brushless is a hardware device that is wirelessly connected to the user's smartphone it can be attached to the smartphone as a phone case and uses an array of solenoids covered with conductive fabric to action the screen when activated each solenoid can punch the screen thereby simulating the

    00:00:50 touching gesture using the smartphone camera and the IMU data brush lens can perceive the interface and precisely determine when to touch allowing users to brush on the screen and delegate the precise actuation to the system [Music] we demonstrate two possible actuator setups for brushless solenoid and auto

    00:01:11 Clicker the solenoid actuator can push the touchscreen to simulate finger touches this allows solenoids to be compatible with various touch screen types such as capacitive touchscreens resistive touch screens and physical touchpad the auto clicker actuator Alters the capacitance of the screen to simulate a fingertip touch with no mechanical

    00:01:34 movement for actuation auto clickers have lower accuration delays than solenoids resulting in better actuation accuracy on capacitive touch screens all actuators are controlled by the brushless software which calculate the device pose from sensor readings and decides when and which solenoid to activate given the same interface layout and the user's command

    00:01:58 using their personal smartphones users can explore the touchscreen and command brushes through an accessible interface we demonstrate three different modes for various interaction needs screen reader mode but a magnifier mode and the interaction routine mode screen reader mode this mode protects all buttons from the current interface to the smartphone internet

    00:02:25 users can use the screen reader on their smartphone such as voiceover to explore inaccessible touch screens brushless uses a great system to Max the screen locations into cells once the user selects the button the one brushless to press brush lens will speak out the target coordinate and brushless current coordinate for movement guidance pressed

    00:02:50 button magnifier mode this mode enlarges and displays touchscreen buttons currently around brushless on the user's smartphone this mode makes smaller or densely packed buttons easier to select which reduces the need for flying motor control and the risk of Miss Touches for motor impaired users with Tremor or spasm an additional handle can be added to the

    00:03:14 extendable slot on the case to support different grass preferences interactions routine mode brushlessness can save a sequence of input as an interaction routine instead of exploring each interface and clicking buttons one by one this mode allows users to quickly actually the sequence of buttons such as ordering a safe place of items or typing password to speed up the interaction

    00:03:42 our user study shows that brushlessness enabled weirdly impaired users to interact with the inaccessible touch screens across Wireless interaction tasks reduce incorrect touches by up to 73.9 percent for participants with Tremor or spasm and give users a sense of control over the proxy for actuation we envisioned that brushless could support a broad range of interaction

    00:04:07 needs reduce the risk of unintended interactions and enable individuals with diverse abilities to benefit from brushless across various daily scenarios