Who needs a keyboard, a mouse, or a joystick? A researcher from Arizona State University wants to command machines with the human brain.

In fact, within ten years, Panagiotis Artemiadis, professor of mechanical and aerospace engineering at Arizona State University, envisions a swarm of brain-controlled drones playing a critical role in a range of applications, including agriculture and search-and-rescue operations.

Using Your Brain

The essential technology component of mind-controlled UAVs, or unmanned aerial vehicles, is the interface: a combination of hardware and algorithms that maps one’s brain activation to commands for a robotic system.

Panagiotis Artemiadis, professor of mechanical and aerospace engineering at Arizona State University, with two drones in his Human-Oriented Robotics and Control (HORC) Lab at the ASU Tempe campus. (Credit: ASU)

Using electrodes placed on the scalp to record electrical activity, the non-invasive Electroencephalography (EEG) method measures voltage fluctuations resulting from the neurons’ ionic current.

The hardware then measures brain activation as the subject thinks about an intended motion for the machine. The algorithms decode those activations to control commands for the robotic system.

At ASU’s Human-Oriented Robotics and Control (HORC) Lab, Artemiadis and his fellow researchers have evaluated the brain's capacity to direct non-human behaviors, including the flight of drones.

In 2016, Artemiadis tested the ability of a single operator to control three UAVs, guiding each through a narrow loop. Watch the demo:

The subject used a hybrid brain-machine interface, combining EEG-recorded brain activity with input from a joystick. To control the multiple drones, the user had to think about shrinking or expanding the shape of the UAV grouping as a whole.

By developing algorithms that extracted specific information from the brain, the experiment demonstrated the ability for humans to steer not just a single machine, but a swarm.

A Robotic Swarm

Collective behaviors are abundant in nature, but the idea of a flock or herd has only recently been adopted to robotic concepts.

A robotic “swarm” system consists of a large group of interchangeable vehicles that use information, obtained via local sensing and communication, to execute autonomous decisions.

Artemiadis and his team tested a “human-swarm interface” to, in effect, decode the brain and extract information related to desired collective behaviors, like the expansion of a swarm’s coverage or the implementation of a specific formation.

“The human-swarm interface is a complex ‘keyboard’ that lets humans think, instead of type, collective commands for a swarm of drones, and those commands are wirelessly transmitted to the drones,” Artemiadis told Tech Briefs.

The algorithms developed at the HORC lab extract brain signals. The ASU team applies machine learning and pattern recognition algorithms to translate the brain’s electrical signals into control commands that are wirelessly transmitted to the drones.

“I think the most exciting feature of our results is the ability to extract information from the brain that goes beyond controlling our body, and can be successfully used to control systems and machines that do not resemble anything the brain was made to control,” said Artemiadis.

New Applications: Swarms of Ideas

To understand the value of decoding the brain to control a swarm of drones, one must first appreciate the advantages of a swarm itself.

“The redundancy in a swarm makes its operation robust to vehicle failures and disturbances, which also enables the use of sacrificial platforms, and its distributed activity can conceal the system’s mission from an opponent,” said Artemiadis.

The integration of very large teams of robots into comprehensive systems enables new tasks and missions, including search, exploration, and surveillance, according to the ASU researcher.

Armed with infrared imaging equipment, a drone swarm, for example, could provide real-time tracking of a forest fire, allowing responders to adjust their plans on the fly. Teams of drones could also be called on to create topographic maps for soil analysis and irrigation planning.

Some drone systems are already being used to spray crops. Swarms, however, will be able to accomplish the task more quickly and efficiently, said Artemiadis.

In fact, the Arizona State researcher sees the mind-controlled drones taking the skies in the very-near future.

“As the noninvasive sensors for measuring the brain activity are becoming cheaper and more robust, I believe in the next 10 years we will be able to see brain-controlled UAVs playing critical roles in those applications,” said Artemiadis, who will continue his research this year at the university.

What do you think? In 10 years, will brain-controlled UAVs support critical applications? Share your comments below.

Related Content: