AI Pilot Can Navigate Crowded Airspace

Carnegie Mellon University, Pittsburg, PA

A team of Carnegie Mellon University researchers have developed an AI pilot that can navigate a crowded airspace. The team tested the AI on two flight simulators: one controlled by the AI, the other by a human — both operating in the same airspace. (Image: CMU)

A team of researchers at Carnegie Mellon University believe they have developed the first AI pilot that enables autonomous aircraft to navigate a crowded airspace. The artificial intelligence can safely avoid collisions, predict the intent of other aircraft, track aircraft and coordinate with their actions, and communicate over the radio with pilots and air traffic controllers. The researchers aim to develop the AI so the behaviors of their system will be indistinguishable from those of a human pilot.

To interact with other aircraft as a human pilot would, the AI uses both vision and natural language to communicate its intent with other aircraft, whether piloted or not. This behavior leads to safe and socially compliant navigation. Researchers achieved this implicit coordination by training the AI on data collected at the Allegheny County Airport and the Pittsburgh-Butler Regional Airport that included air traffic patterns, images of aircraft, and radio transmissions.

The AI uses six cameras and a computer vision system to detect nearby aircraft in a manner similar to that of a human pilot. Its automatic speech recognition function uses natural language processing techniques to both understand incoming radio messages and communicate with pilots and air traffic controllers using speech.

Advancement in autonomous aircraft will broaden opportunities for drones, air taxis, helicopters, and other aircraft to operate — moving people and goods, inspecting infrastructure, treating fields to protect crops, and monitoring for poaching or deforestation — often without a pilot behind the controls. These aircraft will have to fly, however, in an airspace already crowded with small airplanes, medical helicopters, and more.

While autopilot controls are common among commercial airliners and other aircraft operating in higher altitudes under instrument flight rules (IFR), developing an AI to handle the often crowded and pilot-controlled lower-altitude traffic operating under visual flight rules (VFR) has challenged the aerospace industry. The team’s AI is designed to seamlessly interact with aircraft in the VFR airspace.

The team has yet to test the AI pilot on actual aircraft, but it has performed well on flight simulators. To test the AI, the team sets up two flight simulators. One is controlled by the AI, the other by a human. Both operate in the same airspace. The AI can safely navigate around the piloted aircraft, even if the person behind the controls is not an experienced pilot.

Commercially, the AI could help autonomous aircraft deliver packages and ferry passengers.

For more information, contact Aaron Aupperlee at This email address is being protected from spambots. You need JavaScript enabled to view it.; 412-268-9068.