An interdisciplinary team of mechanical engineers and autism experts at Vanderbilt University have developed robotic systems that will enhance the basic social learning skills of children with autism spectrum disorder (ASD).
The initial impetus for the project came from Vanderbilt Professor of Mechanical Engineering and Computer Engineering Nilanjan Sarkar. His original research involved the development of systems to improve the man-machine interface. He did so by outfitting computer/robot users with biosensors and analyzing variations in various readings like blood pressure and skin response to evaluate their emotional state. The information was used to program computers and robots to respond accordingly. At the time, several experiments had been conducted that suggested young children in general, and young children with ASD in particular, found robots especially appealing.
The researchers built an “intelligent environment” around NAO, a commercial humanoid robot made in France, whose control architecture was augmented for the purpose. The small robot stands on a table at the front of the room. Flat panel displays are attached to the side walls. The chair where the child sits faces the front of the room and is high enough to put the robot at eye level. The room is equipped with a number of inexpensive web cameras that are aimed at the chair. Their purpose is to track the child’s head movements, so the system can determine where he or she is looking. To aid in this effort, children in the study wore a baseball cap decorated with a strip of LED lights that allowed the computer to infer where they are looking.
NAO has been programmed with a series of verbal prompts, such as “look over here” and “let’s do some more,” and gestures such as looking and pointing at one of the displays, that imitate the prompts and gestures that human therapists use in joint attention training. The protocol begins with a verbal prompt that asks the child to look at an image or video displayed on one of the screens. If the child doesn’t respond, then the therapist provides increasing support by combining a verbal prompt with physical gestures such as turning her head or pointing. When the child looks at the target then the therapist responds with praise, such as telling the child, “good job.”
Also: Read a Q&A with one of NASA's Robonaut engineers.