High-Speed Noninvasive Eye-Tracking System

This system operates at a frame rate of several kilohertz.

The figure schematically depicts a system of electronic hardware and software that noninvasively tracks the direction of a person’s gaze in real time. Like prior commercial noninvasive eye-tracking systems, this system is based on (1) illumination of an eye by a low-power infrared light-emitting diode (LED); (2) acquisition of video images of the pupil, iris, and cornea in the reflected infrared light; (3) digitization of the images; and (4) processing the digital image data to determine the direction of gaze from the centroids of the pupil and cornea in the images. Relative to the prior commercial systems, the present system operates at much higher speed and thereby offers enhanced capability for applications that involve human-computer interactions, including typing and computer command and control by handicapped individuals, and eye-based diagnosis of physiological disorders that affect gaze responses.

Most of the prior commercial noninvasive eye-tracking systems rely on standard video cameras, which operate at frame rates of about 30 Hz. In a typical system, the video-data stream is processed either in the central processing unit of a host computer or in a digital signal processor on a framegrabber board. Such a system is limited to slow, full-frame operation in which the burden of processing the full-frame image data is placed on the host computer.

In the present system, most control functions and processing of image data are performed by firmware on an onboard field-programmable gate array (FPGA). This aspect of the design relieves the host computer of much of the burden of transferring full-image data via the host bus (which is typically a slow operation) or the need to process the full image data after transfer to the host PC. The firmware for the FPGA is relatively easily extendable to the design of a compact application-specific integrated circuit that could be mass-produced. It is envisioned that with further development, the architecture of this system could progress to that of an affordable, portable, stand-alone computer-peripheral unit similar to an optical mouse.

The U.S. Government does not endorse any commercial product, process, or activity identified on this web site.