Motion-Capture-Enabled Software for Gestural Control of 3D Models

Current state-of-the-art systems use general-purpose input devices such as a keyboard, mouse, or joystick that map to tasks in unintuitive ways. This software enables a person to control intuitively the position, size, and orientation of synthetic objects in a 3D virtual environment. It makes possible the simultaneous control of the 3D position, scale, and orientation of 3D objects using natural gestures.

Enabling the control of 3D objects using a commercial motion-capture system allows for natural mapping of the many degrees of freedom of the human body to the manipulation of the 3D objects. It reduces training time for this kind of task, and eliminates the need to create an expensive, special-purpose controller.

This work was done by Jeffrey S. Norris, Victor Luo, Thomas M. Crockett, Khawaja S. Shams, and Mark W. Powell of Caltech; and Anthony Valderrama of MIT for NASA’s Jet Propulsion Laboratory.

This software is available for commercial licensing. Please contact Daniel Broderick of the California Institute of Technology at This email address is being protected from spambots. You need JavaScript enabled to view it.. NPO-47893

This Brief includes a Technical Support Package (TSP).

Motion-Capture-Enabled Software for Gestural Control of 3D Models (reference NPO-47893) is currently available for download from the TSP library.

Please Login at the top of the page to download.

White Papers

The U.S. Government does not endorse any commercial product, process, or activity identified on this web site.