LEGION: Lightweight Expandable Group of Independently Operating Nodes

LEGION is a lightweight C-language software library that enables distributed asynchronous data processing with a loosely coupled set of compute nodes. Loosely coupled means that a node can offer itself in service to a larger task at any time and can withdraw itself from service at any time, provided it is not actively engaged in an assignment. The main program, i.e., the one attempting to solve the larger task, does not need to know up front which nodes will be available, how many nodes will be available, or at what times the nodes will be available, which is normally the case in a “volunteer computing” framework. The LEGION software accomplishes its goals by providing message-based, inter-process communication similar to MPI (message passing interface), but without the tight coupling requirements. The software is lightweight and easy to install as it is written in standard C with no exotic library dependencies.

LEGION has been demonstrated in a challenging planetary science application in which a machine learning system is used in closed-loop fashion to efficiently explore the input parameter space of a complex numerical simulation. The machine learning system decides which jobs to run through the simulator; then, through LEGION calls, the system farms those jobs out to a collection of compute nodes, retrieves the job results as they become available, and updates a predictive model of how the simulator maps inputs to outputs. The machine learning system decides which new set of jobs would be most informative to run given the results so far; this basic loop is repeated until sufficient insight into the physical system modeled by the simulator is obtained.

This work was done by Michael C. Burl of Caltech for NASA’s Jet Propulsion Laboratory.

This software is available for commercial licensing. Please contact Daniel Broderick of the California Institute of Technology at This email address is being protected from spambots. You need JavaScript enabled to view it.. NPO-47910

This Brief includes a Technical Support Package (TSP).

LEGION: Lightweight Expandable Group of Independently Operating Nodes (reference NPO-47910) is currently available for download from the TSP library.

Please Login at the top of the page to download.


White Papers

Unique Method for Orifice Production
Sponsored by Bird Precision
Noncontact Differential Impedance Transducer
Sponsored by Kaman
3D Printing in Space: The Next Frontier
Sponsored by Stratasys
Force Sensors for Design
Sponsored by Tekscan
The Significance of Critical Cleaning for Solar Module Fabrication
Sponsored by Alconox
Multi-Purpose Non-Contact Position/Displacement Sensing
Sponsored by Kaman

White Papers Sponsored By: