2012

Data::Downloader

Downloading and organizing large amounts of files is challenging, and often done using ad hoc methods. This software is capable of downloading and organizing files as an OpenSearch client. It can subscribe to RSS (Really Simple Syndication) feeds and Atom feeds containing arbitrary metadata, and maintains a local content addressable data store. It uses existing standards for obtaining the files, and uses efficient techniques for storing the files. Novel features include symbolic links to maintain a sane directory structure, checksums for validating file integrity during transfer and storage, and flexible use of server-provided metadata.

This work was done by Brian Duggan of Adnet Systems and Curt Tilmes of NASA for Goddard Space Flight Center. For further information, contact the Goddard Innovative Partnerships Office at (301) 286-5810. GSC-16203-1.

White Papers

Electronic Component Testing: A Non-contact Sport
Sponsored by FLIR
High Reliability Flexible Circuits for the Medical Marketplace
Sponsored by Tech-Etch
Bonded Magnets: A Versatile Class of Permanent Magnets
Sponsored by Magnet Applications
Controlling the EMI Effects of Avionic Equipment
Sponsored by Orbel
Selecting the Right Material for 3D Printing
Sponsored by Proto Labs
Protecting the Sky
Sponsored by Rohde & Schwarz A&D

White Papers Sponsored By:

The U.S. Government does not endorse any commercial product, process, or activity identified on this web site.