Simulating Data Flow via Multiple Secure Connections
- Created: Sunday, 01 June 2014
Goddard Space Flight Center, Greenbelt, Maryland
A software simulator was developed to simulate data flow from the Interface Data Processing Segment (IDPS) to the Science Data Segment (SDS) for the NPOESS Preparatory Project (NPP) via multiple Secure FTP (sftp) connections. The simulator is a multi-threaded Java program that handles the continuous sftp transfer of large amounts of data with some error-handling capabilities built in.
The simulator takes one orbit of data and pushes it via sftp to user-defined locations. Users have the option of specifying the number of sftp connections and the number of minutes between each orbit.
All data file names are updated with proper time-stamps simulating different orbits of data. A corresponding CRC (Cyclic Redundancy Check) file is created for each HDF5 file so that the data-7ingest software would ingest the data files without issue. The use of the simulator is crucial for testing the interface, load, and performance requirements of the SDS for the NPP.
This work was done by Chiu Wiegand, Jacqueline LeMoigne-Stewart, and LaMont Ruley of Goddard Space Flight Center. For further information, contact the Goddard Technology Transfer Office at (301) 286-5810. GSC-16402-1