Researchers: Jason Leigh, Venkatram Vishwanath, NASA Goddard Space Flight Center, Software Integration & Visualization Office

URL: http://www.evl.uic.edu/cavern/lambdaram

As NASA’s large scientific applications scale to greater numbers of processors, this creates Input / Output (I/O) bottlenecks.

Applications like numerical weather prediction models, scientific data-analysis applications, and scientific visualizations can take advantage of LambdaRAM, an approach to memory management developed at EVL. The global forecast models used in the Modeling, Analysis, and Prediction (MAP) project have substantial disk I/O latency in the analysis segment, which idles NASA’s computer processors for 25-50% of the execution time. If this I/O latency is reduced, model results can be obtained faster.

The ability to quickly pre-fetch data from disk storage and temporarily store (or cache) it in a computer’s memory, and then move the data from this “staging” computer to the computer running the weather simulation, assumes that the machines are all connected at high speed.

Based on earlier experience and information gained as an OptIPuter partner, NASA Goddard was able to more easily install several high-speed networks within its facility, which connect to the nation-wide NASA Research & Education Network (NREN) 10Gbps backbone. Ultimately, the machines used to store, access and analyze data can be located at any NASA facility connected to Goddard at high speeds.

EVL recently made modifications to make LambdaRAM work seamlessly with a legacy application to locally access large data files. LambdaRAM allowed NASA to transparently access data files across multiple servers over high-speed networks, instead of from local disks. The next step is to analyze the performance of LambdaRAM and extend the work to other NASA applications, such as MAP.

Advanced network tools being developed by EVL (and tested over IRNC links with collaborators in the Netherlands) are getting interest from other communities.

Email: spiff@uic.edu

Date: May 1, 2005 - Ongoing

Related Entries

Directory:

• Venkatram Vishwanath
• Jason Leigh

Events:

• LambdaRAM, Venkatraman Vishwanath, PhD Defense
• Exploiting Concurrency Efficiently and Correctly - (EC)2 Workshop

Papers:

• LambdaRAM: A High-Performance, Multi-Dimensional, Distributed Cache Over Ultra-High Speed Networks
• Accelerating tropical cyclone analysis using LambdaRAM, a distributed data cache over wide-area ultra-fast networks
• Verification of Data Intensive High Performance Computing Middleware

Related Categories

• Government
• Networking