Grand Challenge Application on HENP Data

Focussed on

Efficient Data Access for RHIC


A Sharper Drill Bit for Mining the QGP



The purpose of this project is to develop techniques and tools that will enable efficient access to the massive datasets for the RHIC experiments (beginning in late 1999), in their search for the Quark-Gluon-Plasma (QGP).

The requirements imposed by a very large (PB scale) tape-based database necessitates developing new techniques for organizing data and coordinating access. This involves developing tools to store data as it is generated according to predicted access patterns as well as monitoring access patterns in order to decide when and how to re-organize the data as necessary. A key ingredient to efficient tape access is a disk resident index which is queried to identify which tape files to access, permit scheduling of staging files to disk to balance multi-user access and enable event-parallel processing for analysis of the selected data. These tools will operate with an HPSS storage system and provide data access in an ODMG object framework.

Simulated data generated at NERSC and the RHIC Computing Facility (RCF) will be used in testing and developing these tools before experiment operations begin.


Project Participants

This project is associated with the National Energy Research Scientific Computing Center (NERSC) at Berkeley Lab and the RHIC Computing Facility (RCF) at Brookhaven Lab.



For questions and additional information about this project contact Doug Olson (

Related Projects



GC Project working web.

Last Update: September 17, 1997