[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

CHEP abstract on Storage Manager



This was sent on Friday.  It includes the modifications that Dave
Malon suggested.

------------------------------------------------------------------
Storage Management for High Energy Physics analysis applications

L. Bernardo, H. Nordberg, D. Rotem, A. Shoshani, A. Sim

National Energy Research Scientific Computing (NERSC) Division 
Lawrence Berkeley National Laboratory
Berkeley, California

We describe the design, architecture and status of the Storage
Management component being developed as part of the High Energy and
Nuclear Physics Grand Challenge (HENP-GC) collaboration of several
U.S. Department of Energy laboratories.  This component addresses the
problem of efficient organization of the event data stored on
tertiary storage in order to minimize the number of tape mounts and
files accessed when subsets of the events are requested.  The concept
is to match the order of storing the event data on tapes according to
their anticipated access patterns rather than the order they were
generated.  The design is based on partitioning the events into cells
that are defined over bins in the property space of the events.  We
emphasize the storage management aspects of the system, including:
the design and implementation of a clustering analyzer (which
analyzes clustering properties of the events in a high-dimensional
space), bit-sliced indexing methods over the binning space (to
identify files that qualify for the query and provide query size
estimation), support for scheduling multiple, possibly overlapping,
queries, and a cache manager which interacts with the HPSS mass
storage management system.  The first version of the system was
implemented on a Sun Solaris system using Orbix CORBA technology.

-----------------------------------------------------------------------
The following confirmation was recieved:

CHEP'98 Abstract Submission Confirmation

Thank you for your submission. Your abstract number is 154. You will be
notified by 1 July, 1998.

Please send any questions or comments to chep98@anl.gov.