Objectivity-HPSS Integration Project
DRAFT
Summary as of September 11, 1997
Purpose
*May 1997 Meeting Summary
*Objectivity-HPSS Integration Prototype
*Host Site for Objectivity HPSS Integration Development
*Participation in SC97 in November 1997
*September 16, 1997 Meeting
*Goals:
*Attendees:
*Agenda
*Objectivity HPSS Integration Requirements
*Email Alias
*
In preparation for the September meeting on the Objectivity-HPSS Integration project, a summary of project activities and communications todate is provided.
The May meeting was attended by representatives from Objectivity, the HPSS Collaboration, the HEP community and Digital.
Jamie Shiers represented the HEP community and specifically CERN, identifying requirements for functionality, platform support and timeframes.
|
Proof of Concept Date and Platform |
Production Date and Platform |
|
|
CERN |
4Q97 on IBM |
4Q98 on IBM |
|
Caltech |
IBM |
|
|
SLAC |
4Q98 on Sun Solaris, IBM |
|
|
Fermi |
2Q99 |
|
|
LBL: Babar |
Mock Data Challenge (MDC) May-Sept 1998 stress test Based on SLAC HPSS system |
Objectivity agreed to proceed with the Objectivity-HPSS Integration Project in the following message from Frank Bergandi, Objectivity President and CEO:
>Subject: Objectivity/DB - HPSS integration
>
>Following a successful meeting with representatives from the High
>Energy Physics community and the HPSS collaboration, I am pleased to
>announce that Objectivity plans to provide an interface between its
>Object Database product and the HPSS system. A proof of concept
>prototype will be demonstrated at SuperComputing 97 in November in
>San Jose, and a productised version will be made available towards
>the end of 1998. The initial work will be restricted to IBM platforms
>at the server end, although Objectivity's architecture will permit
>clients from any supported platform to access HPSS-resident data
>transparently. Additional server platforms may be added in the
>official release, as required.
>
>Objectivity is the leading supplier of scalable object databases,
>with over 140,000 licenses deployed. By coupling our database
>technology to that of HPSS, we are confident that we can meet the
>requirements of future HEP experiments in the 100TB to multi-PB
>range.
>
>Please feel free to forward this mail within the HEP community as you
>feel appropriate.
>
>Frank J. Bergandi
>President and CEO
>Objectivity, Inc.
Objectivity-HPSS Integration Prototype
Objectivity will provide a prototype by November 1997 using the hardware environment offered by NERSC at LBL.
The requirements for the prototype have been defined as follows:
>Posted-Date: Mon, 2 Jun 1997 09:37:25 +0200 (MET DST)
>Comments: Authenticated sender is <jamie@mail.cern.ch>
>From: "Jamie Shiers" <Jamie.Shiers@cern.ch>
>Organization: CERN
>To: rthorst@pi.net, LGuzenda@ix.netcom.com (Leon Guzenda)
>Date: Mon, 2 Jun 1997 09:37:46 +0100
>Subject: Draft requirements for proof of concept Objy/HPSS interf
>Reply-to: Jamie.Shiers@cern.ch
>Priority: normal
>
>
>
>Here are some draft requirements for the proof of concept Objy/HPSS
>interface. I've sent these to David Quarrie and Richard Mount, but
>got no reply, so I assume that they're ok. Did you manage to get hold
>of all the HPSS documentation etc that is required? I think that its
>very important that the date for the proof of concept doesn't slip.
>
>Objy/HPSS proof of concept should provide transparent client access to
>a federation stored in HPSS-managed storage
>
>Prototype should demonstrate client-transparent migration/staging of
databases to/from tertiary storage
> i.e. disk pool should be smaller than total federation
> only one class of service need be supported for this prototype
>
>Demonstration of sequential and random read & write access;
>creation/deletion of databases
>
>Demonstration of access from Unix and NT clients
>
>---
>
>Jamie
>
Richard Mount from SLAC has elaborated with "the minimal requirements for proof of concept would be a total substitution of the ufs file system by the HPSS API --- AMS gets all files from HPSS. Much more valuable would be that AMS uses the HPSS API if a file is not present in the ufs, with the complementary requirement to move ufs files to HPSS according to some criterion of inactivity."
Host Site for Objectivity HPSS Integration Development
The following information was received from Richard Mount:
> 1) SLAC will not have a working HPSS installation for some time (> 1 month)
> due to late deliveries of hardware and software.
>
> 2) NERSC/LBL are willing to make their HPSS development system (they have
> both production and development HPSSs) and two RS6000s available
> for the proof of concept installation. The only (perhaps) missing
> component in the setup is a C++ compiler for the machine which
> will run the AMS server. David Quarrie will see that a compiler
> is installed.
NERSC HPSS and LBL Contacts
> Contacts are: Nancy Meyer, HPSS at LBL-NERSC
> Keith Fitzgerald in charge of mass storage at NERSC
> Jim Daveler, HPSS API expert at NERSC
> David Quarrie, LBL-BaBar for Objectivity at LBL-NRSC
>
> Nancy Meyer (National Energy Research Supercomp) 311603
> 50B-2239 NLMeyer@lbl.gov 50B-2232B 486-6627 495-2998
> Keith J Fitzgerald (National Energy Research Supercomp) 321603
> 50B-2239 KJFitzgerald@lbl.gov50B-2232E 486-6495 495-2998
> Jim Daveler (National Energy Research Supercomp) 589603
> 50B-2239 JADaveler@lbl.gov 50B-2215F 495-2911
> David R Quarrie (Information & Computing Sciences) 339801
> 50B-3238 DRQuarrie@lbl.gov 50B-3238E 486-4868 486-4004
>
> 3) SLAC people who will follow progress and help where possible are:
> Andy Hanushevsky, one of the original HPSS developers
> Jacek Becla, working on the BaBar Objectivity database
> Jean Noel Albert, 6-month visitor from LAL Orsay also
> working on the BaBar database.
> Richard Mount, Director of SLAC Computing Services
> Andrew B. Hanushevsky
> abh@SLAC.Stanford.EDU
> SLAC, Mail Stop: 97
> Group: SCS
> Phone: (650) 926-2063
> Building: 050
> Room: 302
>
> Jacek Becla
> becla@SLAC.Stanford.EDU
> SLAC, Mail Stop: 97
> Group: SCS
> Phone: (650) 926-8664
> Building: 050
> Room: 360A
>
> Jean-Noel Albert
> albert@SLAC.Stanford.EDU
> SLAC, Mail Stop: 59
> Group: SCS
> Phone: (650) 926-2863
> Building: 050
> Room: 360A
>
> Richard P. Mount
> rmount@SLAC.Stanford.EDU
> SLAC, Mail Stop: 97
> Group: SCS
> Phone: (650) 926-2467
> Building: 050
> Room: 324
>
Participation in SC97 in November 1997
Objectivity is very excited about participating in SuperComputing 97 in San Jose in November 1997.
Pat Mullin from Objectivity, Inc. has initiated contact with Bob Coyne (IBM HPSS Collaboration) and Bill Kramer (LBL) regarding Objectivity participation in the HPSS Oakridge booth.
Jamie Shiers from CERN
Andy Hanushevsky from SLAC
From Objectivity:
Urs Bertschinger
Pat Mullin
Henk Nijenhuis
Peter Moore
Julie Tsoi
Glen Finston
Skip Morehead
9:00 or 9:30 Introductions, goals of meeting
9:30 – 12:00 pm 1). Discuss requirements for proof of concept, and complete product
implementation.
2). Platform coverage and dates for complete product
3). IBM or HPSS Collaboration technical support
4). HPSS installation support
5). Licensing issues if any.
Afternoon Subset of attendees visit LBL to discuss working plan (site and system access, support, etc.)
Objectivity HPSS Integration Requirements
Jamie Shiers of CERN has established a group alias:
objy-hpss@listbox.cern.ch
This alias should be used for all communication regarding the project.
You can find out who is on the list by sending a mail to
listserver@listbox.cern.ch
with a line
who objy-hpss
The following people are currently subscribed:
Members of list 'objy-hpss':
Fabrizio Gagliardi - IT <fab@vxcern.cern.ch> (# 1417)
Richard Mount - PPE <rmount@slac.stanford.edu> (# 2755)
Dave Quarrie - PPE <drquarrie@lbl.gov> (# 17061)
Harry Renshall - IT <renshall@mail.cern.ch> (# 3272)
Jamie Shiers - IT <jamie@zfatal.cern.ch> (# 3635)
boeheim@SLAC.Stanford.EDU
abh@stanford.edu
meyer@nersc.gov
KJFitzgerald@LBL.Gov
Albert@SLAC.Stanford.EDU
brian.clark@objectivity.com
pat.mullin@objectivity.com
julie.Tsoi@objectivity.com
leon.guzenda@objectivity.com
rick.terhorst@objectivity.com
glen.finston@objectivity.com
elizabeth.laduca@objectivity.com
henk.nijenhuis@objectivity.com
urs.bertschinger@objectivity.com
JADaveler@lbl.gov
peter.moore@objectivity.com
john.myser@objy.com
22 subscribers
As of this date, the following people are associated with the alias: