Registration for PDPG Collaboration Meeting

Questions for Job Scheduling and Management meeting, for gripe and complaint and ultimately - for answering!

Experiment Workload Questions:

SI2000 cpu secs/byte of data transferred.
Are computations floating point intensive?
Typical size of input data blocks for execution of a job
Typical size of output data blocks for execution of a job
Ancillary data to be accessed and from where - e.g. calibration data from a central database.
Is job checkpointing required? at what granularity?
How many sites are typically available to execute jobs?
How many users are submitting jobs and what is the profile of length of job execution?
What batch systems must be supported?
What security systems must be supported?
Is the data processing model one of central management and support or distributed management and support?

Check the Hofmann report and the PPDG CS-11 Requirements documents

Lets see if we can complete/check this table from DGRA V2.09:

Appli-cation	First Data	Data Rate MB/s	Total? Raw? Data Volume (TB/yr)	User Comm-unity	Data Access Pattern	Compute Rate (Gflops)	Type of data
SDSS	1999	8	10	100s	Object access and streaming	1 to 50	Catalogs, image files
LIGO	2002	10	250	100s	Random, 100 MB streaming	50 to 10,000	Multiple channel time series, Fourier transformations
BaBar	2000	15	500	500	Object Database	TBD	Raw and processed events (?/event) need official numbers
D0	2001	15	350	500	Sequential access to files	TBD	Raw and processed events (250Kbytes/event)
STAR	2000	TBD	TBD	TBD	TBD	TBD	TBD
JLAB	2000	TBD	TBD	TBD	TBD	TBD	TBD
ATLAS/CMS	2006	100 [CFK1]	5000	1000s	Streaming, 1 MB object access	120,000	Events, 100 GB/sec simultaneous access

[CFK1]Koen thinks this number may be too low.

General Questions (experiments and cs vision):

How are data and job co-located and scheduled?
What are the interfaces to resource discovery and resource broker?
What are the plans for job scheduling and management portals?
What mechanisms are in place for robustness e.g. restart, graceful degradation under load?
What are the requirements and support for interactive jobs?