Predicting the Resource Requirements of a Job Submission
Abstract
Grid computing aims to provide an infrastructure for distributed problem solving in dynamic virtual organizations. It is gaining interest among many scientific disciplines as well as the industrial community. However, current grid solutions still require highly trained programmers with expertise in networking, high-performance computing, and operating systems. One of the big issues in full-scale usage of a grid is matching the resource requirements of job submission to the resources available on the grid. Resource brokers and job schedulers must make estimates of the resource usage of job submissions in order to ensure efficient use of grid resources. We prop ose a prediction engine that will operate as part of a grid scheduler. This prediction engine will provide estimates of the resources required by job submission based upon historical information. This paper presents the need for such a prediction engine and discusses two approaches for history based estimation.
Attached Files
Submitted - Chep_04__Paper__Runtime_Estimation-13-10.pdf
Files
Name | Size | Download all |
---|---|---|
md5:bf47761739285887b40d23005ff73b29
|
34.6 kB | Preview Download |
Additional details
- Eprint ID
- 28185
- Resolver ID
- CaltechCACR:2004.210
- Created
-
2004-11-16Created from EPrint's datestamp field
- Updated
-
2023-01-20Created from EPrint's last_modified field
- Caltech groups
- Center for Advanced Computing Research