Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published 2011 | Published
Journal Article Open

Workflow management in large distributed systems

Abstract

The MonALISA (Monitoring Agents using a Large Integrated Services Architecture) framework provides a distributed service system capable of controlling and optimizing large-scale, data-intensive applications. An essential part of managing large-scale, distributed data-processing facilities is a monitoring system for computing facilities, storage, networks, and the very large number of applications running on these systems in near realtime. All this monitoring information gathered for all the subsystems is essential for developing the required higher-level services—the components that provide decision support and some degree of automated decisions—and for maintaining and optimizing workflow in large-scale distributed systems. These management and global optimization functions are performed by higher-level agent-based services. We present several applications of MonALISA's higher-level services including optimized dynamic routing, control, data-transfer scheduling, distributed job scheduling, dynamic allocation of storage resource to running jobs and automated management of remote services among a large set of grid facilities.

Additional Information

© 2011 Institute of Physics. Published under licence by IOP Publishing Ltd.

Attached Files

Published - ISI000301299200022Proceedings.pdf

Files

ISI000301299200022Proceedings.pdf
Files (942.2 kB)
Name Size Download all
md5:5cea50871bbde960df1b38a6881d0d87
942.2 kB Preview Download

Additional details

Created:
August 19, 2023
Modified:
October 17, 2023