{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T07:07:10Z","timestamp":1768028830903,"version":"3.49.0"},"reference-count":29,"publisher":"Wiley","issue":"16","license":[{"start":{"date-parts":[[2009,7,2]],"date-time":"2009-07-02T00:00:00Z","timestamp":1246492800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Concurrency and Computation"],"published-print":{"date-parts":[[2009,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Workflows are widely used in applications that require coordinated use of computational resources. Workflow definition languages typically abstract over some aspects of the way in which a workflow is to be executed, such as the level of parallelism to be used or the physical resources to be deployed. As a result, a workflow management system has the responsibility of establishing how best to execute a workflow given the available resources. The Pegasus workflow management system compiles abstract workflows into concrete execution plans, and has been widely used in large\u2010scale e\u2010Science applications. This paper describes an extension to Pegasus whereby resource allocation decisions are revised during workflow evaluation, in the light of feedback on the performance of jobs at runtime. The contributions of this paper include: (i) a description of how adaptive processing has been retrofitted to an existing workflow management system; (ii) a scheduling algorithm that allocates resources based on runtime performance; and (iii) an experimental evaluation of the resulting infrastructure using grid middleware over clusters. Copyright \u00a9 2009 John Wiley &amp; Sons, Ltd.<\/jats:p>","DOI":"10.1002\/cpe.1446","type":"journal-article","created":{"date-parts":[[2009,7,2]],"date-time":"2009-07-02T07:41:09Z","timestamp":1246520469000},"page":"1965-1981","source":"Crossref","is-referenced-by-count":29,"title":["Adaptive workflow processing and execution in Pegasus"],"prefix":"10.1002","volume":"21","author":[{"given":"Kevin","family":"Lee","sequence":"first","affiliation":[]},{"given":"Norman W.","family":"Paton","sequence":"additional","affiliation":[]},{"given":"Rizos","family":"Sakellariou","sequence":"additional","affiliation":[]},{"given":"Ewa","family":"Deelman","sequence":"additional","affiliation":[]},{"given":"Alvaro A. A.","family":"Fernandes","sequence":"additional","affiliation":[]},{"given":"Gaurang","family":"Mehta","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2009,7,2]]},"reference":[{"key":"e_1_2_7_2_2","doi-asserted-by":"publisher","DOI":"10.1155\/2005\/128026"},{"key":"e_1_2_7_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2008.06.012"},{"key":"e_1_2_7_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84628-757-2_27"},{"key":"e_1_2_7_5_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bth361"},{"key":"e_1_2_7_6_2","unstructured":"AltintasI BerkleyC JaegerE JonesM LudascherB MockS.Kepler: An extensible system for design execution of scientific workflow. 16th International Conference on Scientific and Statistical Database Management (SSDBM'04) Santorini Island Greece 21\u201323 June 2004."},{"key":"e_1_2_7_7_2","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1007\/978-1-84628-757-2_20","article-title":"The triana workflow environment: Architecture and applications","author":"Taylor I","year":"2007","journal-title":"Workflows for e\u2010Science"},{"key":"e_1_2_7_8_2","doi-asserted-by":"crossref","unstructured":"BlytheJ JainS DeelmanE GilY VahiK MandalA KennedyK.Task scheduling strategies for workflow\u2010based applications in grids. IEEE Symposium on Cluster Computing and the Grid Cardiff U.K. 2005.","DOI":"10.1109\/CCGRID.2005.1558639"},{"key":"e_1_2_7_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/1084805.1084816"},{"key":"e_1_2_7_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAC.2005.21"},{"key":"e_1_2_7_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICGRID.2006.310995"},{"key":"e_1_2_7_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72360-8_26"},{"key":"e_1_2_7_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2007.370305"},{"key":"e_1_2_7_14_2","doi-asserted-by":"publisher","DOI":"10.1155\/2004\/930924"},{"key":"e_1_2_7_15_2","doi-asserted-by":"crossref","unstructured":"LeeK SakellariouR PatonNW FernandesAAA.Workflow adaptation as an autonomic computing problem. Proceedings of 2nd Workshop on Workflows in Support of Large\u2010scale Science Monterey Bay U.S.A. 2007;29\u201334.","DOI":"10.1145\/1273360.1273366"},{"key":"e_1_2_7_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/71.993206"},{"key":"e_1_2_7_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/11610113"},{"key":"e_1_2_7_18_2","doi-asserted-by":"crossref","unstructured":"FreyJ TannenbaumT LivnyM FosterIT TueckeS.Condor\u2010G: A computation management agent for multi\u2010institutional grids. HPDC San Francisco U.S.A. 2001;55\u201363.","DOI":"10.1109\/HPDC.2001.945176"},{"key":"e_1_2_7_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/E-SCIENCE.2006.261098"},{"key":"e_1_2_7_20_2","doi-asserted-by":"crossref","unstructured":"BerrimanGB DeelmanE GoodJ JacobJ KatzDS KesselmanC LaityA PrinceTA SinghG SuM.Montage: A grid enabled engine for delivering custom science\u2010grade image mosaics on demand. Proceedings of the SPIE Conference on Astronomical Telescopes and Instrumentation Glasgow U.K. June 2004.","DOI":"10.1117\/12.550551"},{"key":"e_1_2_7_21_2","volume-title":"Workflows for e\u2010Science","author":"Brown DA","year":"2006"},{"key":"e_1_2_7_22_2","doi-asserted-by":"publisher","DOI":"10.1063\/1.882861"},{"key":"e_1_2_7_23_2","doi-asserted-by":"crossref","unstructured":"ChervenakA DeelmanE FosterI GuyL HoschekW IamnitchiA KesselmanC KunsztP RipeanuM SchwartzkopfB StockingerH StockingerK TierneyB.Giggle: A framework for constructing sclable replica location services. Proceedings of Supercomputing 2002 (SC2002) Baltimore U.S.A. November 2002.","DOI":"10.1109\/SC.2002.10024"},{"key":"e_1_2_7_24_2","unstructured":"DeelmanE KesselmanC MehtaG. Transformation catalog design for griphyn. Technical Report GriPhyN\u20102001\u201017 2001. Available at:www.griphyn.org[10 September2001]."},{"key":"e_1_2_7_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPDC.2001.945188"},{"key":"e_1_2_7_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(02)00094-7"},{"key":"e_1_2_7_27_2","unstructured":"BaruC MooreR RajasekarA WanM.The SDSC storage resource broker. CASCON'98 Toronto Canada 1998."},{"key":"e_1_2_7_28_2","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1007\/BFb0053981","volume-title":"A Resource Management Architecture for Metacomputing Systems","author":"Czajkowski K","year":"1998"},{"key":"e_1_2_7_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2003.1160055"},{"key":"e_1_2_7_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-004-0147-z"}],"container-title":["Concurrency and Computation: Practice and Experience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fcpe.1446","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpe.1446","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T16:05:55Z","timestamp":1739203555000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cpe.1446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,7,2]]},"references-count":29,"journal-issue":{"issue":"16","published-print":{"date-parts":[[2009,11]]}},"alternative-id":["10.1002\/cpe.1446"],"URL":"https:\/\/doi.org\/10.1002\/cpe.1446","archive":["Portico"],"relation":{},"ISSN":["1532-0626","1532-0634"],"issn-type":[{"value":"1532-0626","type":"print"},{"value":"1532-0634","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,7,2]]}}}