{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T20:07:18Z","timestamp":1771963638648,"version":"3.50.1"},"reference-count":24,"publisher":"Wiley","issue":"7","license":[{"start":{"date-parts":[[2015,11,13]],"date-time":"2015-11-13T00:00:00Z","timestamp":1447372800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"name":"NSF","award":["1339774"],"award-info":[{"award-number":["1339774"]}]},{"name":"Google Summer of Code 2015"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Concurrency and Computation"],"published-print":{"date-parts":[[2016,5]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Science Gateways provide scientists with tools for creating, executing, and monitoring scientific experiments on multiple resource infrastructures. Apache Airavata abstracts interactions between gateways and distributed computing infrastructures like Extreme Science and Engineering Discovery Environment, international grids, and campus clusters. Airavata consists of several component services such as the API server, Orchestrator, Workflow Interpreter, Credential Store, and Application Factory. In addition, Airavata uses third party software, including RabbbitMQ for messaging, MySQL for production database management, and Apache Zookeeper for internal communications. In this paper, we discuss our initial experiences with leveraging open source technologies to manage Airavata and its dependent components to deploy, detect, and restart failed components in an auto\u2010scaling platform. Such capabilities will allow Airavata services to be deployed in a wide area, large Virtual Machine (VM) based cluster, and a developer's laptop. The emerging technologies in cloud computing and Big Data that address these needs are the following: Docker, Marathon, and Apache Mesos. Docker is a Linux\u2010based lightweight container that allows different applications to run isolated from each other but safely share the machine's resources. Docker images of applications can be published in registries and retrieved for execution in the target infrastructures. Marathon provides a cluster\u2010wide init and control system for services, including Docker containers. Mesos provides a cluster\u2010wide framework to schedule tasks based on fine\u2010grained resource needs. Mesosphere provides the packages, scripts, and web interface to ease the use of these technologies. We present the design, experience, and lessons learned from integrating Mesos, Docker, and Marathon with Apache Airavata. Copyright \u00a9 2015 John Wiley &amp; Sons, Ltd.<\/jats:p>","DOI":"10.1002\/cpe.3708","type":"journal-article","created":{"date-parts":[[2015,11,14]],"date-time":"2015-11-14T01:48:42Z","timestamp":1447465722000},"page":"1952-1959","source":"Crossref","is-referenced-by-count":22,"title":["Integrating Apache Airavata with Docker, Marathon, and Mesos"],"prefix":"10.1002","volume":"28","author":[{"given":"Pankaj","family":"Saha","sequence":"first","affiliation":[{"name":"Department of Computer Science Binghamton University, State University of New York (SUNY) Binghamton NY USA"}]},{"given":"Madhusudhan","family":"Govindaraju","sequence":"additional","affiliation":[{"name":"Department of Computer Science Binghamton University, State University of New York (SUNY) Binghamton NY USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6374-095X","authenticated-orcid":false,"given":"Suresh","family":"Marru","sequence":"additional","affiliation":[{"name":"Research Technologies University Information Technology Services, Indiana University Bloomington IN USA"}]},{"given":"Marlon","family":"Pierce","sequence":"additional","affiliation":[{"name":"Research Technologies University Information Technology Services, Indiana University Bloomington IN USA"}]}],"member":"311","published-online":{"date-parts":[[2015,11,13]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"crossref","unstructured":"MarruS PierceM PamidighantamS WimalasenaC.Apache Airavata as a laboratory: architecture and case study for component\u2010based gateway middleware. In Proceedings of the 1st Workshop on The Science of Cyberinfrastructure: Research Experience Applications and Models 2015;9\u201326. ACM.","DOI":"10.1145\/2753524.2753529"},{"key":"e_1_2_8_3_1","volume-title":"Concurrency and Computation: Practice and Experience","author":"Pierce ME","year":"2015"},{"key":"e_1_2_8_4_1","volume-title":"Concurrency and Computation: Practice and Experience","author":"Lawrence KA","year":"2015"},{"key":"e_1_2_8_5_1","doi-asserted-by":"crossref","unstructured":"PierceM MarruS DemelerB SinghR GorbetG. The apache airavata application programming interface: overview and evaluation with the UltraScan science gateway. InProceedings of the 9th Gateway Computing Environments Workshop IEEE Press 2014;25\u201329.","DOI":"10.1109\/GCE.2014.15"},{"key":"e_1_2_8_6_1","doi-asserted-by":"crossref","unstructured":"BrandonE SinghR EvrardAE BeckerMR BushaMT KravtsovAV MarruS PierceM WechslerRH. A high throughput workflow environment for cosmological simulations.Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the campus and beyond ACM 2012;34.","DOI":"10.1145\/2335755.2335830"},{"key":"e_1_2_8_7_1","volume-title":"Concurrency and Computation: Practice and Experience","author":"Brookes EH","year":"2015"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocs.2014.01.005"},{"key":"e_1_2_8_9_1","article-title":"BioVLAB\u2010MMIA\u2010NGS: microRNA\u2013mRNA integrated analysis using high\u2010throughput sequencing data","author":"Chae H","year":"2014","journal-title":"Bioinformatics"},{"key":"e_1_2_8_10_1","unstructured":"Powered bySeeMhttp:\/\/mesos.apache.org\/documentation\/latest\/powered\u2010by\u2010mesos\/"},{"key":"e_1_2_8_11_1","unstructured":"Docker: build ship run any app anywhere:https:\/\/www.docker.com\/"},{"key":"e_1_2_8_12_1","unstructured":"HuntPet al.ZooKeeper: wait\u2010free coordination for internet\u2010scale systems. USENIX Annual Technical Conference. Vol. 8.2010."},{"key":"e_1_2_8_13_1","unstructured":"Clustered Zookeper instances:http:\/\/zookeeper.apache.org\/doc\/r3.4.5\/zookeeperAdmin.html#sc_zkMulitServerSetup"},{"key":"e_1_2_8_14_1","unstructured":"Mesosphere: introducing mesosphere datacenter operating system:https:\/\/mesosphere.com\/"},{"key":"e_1_2_8_15_1","unstructured":"Marathon: a cluster\u2010wide init and control system for services in cgroups or Docker containers. Seehttps:\/\/mesosphere.github.io\/marathon\/"},{"key":"e_1_2_8_16_1","unstructured":"Airavata Docker Postings:https:\/\/www.mail\u2010archive.com\/dev@airavata.apache.org\/msg09712.html"},{"key":"e_1_2_8_17_1","unstructured":"Airavata PGA Docker Postings:https:\/\/www.mail\u2010archive.com\/dev%40airavata.apache.org\/msg09639.html"},{"key":"e_1_2_8_18_1","unstructured":"Airavata Docker Communications:https:\/\/www.mail\u2010archive.com\/dev%40airavata.apache.org\/msg09698.html"},{"key":"e_1_2_8_19_1","first-page":"55","volume-title":"Dynamically Provisioning Portable Gateway Infrastructure Using Docker and Agave","author":"Dooley R","year":"2014"},{"key":"e_1_2_8_20_1","doi-asserted-by":"crossref","unstructured":"StewartCA TimothyMCockerill IF HancockD NiravM SkidmoreE StanzioneDet al. Jetstream: a self\u2010provisioned scalable science and engineering cloud environment. InProceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure 2015; ACM29.","DOI":"10.1145\/2792745.2792774"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723872.2723882"},{"key":"e_1_2_8_22_1","unstructured":"ChamberlainR SchommerJ.Using Docker to support reproducible research. Technical report Invenshure LLC.http:\/\/dx.doi.org\/10.6084\/m9.figshare.1101910 2014."},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2010.41"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.3274"},{"key":"e_1_2_8_25_1","doi-asserted-by":"crossref","unstructured":"AfganE BakerD ChiltonJ CoraorN TaylorJ TeamG.Galaxy cluster to cloud\u2010genomics at scale. In Proceedings of the 9th Gateway Computing Environments Workshop IEEE Press 2014;47\u201350.","DOI":"10.1109\/GCE.2014.13"}],"container-title":["Concurrency and Computation: Practice and Experience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fcpe.3708","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpe.3708","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,31]],"date-time":"2025-05-31T11:50:28Z","timestamp":1748692228000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cpe.3708"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,11,13]]},"references-count":24,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2016,5]]}},"alternative-id":["10.1002\/cpe.3708"],"URL":"https:\/\/doi.org\/10.1002\/cpe.3708","archive":["Portico"],"relation":{},"ISSN":["1532-0626","1532-0634"],"issn-type":[{"value":"1532-0626","type":"print"},{"value":"1532-0634","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,11,13]]}}}