{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T09:44:47Z","timestamp":1753868687448,"version":"3.41.2"},"reference-count":75,"publisher":"Wiley","issue":"21","license":[{"start":{"date-parts":[[2019,2,27]],"date-time":"2019-02-27T00:00:00Z","timestamp":1551225600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"name":"National funds through Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","award":["UID\/CEC\/50021\/2013"],"award-info":[{"award-number":["UID\/CEC\/50021\/2013"]}]},{"name":"PhD grant offered by the Erasmus Mundus Joint Doctorate in Distributed Computing","award":["2012-0030"],"award-info":[{"award-number":["2012-0030"]}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Concurrency and Computation"],"published-print":{"date-parts":[[2020,11,10]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Sharing of computing resources and workload across different big data frameworks is challenging due to their lack of interoperable interfaces. In contrast, web services natively support an interoperable execution. Therefore, an increasing number of big data workflows are composed of data services and web service implementations that access and process big data. On the other hand, big data execution in the wide area networks needs to minimize latency and communication overheads to be able to scale seamlessly. Lack of network\u2010awareness of classic web service execution beyond data centers significantly challenges the scope of data services.<\/jats:p><jats:p>Software\u2010Defined Networking (SDN) offers better control and management to the network, by unifying the control plane centrally, away from the distributed data plane devices. In this paper, we propose Software\u2010Defined Data Services (SDDS), an SDN\u2010based distributed service composition and workflow placement approach for data services in wide area networks. We first present the design of an SDDS framework that models the big data executions as composable data service workflows in multi\u2010domain network environments. We then evaluate the performance of a prototype SDDS framework through microbenchmarks. The benchmarks highlight the efficiency of SDDS in data service execution inside and beyond data centers.<\/jats:p>","DOI":"10.1002\/cpe.5212","type":"journal-article","created":{"date-parts":[[2019,2,28]],"date-time":"2019-02-28T03:34:06Z","timestamp":1551324846000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Interoperable and network\u2010aware service workflows for big data executions at internet scale"],"prefix":"10.1002","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0335-0458","authenticated-orcid":false,"given":"Pradeeban","family":"Kathiravelu","sequence":"first","affiliation":[{"name":"Emory University  Atlanta Georgia"},{"name":"INESC\u2010ID Lisboa\/Instituto Superior T\u00e9cnico Universidade de Lisboa  Lisbon Portugal"},{"name":"Universit\u00e9 Catholique de Louvain  Louvain\u2010la\u2010Neuve Belgium"}]},{"given":"Peter","family":"Van Roy","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Catholique de Louvain  Louvain\u2010la\u2010Neuve Belgium"}]},{"given":"Lu\u00eds","family":"Veiga","sequence":"additional","affiliation":[{"name":"INESC\u2010ID Lisboa\/Instituto Superior T\u00e9cnico Universidade de Lisboa  Lisbon Portugal"}]}],"member":"311","published-online":{"date-parts":[[2019,2,27]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2014.01.015"},{"key":"e_1_2_10_3_1","doi-asserted-by":"crossref","unstructured":"SagirogluS SinancD.Big data: a review. Paper presented at: 2013 International Conference on Collaboration Technologies and Systems (CTS);2013;San Diego CA.","DOI":"10.1109\/CTS.2013.6567202"},{"key":"e_1_2_10_4_1","unstructured":"GaurN BhogalKS JohnsonCD KaplingerTE BergDC inventors:International Business Machines Corp assignee.System and method of optimization of in\u2010memory data grid placement. US Patent 9 405 589. August 2 2016."},{"key":"e_1_2_10_5_1","unstructured":"ZahariaM ChowdhuryM DasT et al.Resilient distributed datasets: a fault\u2010tolerant abstraction for in\u2010memory cluster computing. In: Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation USENIX Association;2012;San Jose CA."},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1496091.1496103"},{"key":"e_1_2_10_7_1","doi-asserted-by":"crossref","unstructured":"MengX PappasV ZhangL.Improving the scalability of data center networks with traffic\u2010aware virtual machine placement. In: Proceedings of the IEEE INFOCOM;2010;San Diego CA.","DOI":"10.1109\/INFCOM.2010.5461930"},{"key":"e_1_2_10_8_1","doi-asserted-by":"crossref","unstructured":"WilliamsJW AggourKS InterranteJ McHughJ PoolE.Bridging high velocity and high volume industrial big data through distributed in\u2010memory storage & analytics. Paper presented at: 2014 IEEE International Conference on Big Data (Big Data);2014;Washington DC.","DOI":"10.1109\/BigData.2014.7004325"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2012.09.001"},{"key":"e_1_2_10_10_1","doi-asserted-by":"crossref","unstructured":"AndersonDP FedakG.The computational and storage potential of volunteer computing. Paper presented at: Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID);2006;Singapore.","DOI":"10.1109\/CCGRID.2006.101"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.4198"},{"key":"e_1_2_10_12_1","unstructured":"GiovannozziM SkandsP ZacharovI et al.LHC@ home: a volunteer computing system for massive numerical simulations of beam dynamics and high energy physics events. Paper presented at: 3rd International Particle Accelerator Conference (IPAC);2012;New Orleans LA."},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.938"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2004.58"},{"key":"e_1_2_10_15_1","first-page":"13","article-title":"Underlying techniques for web services: a survey","volume":"3","author":"Yue K","year":"2004","journal-title":"J Softw"},{"key":"e_1_2_10_16_1","doi-asserted-by":"crossref","unstructured":"VillamizarM GarcesO OchoaL et al.Infrastructure cost comparison of running web applications in the cloud using AWS lambda and monolithic and microservice architectures. Paper presented at: 2016 16th IEEE\/ACM International Symposium on Cluster Cloud and Grid Computing (CCGrid);2016;Cartagena Colombia.","DOI":"10.1109\/CCGrid.2016.37"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1108\/17440080910947295"},{"key":"e_1_2_10_18_1","unstructured":"HadleyMJ Sun Microsystems Inc.Web Application Description Language (WADL).2006."},{"key":"e_1_2_10_19_1","unstructured":"ChristensenE CurberaF MeredithG WeerawaranaS.Web Services Description Language (WSDL) 1.1.2001."},{"key":"e_1_2_10_20_1","doi-asserted-by":"crossref","unstructured":"PautassoC ZimmermannO LeymannF.Restful web services vs. big'web services: making the right architectural decision. In: Proceedings of the 17th International Conference on World Wide Web;2008;Beijing China.","DOI":"10.1145\/1367497.1367606"},{"key":"e_1_2_10_21_1","unstructured":"BoxD EhnebuskeD KakivayaG et al.Simple Object Access Protocol (SOAP) 1.1.2000."},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2007.99"},{"key":"e_1_2_10_23_1","unstructured":"ZhangQ ZhangS DingZ ZongY GuN LiuJ.Service registration and discovery in a domain\u2010oriented UDDI registry. Paper presented at: The Fifth International Conference on Computer and Information Technology (CIT);2005;Shanghai China."},{"key":"e_1_2_10_24_1","doi-asserted-by":"crossref","unstructured":"DogacA TambagY PembeciogluP et al.An ebXML infrastructure implementation through UDDI registries and RosettaNet PIPs. In: Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data;2002;Madison WI.","DOI":"10.1145\/564691.564750"},{"key":"e_1_2_10_25_1","unstructured":"The Apache Software Foundation.Apache jUDDI.2018.https:\/\/juddi.apache.org\/"},{"issue":"2","key":"e_1_2_10_26_1","first-page":"30","article-title":"Software\u2010defined networking","volume":"17","author":"McKeown N","year":"2009","journal-title":"INFOCOM keynote talk"},{"key":"e_1_2_10_27_1","doi-asserted-by":"crossref","unstructured":"PhemiusK BouetM LeguayJ.Disco: distributed multi\u2010domain SDN controllers. Paper presented at: 2014 IEEE Network Operations and Management Symposium (NOMS);2014;Krakow Poland.","DOI":"10.1109\/NOMS.2014.6838330"},{"key":"e_1_2_10_28_1","unstructured":"Cyrus.May 9th: Ibm announces version 2.2.6 of IBM spectrum copy data management.IBM.2017.https:\/\/spectrumcdmsite.wordpress.com\/2017\/05\/12\/may-9th-ibm-announces-version-2-2-6-of-ibm-spectrum-copy-data-management\/"},{"key":"e_1_2_10_29_1","unstructured":"Nexion.Nexion networks.2018.https:\/\/www.nexionnetworks.com\/cloud-solutions\/"},{"key":"e_1_2_10_30_1","unstructured":"Catalogic.What's new in Catalogic\u00aeECXTM2.6.2017.https:\/\/catalogicsoftware.com\/assets\/uploads\/resources\/Catalogic-Whats-New-in-ECX-26.pdf"},{"key":"e_1_2_10_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2014.6871676"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2534169.2486019"},{"volume-title":"MPLS: technology and applications","year":"2000","author":"Davie BS","key":"e_1_2_10_33_1"},{"key":"e_1_2_10_34_1","doi-asserted-by":"crossref","unstructured":"KathiraveluP ChiesaM MarcosP CaniniM VeigaL.Moving bits with a fleet of shared virtual routers. Paper presented at: IFIP Networking;2018;Z\u00fcrich Switzerland.","DOI":"10.23919\/IFIPNetworking.2018.8697019"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/35.668286"},{"key":"e_1_2_10_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2377677.2377714"},{"key":"e_1_2_10_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2018.2815638"},{"key":"e_1_2_10_38_1","doi-asserted-by":"crossref","unstructured":"ManzaliniA SaraccoR.Software networks at the edge: a shift of paradigm. Paper presented at: 2013 IEEE SDN for Future Networks and Services (SDN4FNS);2013;Trento Italy.","DOI":"10.1109\/SDN4FNS.2013.6702555"},{"key":"e_1_2_10_39_1","doi-asserted-by":"crossref","unstructured":"GalisA ClaymanS MamatasL et al.Softwarization of future networks and services\u2010programmable enabled networks as next generation software defined networks. Paper presented at: 2013 IEEE SDN for Future Networks and Services (SDN4FNS);2013;Trento Italy.","DOI":"10.1109\/SDN4FNS.2013.6702557"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/0470862084.ch1"},{"key":"e_1_2_10_41_1","doi-asserted-by":"crossref","unstructured":"KathiraveluP Van\u00a0RoyP VeigaL.Software\u2010defined data services: interoperable and network\u2010aware big data executions. Paper presented at: 2018 Fifth International Conference on Software Defined Systems (SDS);2018;Barcelona Spain.","DOI":"10.1109\/SDS.2018.8370436"},{"key":"e_1_2_10_42_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.4830"},{"key":"e_1_2_10_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2006.116"},{"key":"e_1_2_10_44_1","doi-asserted-by":"crossref","unstructured":"HunkelerU TruongHL Stanford\u2010ClarkA.MQTT\u2010S\u2014a publish\/subscribe protocol for wireless sensor networks. Paper presented at: 2008 3rd International Conference on Communication Systems Software and Middleware and Workshops (COMSWARE);2008;Bangalore India.","DOI":"10.1109\/COMSWA.2008.4554519"},{"volume-title":"Getting Started With Hazelcast","year":"2013","author":"Johns M","key":"e_1_2_10_45_1"},{"volume-title":"Infinispan Data Grid Platform","year":"2012","author":"Marchioni F","key":"e_1_2_10_46_1"},{"key":"e_1_2_10_47_1","doi-asserted-by":"crossref","unstructured":"KathiraveluP VeigaL.SDN middlebox architecture for resilient transfers. Paper presented at: 2017 IFIP\/IEEE Symposium on Integrated Network and Service Management (IM);2017;Lisbon Portugal.","DOI":"10.23919\/INM.2017.7987329"},{"key":"e_1_2_10_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2805789.2805796"},{"key":"e_1_2_10_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.939"},{"volume-title":"Understanding SOA With Web Services","year":"2005","author":"Newcomer E","key":"e_1_2_10_50_1"},{"key":"e_1_2_10_51_1","unstructured":"RupprechtL.Network\u2010Aware Big Data Processing[PhD thesis].London UK:Imperial College London;2017."},{"key":"e_1_2_10_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2641573"},{"key":"e_1_2_10_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-006-9059-z"},{"key":"e_1_2_10_54_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.4229"},{"key":"e_1_2_10_55_1","first-page":"1","article-title":"Towards network\u2010aware service composition in the cloud","volume":"1","author":"Wang S","year":"2016","journal-title":"IEEE Trans Cloud Comput"},{"key":"e_1_2_10_56_1","doi-asserted-by":"crossref","unstructured":"KleinA IshikawaF HonidenS.Towards network\u2010aware service composition in the cloud. In: Proceedings of the 21st International Conference on World Wide Web;2012;Lyon France.","DOI":"10.1145\/2187836.2187965"},{"key":"e_1_2_10_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1030194.1015471"},{"key":"e_1_2_10_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2013.SUP2.1213008"},{"key":"e_1_2_10_59_1","unstructured":"OppenheimerD ChunB PattersonD SnoerenAC VahdatA.Service placement in a shared wide\u2010area platform. In: Proceedings of the 2006 USENIX Annual Technical Conference General Track;2006;Boston MA."},{"key":"e_1_2_10_60_1","doi-asserted-by":"crossref","unstructured":"KathiraveluP GrbacTG VeigaL.Building blocks of mayan: componentizing the escience workflows through software\u2010defined service composition. Paper presented at: 2016 IEEE International Conference on Web Services (ICWS);2016;San Francisco CA.","DOI":"10.1109\/ICWS.2016.55"},{"key":"e_1_2_10_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-015-0290-y"},{"key":"e_1_2_10_62_1","doi-asserted-by":"crossref","unstructured":"DarabsehA' Al\u2010AyyoubM JararwehY BenkhelifaE VoukM RindosA.SDSecurity: A software defined security experimental framework. Paper presented at: 2015 IEEE International Conference on Communication Workshop (ICCW);2015.","DOI":"10.1109\/ICCW.2015.7247453"},{"key":"e_1_2_10_63_1","doi-asserted-by":"crossref","unstructured":"DarabsehA Al\u2010AyyoubM JararwehY BenkhelifaE VoukM RindosA.Sdstorage: a software defined storage experimental framework. Paper presented at: 2015 IEEE International Conference on Cloud Engineering;2015;Tempe AZ.","DOI":"10.1109\/IC2E.2015.60"},{"key":"e_1_2_10_64_1","unstructured":"SAP.Sap data services.2018.https:\/\/www.sap.com\/products\/data-services.html"},{"key":"e_1_2_10_65_1","unstructured":"Oracle.Oracle rest data services.2018.http:\/\/www.oracle.com\/technetwork\/developer-tools\/rest-data-services\/overview\/index.html"},{"key":"e_1_2_10_66_1","unstructured":"Portworx.Portworx.2018.https:\/\/portworx.com\/"},{"key":"e_1_2_10_67_1","unstructured":"PureStorage.The data platform for the cloud era.2018.https:\/\/www.purestorage.com\/uk\/products.html"},{"key":"e_1_2_10_68_1","unstructured":"IBM.IBM spectrum copy data management.2018.https:\/\/www.ibm.com\/us-en\/marketplace\/spectrum-copy-data-management"},{"key":"e_1_2_10_69_1","unstructured":"Catalogic.Catalogic ECX.2018.https:\/\/catalogicsoftware.com\/products\/ecx\/"},{"key":"e_1_2_10_70_1","unstructured":"Red hat storage: Why software\u2010defined storage matters.2016.https:\/\/www.redhat.com\/en\/about\/videos\/why-software-defined-storage-matters"},{"key":"e_1_2_10_71_1","unstructured":"GroffJ.VMware certified software\u2010defined data services offering enables enhanced performance gains for tier\u20101 virtualized applications.2016.https:\/\/www.primaryio.com\/vmware-certified-software-defined-data-services-offering-enables-enhanced-performance-gains-for-tier-1-virtualized-applications\/"},{"key":"e_1_2_10_72_1","unstructured":"PrimaryIO.PrimaryIO: application performance accelerator (APA) 2.5.2018.http:\/\/www.primaryio.com\/"},{"key":"e_1_2_10_73_1","unstructured":"SheikhH.HPE hyper converged:Hewlett Packard Enterprise (HPE).2016.https:\/\/tdhpe.techdata.eu\/Documents\/SWEDEN\/Server%20on%20Tour\/Hyper-Converged%20for%20TechData%20Sweden_HasanSheikh.pdf"},{"key":"e_1_2_10_74_1","unstructured":"MellorC.Hammer hopes to nail software\u2010defined future for commvault.2016.https:\/\/www.theregister.co.uk\/2016\/10\/26\/commvault_set_fair_for_sustained_turnaround\/"},{"key":"e_1_2_10_75_1","unstructured":"Commvault.Commvault introduces new innovations for the commvault data platform in software defined data services orchestration and user interface.2016.https:\/\/www.commvault.com\/news\/2016\/october\/commvault-introduces-new-innovations-for-the-commvault-data-platform-in-software-defined-data-services-orchestration-and-user-interface"},{"issue":"239","key":"e_1_2_10_76_1","article-title":"Docker: lightweight linux containers for consistent development and deployment","volume":"2014","author":"Merkel D","year":"2014","journal-title":"Linux Journal"}],"container-title":["Concurrency and Computation: Practice and Experience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fcpe.5212","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpe.5212","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/cpe.5212","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpe.5212","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,29]],"date-time":"2023-08-29T23:22:02Z","timestamp":1693351322000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cpe.5212"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,27]]},"references-count":75,"journal-issue":{"issue":"21","published-print":{"date-parts":[[2020,11,10]]}},"alternative-id":["10.1002\/cpe.5212"],"URL":"https:\/\/doi.org\/10.1002\/cpe.5212","archive":["Portico"],"relation":{},"ISSN":["1532-0626","1532-0634"],"issn-type":[{"type":"print","value":"1532-0626"},{"type":"electronic","value":"1532-0634"}],"subject":[],"published":{"date-parts":[[2019,2,27]]},"assertion":[{"value":"2018-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-02-06","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-02-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e5212"}}