{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T12:21:16Z","timestamp":1774354876958,"version":"3.50.1"},"reference-count":80,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2022,5,5]],"date-time":"2022-05-05T00:00:00Z","timestamp":1651708800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["FA8650\u201018\u2010C\u20107823"],"award-info":[{"award-number":["FA8650\u201018\u2010C\u20107823"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["W911NF\u201020\u20101\u20100008"],"award-info":[{"award-number":["W911NF\u201020\u20101\u20100008"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Topics in Cognitive Science"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this study, we explore the future of work by examining differences in productivity when teams are composed of only humans or both humans and machine agents. Our objective was to characterize the similarities and differences between human and human\u2013machine teams as they work to coordinate across their specialized roles. This form of research is increasingly important given that machine agents are becoming commonplace in sociotechnical systems and playing a more active role in collaborative work. One particular class of machine agents, bots, is being introduced to these systems to facilitate both taskwork and teamwork. We investigated the association between bots and productivity outcomes in open source software development through an analysis of hundreds of project teams. The presence of bots in teams was associated with higher levels of productivity and higher work centralization in addition to greater amounts of observed communication. The adoption of bots in software teams may have tradeoffs, in that doing so may increase productivity, but could also increase workload. We discuss the theoretical and practical implications of these findings for advancing human\u2013machine teaming research.<\/jats:p>","DOI":"10.1111\/tops.12613","type":"journal-article","created":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T01:10:16Z","timestamp":1651799416000},"page":"450-484","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["EveryBOTy Counts: Examining Human\u2013Machine Teams in Open Source Software Development"],"prefix":"10.1111","volume":"16","author":[{"given":"Olivia B.","family":"Newton","sequence":"first","affiliation":[{"name":"College of Engineering and Computer Science University of Central Florida"},{"name":"Institute for Simulation and Training University of Central Florida"}]},{"given":"Samaneh","family":"Saadat","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of Central Florida"}]},{"given":"Jihye","family":"Song","sequence":"additional","affiliation":[{"name":"College of Engineering and Computer Science University of Central Florida"},{"name":"Institute for Simulation and Training University of Central Florida"}]},{"given":"Stephen M.","family":"Fiore","sequence":"additional","affiliation":[{"name":"Institute for Simulation and Training University of Central Florida"},{"name":"Department of Philosophy University of Central Florida"}]},{"given":"Gita","family":"Sukthankar","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of Central Florida"}]}],"member":"311","published-online":{"date-parts":[[2022,5,5]]},"reference":[{"key":"e_1_2_12_2_1","unstructured":"Abrahamsson P. Salo O. Ronkainen J.&Warsta J.(2002). Agile software development methods: Review and analysis. Otavamedia Oy."},{"key":"e_1_2_12_3_1","doi-asserted-by":"crossref","unstructured":"Baltes S. &Diehl S.(2018).Towards a theory of software development expertise.Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering \u2010 ESEC\/FSE 2018(pp. 187\u2013200).https:\/\/doi.org\/10.1145\/3236024.3236061","DOI":"10.1145\/3236024.3236061"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2010.04.008"},{"key":"e_1_2_12_5_1","doi-asserted-by":"crossref","unstructured":"Bernardo J. H. daCosta D. A. &Kulesza U.(2018).Studying the impact of adopting continuous integration on the delivery time of pull requests.Proceedings of the 15th International Conference on Mining Software Repositories(pp. 131\u2013141).https:\/\/doi.org\/10.1145\/3196398.3196421","DOI":"10.1145\/3196398.3196421"},{"key":"e_1_2_12_6_1","doi-asserted-by":"crossref","unstructured":"Blincoe K. &Damian D.(2015).Implicit coordination: A case study of the Rails OSS project.IFIP International Conference on Open Source Systems(pp. 35\u201344).","DOI":"10.1007\/978-3-319-17837-0_4"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2015.10.002"},{"key":"e_1_2_12_8_1","first-page":"47","volume-title":"Graphical methods for data analysis","author":"Chambers J. M.","year":"1983"},{"key":"e_1_2_12_9_1","volume-title":"Modeling coordination and productivity in open\u2010source GitHub projects","author":"Choudhary S. S.","year":"2018"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365\u20102575.2009.00347.x"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.2016.0325"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.1515\/9781400845293"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.12009"},{"key":"e_1_2_12_14_1","unstructured":"Davidson\u2010Pilon C.(2014).lifelines: Survival analysis in Python. Retrieved fromhttps:\/\/github.com\/CamDavidsonPilon\/lifelines\/"},{"key":"e_1_2_12_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2018.07.029"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2018.2877482"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2012.02.033"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.2307\/1924845"},{"key":"e_1_2_12_19_1","doi-asserted-by":"crossref","unstructured":"Erickson I. Robert L. P. Crowston K. &Nickerson J. V.(2018).Workshop: Work in the age of intelligent machines.Proceedings of the 2018 ACM Conference on Supporting Groupwork(pp. 359\u2013361).https:\/\/doi.org\/10.1145\/3148330.3152159","DOI":"10.1145\/3148330.3152159"},{"key":"e_1_2_12_20_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046496408317797"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1177\/1071181321651351"},{"key":"e_1_2_12_22_1","first-page":"271","volume-title":"Research on managing groups and teams","author":"Fiore S. M.","year":"2015"},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.1080\/14639221003729128"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2016.01531"},{"key":"e_1_2_12_25_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00859"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.3357\/ASEM.3819.2014"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-20883-7_9"},{"key":"e_1_2_12_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.22802"},{"key":"e_1_2_12_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.110911"},{"key":"e_1_2_12_30_1","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure","volume":"62","author":"Holm S.","year":"1979","journal-title":"Scandinavian Journal of Statistics"},{"key":"e_1_2_12_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2018.2885970"},{"key":"e_1_2_12_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2018.03.010"},{"key":"e_1_2_12_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664\u2010016\u20109478\u20109"},{"key":"e_1_2_12_34_1","doi-asserted-by":"crossref","unstructured":"Kalliamvakou E. Gousios G. Blincoe K. Singer L. German D. M. &Damian D.(2014).The promises and perils of mining GitHub.Proceedings of the 11th Working Conference on Mining Software Repositories \u2010 MSR 2014(pp. 92\u2013101).https:\/\/doi.org\/10.1145\/2597073.2597074","DOI":"10.1145\/2597073.2597074"},{"key":"e_1_2_12_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1958.10501452"},{"key":"e_1_2_12_36_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.1993.9309035146"},{"key":"e_1_2_12_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/b97377"},{"key":"e_1_2_12_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.leaqua.2019.101377"},{"key":"e_1_2_12_39_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1167742"},{"key":"e_1_2_12_40_1","volume-title":"A taxonomy of software bots: Towards a deeper understanding of software bot characteristics","author":"Lebeuf C. R.","year":"2018"},{"key":"e_1_2_12_41_1","unstructured":"LebeufC. R. Storey M. A.&Zagalsky A.(2017). How software developers mitigate collaboration friction with chatbots. ArXiv:1702.07011 [Cs]. Retrieved fromhttp:\/\/arxiv.org\/abs\/1702.07011"},{"key":"e_1_2_12_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2017.4541027"},{"key":"e_1_2_12_43_1","doi-asserted-by":"crossref","unstructured":"Lebeuf C. R. Zagalsky A. Foucault M. &Storey M.\u2010A.(2019).Defining and classifying software bots: A faceted taxonomy.Proceedings of the 1st International Workshop on Bots in Software Engineering (BotSE '19)(pp.1\u20136).https:\/\/doi.org\/10.1109\/BotSE.2019.00008","DOI":"10.1109\/BotSE.2019.00008"},{"key":"e_1_2_12_44_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021\u20109010.85.2.273"},{"key":"e_1_2_12_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2468382"},{"key":"e_1_2_12_46_1","doi-asserted-by":"publisher","DOI":"10.1201\/9780429459542"},{"key":"e_1_2_12_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720817743223"},{"key":"e_1_2_12_48_1","unstructured":"Miller I. D.(2016).Gh\u2010impact. Retrieved fromhttps:\/\/github.com\/iandennismiller\/gh\u2010impact"},{"key":"e_1_2_12_49_1","doi-asserted-by":"crossref","unstructured":"Mirhosseini S. &Parnin C.(2017).Can automated pull requests encourage software developers to upgrade out\u2010of\u2010date dependencies?2017 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE)(pp. 84\u201394).https:\/\/doi.org\/10.1109\/ASE.2017.8115621","DOI":"10.1109\/ASE.2017.8115621"},{"key":"e_1_2_12_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359176"},{"key":"e_1_2_12_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/00107510500052444"},{"key":"e_1_2_12_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/1541931218621256"},{"key":"e_1_2_12_53_1","doi-asserted-by":"publisher","DOI":"10.1108\/S1534-085620180000019006"},{"key":"e_1_2_12_54_1","unstructured":"National Science Foundation. (2020). NSF's 10 big ideas: Future of work at the human\u2013technology frontier. Retrieved fromhttps:\/\/www.nsf.gov\/news\/special_reports\/big_ideas\/human_tech.jsp"},{"key":"e_1_2_12_55_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720820960865"},{"key":"e_1_2_12_56_1","doi-asserted-by":"crossref","unstructured":"Onoue S. Hata H. &Matsumoto K.(2013).A study of the characteristics of developers\u2019 activities in GitHub.2013 20th Asia\u2010Pacific Software Engineering Conference (APSEC)(pp. 7\u201312).https:\/\/doi.org\/10.1109\/APSEC.2013.104","DOI":"10.1109\/APSEC.2013.104"},{"key":"e_1_2_12_57_1","first-page":"2825","article-title":"Scikit\u2010learn: Machine learning in Python","volume":"12","author":"Pedregosa F.","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_12_58_1","unstructured":"Python Software Foundation. (2019).Python programming language. Retrieved fromhttps:\/\/www.python.org\/"},{"key":"e_1_2_12_59_1","unstructured":"R Core Team. (2019).R: A language and environment for statistical computing.R Foundation for Statistical Computing."},{"key":"e_1_2_12_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03647-7_11"},{"key":"e_1_2_12_61_1","volume-title":"Analyzing GitHub as a collaborative software development platform: A systematic review","author":"Reyes L\u00f3pez A.","year":"2017"},{"key":"e_1_2_12_62_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.2008.27751276"},{"key":"e_1_2_12_63_1","doi-asserted-by":"crossref","unstructured":"Romero D. M. Huttenlocher D. &Kleinberg J. M.(2015).Coordination and efficiency in decentralized collaboration.Proceedings of the 9th International AAAI Conference on Web and Social Media(pp. 367\u2013376).","DOI":"10.1609\/icwsm.v9i1.14606"},{"key":"e_1_2_12_64_1","doi-asserted-by":"crossref","unstructured":"Saadat S. Newton O. B. Sukthankar G.&Fiore S. M.(2020). Analyzing the productivity of GitHub teams based on formation phase activity. 2020 IEEE\/WIC\/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology (WI\u2010IAT) 169\u2013176.https:\/\/doi.org\/10.1109\/WIIAT50758.2020.00027","DOI":"10.1109\/WIIAT50758.2020.00027"},{"key":"e_1_2_12_65_1","doi-asserted-by":"crossref","unstructured":"Saadat S.&Sukthankar G.(2020). Explaining Differences in Classes of Discrete Sequences. 2020 IEEE\/WIC\/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology (WI\u2010IAT) 129\u2013136.https:\/\/doi.org\/10.1109\/WIIAT50758.2020.00022","DOI":"10.1109\/WIIAT50758.2020.00022"},{"key":"e_1_2_12_66_1","doi-asserted-by":"publisher","DOI":"10.1518\/001872008X288457"},{"key":"e_1_2_12_67_1","doi-asserted-by":"publisher","DOI":"10.2466\/01.09.21.PR0.111.6.777\u2010796"},{"key":"e_1_2_12_68_1","doi-asserted-by":"crossref","unstructured":"Storey M. A.&Zagalsky A.(2016). Disrupting developer productivity one bot at a time. Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering \u2010 FSE 2016 (pp. 928\u2013931).https:\/\/doi.org\/10.1145\/2950290.2983989","DOI":"10.1145\/2950290.2983989"},{"key":"e_1_2_12_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2584053"},{"key":"e_1_2_12_70_1","unstructured":"The 2020 State of the Octoverse. (2020).GitHub: Octoverse. Retrieved fromhttps:\/\/octoverse.github.com\/static\/github\u2010octoverse\u20102020\u2010community\u2010report.pdf"},{"key":"e_1_2_12_71_1","doi-asserted-by":"crossref","unstructured":"Vasilescu B. Posnett D. Ray B. van denBrand M. G. J. Serebrenik A. Devanbu P. &Filkov V.(2015).Gender and tenure diversity in GitHub teams.Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems \u2010 CHI \u201915(pp. 3789\u20133798).https:\/\/doi.org\/10.1145\/2702123.2702549","DOI":"10.1145\/2702123.2702549"},{"key":"e_1_2_12_72_1","doi-asserted-by":"crossref","unstructured":"Vasilescu B. Yu Y. Wang H. Devanbu P. &Filkov V.(2015).Quality and productivity outcomes relating to continuous integration in GitHub.Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering \u2010 ESEC\/FSE 2015(pp. 805\u2013816).https:\/\/doi.org\/10.1145\/2786805.2786850","DOI":"10.1145\/2786805.2786850"},{"key":"e_1_2_12_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0048\u20107333(03)00050\u20107"},{"key":"e_1_2_12_74_1","doi-asserted-by":"publisher","DOI":"10.1177\/1555343419867563"},{"key":"e_1_2_12_75_1","doi-asserted-by":"publisher","DOI":"10.1177\/2041386615620837"},{"key":"e_1_2_12_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274451"},{"key":"e_1_2_12_77_1","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.12482"},{"key":"e_1_2_12_78_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2016.09.005"},{"key":"e_1_2_12_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2006.12.006"},{"key":"e_1_2_12_80_1","doi-asserted-by":"crossref","unstructured":"Yu Y. Yin G. Wang H. &Wang T.(2014).Exploring the patterns of social behavior in GitHub.Proceedings of the 1st International Workshop on Crowd\u2010Based Software Development Methods and Technologies (CrowdSoft 2014)(pp. 31\u201336).https:\/\/doi.org\/10.1145\/2666539.2666571","DOI":"10.1145\/2666539.2666571"},{"key":"e_1_2_12_81_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.2013.0485"}],"container-title":["Topics in Cognitive Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/tops.12613","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/tops.12613","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/am-pdf\/10.1111\/tops.12613","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/tops.12613","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,16]],"date-time":"2024-07-16T15:40:50Z","timestamp":1721144450000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/tops.12613"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,5]]},"references-count":80,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["10.1111\/tops.12613"],"URL":"https:\/\/doi.org\/10.1111\/tops.12613","archive":["Portico"],"relation":{},"ISSN":["1756-8757","1756-8765"],"issn-type":[{"value":"1756-8757","type":"print"},{"value":"1756-8765","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,5]]},"assertion":[{"value":"2021-02-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}