{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T20:32:16Z","timestamp":1760646736106,"version":"3.41.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2017,12,6]],"date-time":"2017-12-06T00:00:00Z","timestamp":1512518400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2017,12,6]]},"abstract":"<jats:p>Organizations conduct series of face-to-face meetings aiming to improve work practices. In these meetings, participants from different backgrounds collaboratively design artifacts, such as knowledge or process maps. Such meetings are orchestrated and carried out by facilitators and the success of the meetings almost solely depends on the experience of the facilitators. Previous research has mainly focused on approaches that support facilitators and participants in the upfront planning of such events. There is however, little guidance for facilitators and participants once a meeting has started. One critical aspect -- among others -- is that during a meeting, the facilitator and participants need to decide for how long the iterative process of discussion and design should continue. We argue that we can provide support for such decisions based on the evolution of artifacts collaboratively created during such meetings. This paper presents a multi-level, multi-method analysis of artifacts based on experts' observations in combination with network analytics. We study the use of automated analytics to assess the evolution of collaboratively created artifacts and to indicate maturity and established consensus of the collaborative practice. We propose a computational approach to support facilitators and participants in deciding when to stop face-to-face meetings.<\/jats:p>","DOI":"10.1145\/3134668","type":"journal-article","created":{"date-parts":[[2017,12,6]],"date-time":"2017-12-06T21:23:15Z","timestamp":1512595395000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["When to say \"Enough is Enough!\""],"prefix":"10.1145","volume":"1","author":[{"given":"Irene-Angelica","family":"Chounta","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Alexander","family":"Nolte","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, Pittsburgh, PA, USA"}]},{"given":"Tobias","family":"Hecking","sequence":"additional","affiliation":[{"name":"University of Duisburg-Essen, Duisburg, Germany"}]},{"given":"Rosta","family":"Farzan","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, Pittsburgh, PA, USA"}]},{"given":"Thomas","family":"Herrmann","sequence":"additional","affiliation":[{"name":"Ruhr-University Bochum, Bochum, Germany"}]}],"member":"320","published-online":{"date-parts":[[2017,12,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-013-9192-8"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jors.2602339"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1727(199722)13:2<107::AID-SDR120>3.0.CO;2-7"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753336"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.ejis.3000546"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Albert-L\u00e1szl\u00f3 Barab\u00e1si and R\u00e9ka Albert. 1999. Emergence of scaling in random networks. science 286 5439: 509--512. Albert-L\u00e1szl\u00f3 Barab\u00e1si and R\u00e9ka Albert. 1999. Emergence of scaling in random networks. science 286 5439: 509--512.","DOI":"10.1126\/science.286.5439.509"},{"key":"e_1_2_1_7_1","unstructured":"R.P. Bostrom R. Anson and V.K. Clawson. 1993. Group facilitation and group support systems. In Group support systems: New perspectives L.M. Jessup and J.S. Valacich (eds.). Macmillan 146--168. R.P. Bostrom R. Anson and V.K. Clawson. 1993. Group facilitation and group support systems. In Group support systems: New perspectives L.M. Jessup and J.S. Valacich (eds.). Macmillan 146--168."},{"volume-title":"ThinkLets: Building Blocks for concerted Collaboration","author":"Briggs Robert","key":"e_1_2_1_8_1"},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","first-page":"257","DOI":"10.6339\/JDS.2006.04(3).285","article-title":"A modified PLSR method in prediction","volume":"4","author":"Cheng Bo","year":"2006","journal-title":"J. Data Science"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-014-9355-3"},{"volume-title":"Heinz Ulrich Hoppe, and Nikolaos Avouris","year":"2014","author":"Chounta Irene-Angelica","key":"e_1_2_1_11_1"},{"volume-title":"Brennan","year":"1991","author":"Clark Herbert","key":"e_1_2_1_12_1"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Jacob Cohen. 1968. Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological bulletin 70 4: 213. Jacob Cohen. 1968. Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological bulletin 70 4: 213.","DOI":"10.1037\/h0026256"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2010.08.041"},{"volume-title":"Jan Mendling, and Hajo A Reijers.","year":"2013","author":"Dumas Marlon","key":"e_1_2_1_15_1"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090116.2090118"},{"key":"e_1_2_1_17_1","first-page":"17","article-title":"On the evolution of random graphs","volume":"5","author":"Erdos Paul","year":"1960","journal-title":"Publ. Math. Inst. Hung. Acad. Sci"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Paul Harmon and Celia Wolf. 2016. The state of business process management. Business process trends. Paul Harmon and Celia Wolf. 2016. The state of business process management. Business process trends.","DOI":"10.1201\/b12718-12"},{"volume-title":"AMCIS 2005 Proceedings, 73--80","year":"2005","author":"den Hengst Marielle","key":"e_1_2_1_19_1"},{"key":"e_1_2_1_20_1","unstructured":"Thomas Herrmann. 2006. SeeMe in a nutshell - the semi-structured socio-technical modeling method. Thomas Herrmann. 2006. SeeMe in a nutshell - the semi-structured socio-technical modeling method."},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Thomas Herrmann. 2009. Systems design with the socio-technical walkthrough. Handbook of research on socio-technical design and social networking systems: 336--351. Thomas Herrmann. 2009. Systems design with the socio-technical walkthrough. Handbook of research on socio-technical design and social networking systems: 336--351.","DOI":"10.4018\/978-1-60566-264-0.ch023"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2007.491"},{"volume-title":"Combining Collaborative Modeling with Collaborative Creativity for Process Design. In COOP 2014 - Proceedings of the 11th International Conference on the Design of Cooperative Systems, 27--30","year":"2014","author":"Herrmann Thomas","key":"e_1_2_1_23_1"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-012-9179-x"},{"volume-title":"International Conference of the Learning Sciences (ICLS","year":"2012","author":"Hoppe H. U.","key":"e_1_2_1_25_1"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2006.02.002"},{"volume-title":"Model-based development and evolution of information systems: A Quality Approach","author":"Krogstie John","key":"e_1_2_1_27_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4471-2936-3"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. biometrics: 159--174. J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. biometrics: 159--174.","DOI":"10.2307\/2529310"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1217299.1217301"},{"volume-title":"User Modeling, Adaption and Personalization","author":"Martinez Roberto","key":"e_1_2_1_30_1"},{"volume-title":"Handbook of Research on Modern Systems Analysis and Design Technologies and Applications","author":"Mendling Jan","key":"e_1_2_1_31_1"},{"volume-title":"What makes process models understandable? In Business Process Management","author":"Mendling Jan","key":"e_1_2_1_32_1"},{"key":"e_1_2_1_33_1","unstructured":"OMG. 2003. UML 2.0 Superstructure - Final Adopted Specification. Object Management Group. OMG. 2003. UML 2.0 Superstructure - Final Adopted Specification. Object Management Group."},{"volume-title":"Business Process Modeling Notation (BPMN) Specification","author":"OMG.","key":"e_1_2_1_34_1"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.4018\/ijec.2013100101"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1108\/14637151011018001"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.4018\/jismd.2010070101"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.4018\/ijec.2013100102"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/sdr.229"},{"key":"e_1_2_1_40_1","unstructured":"Richard Soley and others. 2000. Model driven architecture. OMG white paper 308 308: 5. Richard Soley and others. 2000. Model driven architecture. OMG white paper 308 308: 5."},{"volume-title":"Proceedings of the First European Conference on Computer-Supported Collaborative Learning.","year":"2001","author":"Soller Amy","key":"e_1_2_1_41_1"},{"volume-title":"The Practice of Enterprise Modeling","author":"Ssebuggwawo Denis","key":"e_1_2_1_42_1"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"William MK Trochim. 1989. An introduction to concept mapping for planning and evaluation. Evaluation and program planning 12 1: 1--16. William MK Trochim. 1989. An introduction to concept mapping for planning and evaluation. Evaluation and program planning 12 1: 1--16.","DOI":"10.1016\/0149-7189(89)90016-5"},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Duncan J Watts and Steven H Strogatz. 1998. Collective dynamics of \"small-world\" networks. nature 393 6684: 440--442. Duncan J Watts and Steven H Strogatz. 1998. Collective dynamics of \"small-world\" networks. nature 393 6684: 440--442.","DOI":"10.1038\/30918"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3134668","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3134668","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:24Z","timestamp":1750212684000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3134668"}},"subtitle":["A Study on the Evolution of Collaboratively Created Process Models"],"short-title":[],"issued":{"date-parts":[[2017,12,6]]},"references-count":44,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2017,12,6]]}},"alternative-id":["10.1145\/3134668"],"URL":"https:\/\/doi.org\/10.1145\/3134668","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2017,12,6]]},"assertion":[{"value":"2017-12-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}