{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,5]],"date-time":"2025-10-05T21:42:04Z","timestamp":1759700524563,"version":"build-2065373602"},"reference-count":118,"publisher":"Association for Computing Machinery (ACM)","issue":"6","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,10,5]]},"abstract":"<jats:p>Online competitive action games have flourished as a space for entertainment and social connections, yet they face challenges from a small percentage of players engaging in disruptive behaviors. This study delves into the under-explored realm of understanding the effects of moderation on player behavior within online competitive action games on an example of a popular title - Call of Duty\u00ae:Modern Warfare\u00aeII. We employ a quasi-experimental design and causal inference techniques to examine the impact of moderation in a real-world industry-scale moderation system. We further delve into novel aspects around the impact of delayed moderation, as well as the severity of applied punishment. We examine these effects on a set of four disruptive behaviors including cheating, offensive username, chat, and voice. Our findings uncover the dual impact moderation has on reducing disruptive behavior and discouraging disruptive players from participating. We further uncover differences in the effectiveness of quick and delayed moderation and the varying severity of punishment. Our examination of real-world gaming interactions sets a precedent in understanding the effectiveness of moderation and its impact on player behavior. Our insights offer actionable suggestions for the most promising avenues for improving real-world moderation practices, as well as the heterogeneous impact moderation has on different players.<\/jats:p>","DOI":"10.1145\/3748599","type":"journal-article","created":{"date-parts":[[2025,10,5]],"date-time":"2025-10-05T21:01:11Z","timestamp":1759698071000},"page":"96-130","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Online Moderation in Competitive Action Games: How Intervention Affects Player Behaviors"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5602-6056","authenticated-orcid":false,"given":"Rafal","family":"Kocielnik","sequence":"first","affiliation":[{"name":"California Institute of Technology, Pasadena, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0970-9064","authenticated-orcid":false,"given":"Zhuofang","family":"Li","sequence":"additional","affiliation":[{"name":"California Institute of Technology, Pasadena, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0866-405X","authenticated-orcid":false,"given":"Mitchell","family":"Linegar","sequence":"additional","affiliation":[{"name":"California Institute of Technology, Pasadena, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7709-9799","authenticated-orcid":false,"given":"Deshawn","family":"Sambrano","sequence":"additional","affiliation":[{"name":"Activision Publishing, Inc., Los Angeles, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3952-590X","authenticated-orcid":false,"given":"Fereshteh","family":"Soltani","sequence":"additional","affiliation":[{"name":"Activision Publishing, Inc., Los Angeles, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0724-1050","authenticated-orcid":false,"given":"Min","family":"Kim","sequence":"additional","affiliation":[{"name":"Activision Publishing, Inc., Santa Monica, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8588-2801","authenticated-orcid":false,"given":"Nabiha","family":"Naqvie","sequence":"additional","affiliation":[{"name":"Activision Publishing, Inc., Los Angeles, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4145-8942","authenticated-orcid":false,"given":"Grant","family":"Cahill","sequence":"additional","affiliation":[{"name":"Activision Publishing, Inc., Los Angeles, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6974-6797","authenticated-orcid":false,"given":"Animashree","family":"Anandkumar","sequence":"additional","affiliation":[{"name":"California Institute of Technology, Pasadena, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8113-4451","authenticated-orcid":false,"given":"R. Michael","family":"Alvarez","sequence":"additional","affiliation":[{"name":"California Institute of Technology, Pasadena, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,10,5]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/S0005-7894(05)80279-5","article-title":"Effectiveness of delayed punishment in an applied setting","volume":"21","author":"Abramowitz Ann J","year":"1990","unstructured":"Ann J Abramowitz and Susan G O\u2019Leary. 1990. Effectiveness of delayed punishment in an applied setting. Behavior Therapy, 21, 2 (1990), 231\u2013239.","journal-title":"Behavior Therapy"},{"key":"e_1_2_1_2_1","volume-title":"https:\/\/www.callofduty.com\/blog\/2024\/10\/call-of-duty-anti-toxicity-progress-report-black-ops-6-moderation-results [Online","author":"Publishing Inc Activision","year":"2025","unstructured":"Inc Activision Publishing. 2024. Anti-Toxicity \/ Disruptive Behavior Progress Report \u2013 Moderation Results and Readiness for Black Ops 6. https:\/\/www.callofduty.com\/blog\/2024\/10\/call-of-duty-anti-toxicity-progress-report-black-ops-6-moderation-results [Online; accessed 2025-04-30]"},{"key":"e_1_2_1_3_1","volume-title":"Call of Duty Update: An Inside Look at Matchmaking. https:\/\/www.callofduty.com\/uk\/en\/blog\/2024\/01\/call-of-duty-update-an-Inside-look-at-matchmaking [Online","author":"Publishing Inc Activision","year":"2025","unstructured":"Inc Activision Publishing. 2024. Call of Duty Update: An Inside Look at Matchmaking. https:\/\/www.callofduty.com\/uk\/en\/blog\/2024\/01\/call-of-duty-update-an-Inside-look-at-matchmaking [Online; accessed 2025-04-25]"},{"key":"e_1_2_1_4_1","volume-title":"Call of Duty\u00ae Code of Conduct | FPS Game Terms. https:\/\/www.callofduty.com\/values [Online","author":"Publishing Inc Activision","year":"2025","unstructured":"Inc Activision Publishing. 2025. Call of Duty\u00ae Code of Conduct | FPS Game Terms. https:\/\/www.callofduty.com\/values [Online; accessed 2025-04-21]"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1007\/s10610-023-09541-1","article-title":"The Enemy Hates Best? Toxicity in League of Legends and Its Content Moderation Implications","volume":"29","author":"Aguerri Jes\u00fas C","year":"2023","unstructured":"Jes\u00fas C Aguerri, Mario Santisteban, and Fernando Mir\u00f3-Llinares. 2023. The Enemy Hates Best? Toxicity in League of Legends and Its Content Moderation Implications. European Journal on Criminal Policy and Research, 29, 3 (2023), 437\u2013456.","journal-title":"European Journal on Criminal Policy and Research"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1002\/hbe2.195","article-title":"The theory of planned behavior: Frequently asked questions","volume":"2","author":"Ajzen Icek","year":"2020","unstructured":"Icek Ajzen. 2020. The theory of planned behavior: Frequently asked questions. Human Behavior and Emerging Technologies, 2, 4 (2020), 314\u2013324.","journal-title":"Human Behavior and Emerging Technologies"},{"key":"e_1_2_1_7_1","volume-title":"Twitch. In 2022 17th Iberian Conference on Information Systems and Technologies (CISTI). 1\u20135.","author":"Alvarado Claudia","year":"2022","unstructured":"Claudia Alvarado and Francisco Arbaiza. 2022. League of Legends community\u2019s perception of influencer marketing from streamers on Twitch. In 2022 17th Iberian Conference on Information Systems and Technologies (CISTI). 1\u20135."},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1177\/002242787401100204","article-title":"Crime and deterrence: A correlation analysis","volume":"11","author":"Bailey William C","year":"1974","unstructured":"William C Bailey, J David Martin, and Louis N Gray. 1974. Crime and deterrence: A correlation analysis. Journal of Research in Crime and Delinquency, 11, 2 (1974), 124\u2013143.","journal-title":"Journal of Research in Crime and Delinquency"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI \u201921)","author":"Beres Nicole A","year":"2021","unstructured":"Nicole A Beres, Julian Frommel, Elizabeth Reid, Regan L Mandryk, and Madison Klarkowski. 2021. Don\u2019t You Know That You\u2019re Toxic: Normalization of Toxicity in Online Gaming. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI \u201921). Association for Computing Machinery, New York, NY, USA. Article 438, 15 pages. isbn:9781450380966 https:\/\/doi.org\/10.1145\/3411764.3445157 10.1145\/3411764.3445157"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"1732","DOI":"10.1177\/1461444815569723","article-title":"Players\u2019 perspectives on the positive impact of video games: A qualitative content analysis of online forum discussions","volume":"18","author":"Bourgonjon Jeroen","year":"2016","unstructured":"Jeroen Bourgonjon, Geert Vandermeersche, Bram De Wever, Ronald Soetaert, and Martin Valcke. 2016. Players\u2019 perspectives on the positive impact of video games: A qualitative content analysis of online forum discussions. New Media & Society, 18, 8 (2016), 1732\u20131749.","journal-title":"New Media & Society"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3452918.3458796"},{"key":"e_1_2_1_12_1","unstructured":"Caltech. 2022. Caltech and Activision Publishing Team Up to Combat Bad Behavior Online | www.caltech.edu. https:\/\/www.caltech.edu\/about\/news\/caltech-and-activision-publishing-team-up-to-combat-bad-behavior-online (Accessed on 06\/20\/2023)"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction, 5, CHI PLAY","author":"Canossa Alessandro","year":"2021","unstructured":"Alessandro Canossa, Dmitry Salimov, Ahmad Azadvar, Casper Harteveld, and Georgios Yannakakis. 2021. For honor, for toxicity: Detecting toxic behavior through gameplay. Proceedings of the ACM on Human-Computer Interaction, 5, CHI PLAY (2021), 1\u201329."},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1080\/0144929X.2013.843721","article-title":"Group identification as a mediator of the effect of players\u2019 anonymity on cheating in online games","volume":"34","author":"Hua Chen Vivian Hsueh","year":"2015","unstructured":"Vivian Hsueh Hua Chen and Yuehua Wu. 2015. Group identification as a mediator of the effect of players\u2019 anonymity on cheating in online games. Behaviour & Information Technology, 34, 7 (2015), 658\u2013667.","journal-title":"Behaviour & Information Technology"},{"key":"e_1_2_1_15_1","volume-title":"Zach WY Lee, and Tommy KH Chan","author":"Cheung Christy MK","year":"2015","unstructured":"Christy MK Cheung, Xiao-Liang Shen, Zach WY Lee, and Tommy KH Chan. 2015. Promoting sales of online games through customer engagement. Electronic commerce research and applications, 14, 4 (2015), 241\u2013250."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3390\/su12030855"},{"key":"e_1_2_1_17_1","unstructured":"Blair Llewellyn Cleave Nikos Nikiforakis and Robert Slonim. 2010. Is there selection bias in laboratory experiments? Univ. of Melbourne Dept. of Economics Working Paper."},{"key":"e_1_2_1_18_1","volume-title":"Cheating: Gaining advantage in videogames. mit press.","author":"Consalvo Mia","year":"2009","unstructured":"Mia Consalvo. 2009. Cheating: Gaining advantage in videogames. mit press."},{"key":"e_1_2_1_19_1","first-page":"293","article-title":"For whom the gamer trolls: A study of trolling interactions in the online gaming context","volume":"24","author":"Cook Christine","year":"2019","unstructured":"Christine Cook, Rianne Conijn, Juli\u00ebtte Schaafsma, and Marjolijn Antheunis. 2019. For whom the gamer trolls: A study of trolling interactions in the online gaming context. Journal of Computer-Mediated Communication, 24, 6 (2019), 293\u2013318.","journal-title":"Journal of Computer-Mediated Communication"},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","first-page":"3323","DOI":"10.1177\/1461444817748578","article-title":"Under the bridge: An in-depth examination of online trolling in the gaming context","volume":"20","author":"Cook Christine","year":"2018","unstructured":"Christine Cook, Juliette Schaafsma, and Marjolijn Antheunis. 2018. Under the bridge: An in-depth examination of online trolling in the gaming context. New Media & Society, 20, 9 (2018), 3323\u20133340.","journal-title":"New Media & Society"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","first-page":"626409","DOI":"10.3389\/fhumd.2021.626409","article-title":"Commercial versus volunteer: Comparing user perceptions of toxicity and transparency in content moderation across social media platforms","volume":"3","author":"Cook Christine L","year":"2021","unstructured":"Christine L Cook, Aashka Patel, and Donghee Yvette Wohn. 2021. Commercial versus volunteer: Comparing user perceptions of toxicity and transparency in content moderation across social media platforms. Frontiers in Human Dynamics, 3 (2021), 626409.","journal-title":"Frontiers in Human Dynamics"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the ACM on Human-computer Interaction, 6, CSCW1","author":"Cullen Amanda LL","year":"2022","unstructured":"Amanda LL Cullen and Sanjay R Kairam. 2022. Practicing moderation: Community moderation as reflective practice. Proceedings of the ACM on Human-computer Interaction, 6, CSCW1 (2022), 1\u201332."},{"key":"e_1_2_1_23_1","volume-title":"Cheryl McQuire, Kate Tilling, Matthew Hickman, and Peter Craig.","author":"de Vocht Frank","year":"2021","unstructured":"Frank de Vocht, Srinivasa Vittal Katikireddi, Cheryl McQuire, Kate Tilling, Matthew Hickman, and Peter Craig. 2021. Conceptualising natural and quasi experiments in public health. BMC medical research methodology, 21 (2021), 1\u20138."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 58","author":"Doherty Shawn M","year":"2014","unstructured":"Shawn M Doherty, Devin Liskey, Christopher M Via, Christina Frederick, Jason P Kring, and Dahai Liu. 2014. An analysis of expressed cheating behaviors in video games. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 58, 2393\u20132396."},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Nianbo Dong and Benjamin M Kelcey. 2020. A review of Causality in a social world: Moderation mediation and spill-over.","DOI":"10.3102\/1076998619881791"},{"key":"e_1_2_1_26_1","unstructured":"Benjamin Egliston. 2013. Play to win: How competitive modes of play have influenced cultural practice in digital games."},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1177\/13548565221138761","article-title":"Systemic issues with narratives of identity: Toxicity and esports media professionals","volume":"29","author":"Felczak Mateusz","year":"2023","unstructured":"Mateusz Felczak. 2023. Systemic issues with narratives of identity: Toxicity and esports media professionals. Convergence, 29, 2 (2023), 400\u2013416.","journal-title":"Convergence"},{"key":"e_1_2_1_28_1","volume-title":"Women\u2019s experiences with general and sexual harassment in online video games: Rumination, organizational responsiveness, withdrawal, and coping strategies. New media & society, 19, 8","author":"Fox Jesse","year":"2017","unstructured":"Jesse Fox and Wai Yen Tang. 2017. Women\u2019s experiences with general and sexual harassment in online video games: Rumination, organizational responsiveness, withdrawal, and coping strategies. New media & society, 19, 8 (2017), 1290\u20131307."},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","first-page":"26","DOI":"10.4018\/ijskd.2014070102","article-title":"Meet the HUEHUEs: A Sociotechnical Approach to Disruptive Behaviour in Multiplayer Online Games","volume":"6","author":"Fragoso Suely","year":"2014","unstructured":"Suely Fragoso. 2014. Meet the HUEHUEs: A Sociotechnical Approach to Disruptive Behaviour in Multiplayer Online Games. International Journal of Sociotechnology and Knowledge Development (IJSKD), 6, 3 (2014), 26\u201344.","journal-title":"International Journal of Sociotechnology and Knowledge Development (IJSKD)"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","first-page":"399","DOI":"10.4284\/0038-4038-2011.152","article-title":"Certainty of punishment versus severity of punishment: An experimental investigation","volume":"79","author":"Friesen Lana","year":"2012","unstructured":"Lana Friesen. 2012. Certainty of punishment versus severity of punishment: An experimental investigation. Southern Economic Journal, 79, 2 (2012), 399\u2013421.","journal-title":"Southern Economic Journal"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","unstructured":"Julian Frommel and Regan Mandryk. 2022. Effective Toxicity Prediction in Online Multiplayer Gaming: Four Obstacles to Making Approaches Usable. Mensch und Computer 2022 - Workshopband. https:\/\/doi.org\/10.18420\/muc2022-mci-ws12-315 10.18420\/muc2022-mci-ws12-315","DOI":"10.18420\/muc2022-mci-ws12-315"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3505270.3558359"},{"key":"e_1_2_1_33_1","unstructured":"GGWP. 2023. Game Changer: Impact of Chat Sanctions on Toxicity - GGWP - the first AI-powered game moderation platform. https:\/\/www.ggwp.com\/blog\/game-changer-impact-of-chat-sanctions-on-toxicity\/ (Accessed on 02\/11\/2024)"},{"key":"e_1_2_1_34_1","first-page":"4448","article-title":"Analyzing Toxicity in Online Gaming Communities","volume":"12","author":"Ghosh Ayushi","year":"2021","unstructured":"Ayushi Ghosh. 2021. Analyzing Toxicity in Online Gaming Communities. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12, 10 (2021), 4448\u20134455.","journal-title":"Turkish Journal of Computer and Mathematics Education (TURCOMAT)"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","first-page":"205395171989794","DOI":"10.1177\/2053951719897945","article-title":"Algorithmic content moderation: Technical and political challenges in the automation of platform governance","volume":"7","author":"Gorwa Robert","year":"2020","unstructured":"Robert Gorwa, Reuben Binns, and Christian Katzenbach. 2020. Algorithmic content moderation: Technical and political challenges in the automation of platform governance. Big Data & Society, 7, 1 (2020), 2053951719897945.","journal-title":"Big Data & Society"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction, 6, CHI PLAY","author":"Grace Thomas D","year":"2022","unstructured":"Thomas D Grace, Ian Larson, and Katie Salen. 2022. Policies of misconduct: a content analysis of codes of conduct for online multiplayer games. Proceedings of the ACM on Human-Computer Interaction, 6, CHI PLAY (2022), 1\u201323."},{"key":"e_1_2_1_37_1","volume-title":"Certainty vs. severity of punishment. Economic inquiry, 29, 2","author":"Grogger Jeffrey","year":"1991","unstructured":"Jeffrey Grogger. 1991. Certainty vs. severity of punishment. Economic inquiry, 29, 2 (1991), 297\u2013309."},{"key":"e_1_2_1_38_1","unstructured":"Tobias Hatt and Stefan Feuerriegel. 2024. Sequential deconfounding for causal inference with unobserved confounders. In Causal Learning and Reasoning. 934\u2013956."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.chb.2019.09.003","article-title":"I\u2019m just trolling: The role of normative beliefs in aggressive behaviour in online gaming","volume":"102","author":"Hilvert-Bruce Zorah","year":"2020","unstructured":"Zorah Hilvert-Bruce and James T Neill. 2020. I\u2019m just trolling: The role of normative beliefs in aggressive behaviour in online gaming. Computers in Human Behavior, 102 (2020), 303\u2013311.","journal-title":"Computers in Human Behavior"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the ACM Web Conference 2023","author":"Ribeiro Manoel Horta","year":"2023","unstructured":"Manoel Horta Ribeiro, Justin Cheng, and Robert West. 2023. Automated Content Moderation Increases Adherence to Community Guidelines. Proceedings of the ACM Web Conference 2023, 1 (2023), 2666\u20132676. isbn:9781450394161 https:\/\/doi.org\/10.1145\/3543507.3583275 10.1145\/3543507.3583275"},{"key":"e_1_2_1_41_1","volume-title":"Principal PM Manager","author":"Trust Gaming","year":"2024","unstructured":"Gaming Trust & Safety Jennifer Mills-Perov, Principal PM Manager. 2024. GDC 2024: Community Sift & the Future of Content Moderation. https:\/\/developer.microsoft.com\/en-us\/games\/articles\/2024\/03\/community-sift-and-the-future-of-content-moderation\/ [Online; accessed 2025-04-30]"},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.2307\/2009945","article-title":"Deterrence theory revisited","volume":"31","author":"Jervis Robert","year":"1979","unstructured":"Robert Jervis. 1979. Deterrence theory revisited. World Politics, 31, 2 (1979), 289\u2013324.","journal-title":"World Politics"},{"key":"e_1_2_1_43_1","volume-title":"The economics of content moderation: Theory and experimental evidence from hate speech on Twitter","author":"Jim\u00e9nez-Dur\u00e1n Rafael","unstructured":"Rafael Jim\u00e9nez-Dur\u00e1n. 2022. The economics of content moderation: Theory and experimental evidence from hate speech on Twitter. University of Chicago Booth School of Business, Stigler Center for the Study of the Economy and the State, Chicago, IL."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4230296"},{"key":"e_1_2_1_45_1","unstructured":"Jean Kaddour Aengus Lynch Qi Liu Matt J Kusner and Ricardo Silva. 2022. Causal machine learning: A survey and open problems. arXiv\u20132206 pages."},{"key":"e_1_2_1_46_1","volume-title":"Handbook of the fundamentals of financial decision making: Part I. World Scientific","author":"Kahneman Daniel","unstructured":"Daniel Kahneman and Amos Tversky. 2013. Prospect theory: An analysis of decision under risk. In Handbook of the fundamentals of financial decision making: Part I. World Scientific, Singapore. 99\u2013127."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3102071.3110568"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/10468781241277899"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1016\/j.tree.2021.08.008","article-title":"Causal assumptions and causal inference in ecological experiments","volume":"36","author":"Kimmel Kaitlin","year":"2021","unstructured":"Kaitlin Kimmel, Laura E Dee, Meghan L Avolio, and Paul J Ferraro. 2021. Causal assumptions and causal inference in ecological experiments. Trends in Ecology & Evolution, 36, 12 (2021), 1141\u20131152.","journal-title":"Trends in Ecology & Evolution"},{"key":"e_1_2_1_50_1","volume-title":"Cyberbullying perpetration among undergraduates: Evidence of the roles of chronotype and sleep quality. Biological rhythm research, 49, 2","author":"K\u0131rcaburun Ka\u011fan","year":"2018","unstructured":"Ka\u011fan K\u0131rcaburun and \u015eule Bet\u00fcl Tosunta\u015f. 2018. Cyberbullying perpetration among undergraduates: Evidence of the roles of chronotype and sleep quality. Biological rhythm research, 49, 2 (2018), 247\u2013265."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-9125.1989.tb01052.x"},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","first-page":"1283735","DOI":"10.3389\/fcomp.2024.1283735","article-title":"Challenges in Moderating Disruptive Player Behavior in Online Competitive Action Games","volume":"6","author":"Kocielnik Rafal","year":"2023","unstructured":"Rafal Kocielnik, Zhuofang Li, Claudia Kann, Deshawn Sambrano, Jacob Morrier, Mitchell Linegar, Carly Taylor, Min Kim, Nabiha Naqvie, Feri Soltani, Arman Dehpanah, Grant Cahill, Animashree Anandkumar, and R. Michael Alvarez. 2023. Challenges in Moderating Disruptive Player Behavior in Online Competitive Action Games. Frontiers in Computer Science, 6 (2023), 1283735.","journal-title":"Frontiers in Computer Science"},{"key":"e_1_2_1_53_1","volume-title":"Trustworthy online controlled experiments: A practical guide to a\/b testing","author":"Kohavi Ron","unstructured":"Ron Kohavi, Diane Tang, and Ya Xu. 2020. Trustworthy online controlled experiments: A practical guide to a\/b testing. Cambridge University Press, Cambridge, UK."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1108\/INTR-08-2019-0343"},{"key":"e_1_2_1_55_1","volume-title":"Curing toxicity\u2013developing design principles to buffer toxic behaviour in massive multiplayer online games. Safer communities, 20, 3","author":"Kordyaka Bastian","year":"2021","unstructured":"Bastian Kordyaka and Bj\u00f6rn Kruse. 2021. Curing toxicity\u2013developing design principles to buffer toxic behaviour in massive multiplayer online games. Safer communities, 20, 3 (2021), 133\u2013149."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction, 7, CHI PLAY","author":"Kordyaka Bastian","year":"2023","unstructured":"Bastian Kordyaka, Samuli Laato, Katharina Jahn, Juho Hamari, and Bjoern Niehaves. 2023. The Cycle of Toxicity: Exploring Relationships between Personality and Player Roles in Toxic Behavior in Multiplayer Online Battle Arena Games. Proceedings of the ACM on Human-Computer Interaction, 7, CHI PLAY (2023), 611\u2013641."},{"key":"e_1_2_1_57_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3580346","article-title":"Exploring the relationship between offline cultural environments and toxic behavior tendencies in multiplayer online games","volume":"6","author":"Kordyaka Bastian","year":"2023","unstructured":"Bastian Kordyaka, Solip Park, Jeanine Krath, and Samuli Laato. 2023. Exploring the relationship between offline cultural environments and toxic behavior tendencies in multiplayer online games. ACM Transactions on Social Computing, 6, 1-2 (2023), 1\u201320.","journal-title":"ACM Transactions on Social Computing"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3410404.3414243"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction, 5, CSCW2","author":"Kou Yubo","year":"2021","unstructured":"Yubo Kou. 2021. Punishment and Its Discontents: An Analysis of Permanent Ban in an Online Game Community. Proceedings of the ACM on Human-Computer Interaction, 5, CSCW2 (2021), 1\u201321."},{"key":"e_1_2_1_60_1","volume-title":"50th Annual Hawaii International Conference on System Sciences, HICSS 2017","author":"Kou Yubo","year":"2017","unstructured":"Yubo Kou and Xinning Gui. 2017. When code governs community. In 50th Annual Hawaii International Conference on System Sciences, HICSS 2017. 1, IEEE, Hawaii, USA. 2056\u20132064. https:\/\/api.semanticscholar.org\/CorpusID:37012220"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445279"},{"key":"e_1_2_1_62_1","first-page":"9","article-title":"Governance in League of Legends: A hybrid system","volume":"7","author":"Kou Yubo","year":"2014","unstructured":"Yubo Kou and Bonnie A Nardi. 2014. Governance in League of Legends: A hybrid system.. FDG, 7, 1 (2014), 9.","journal-title":"FDG"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046878120931602"},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI \u201915)","author":"Kwak Haewoon","year":"2015","unstructured":"Haewoon Kwak, Jeremy Blackburn, and Seungyeop Han. 2015. Exploring Cyberbullying and Other Toxic Behavior in Team Competition Online Games. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI \u201915). Association for Computing Machinery, New York, NY, USA. 3739\u20133748. isbn:9781450331456 https:\/\/doi.org\/10.1145\/2702123.2702529 10.1145\/2702123.2702529"},{"key":"e_1_2_1_65_1","volume-title":"Effects of anonymity, invisibility, and lack of eye-contact on toxic online disinhibition. Computers in human behavior, 28, 2","author":"Lapidot-Lefler Noam","year":"2012","unstructured":"Noam Lapidot-Lefler and Azy Barak. 2012. Effects of anonymity, invisibility, and lack of eye-contact on toxic online disinhibition. Computers in human behavior, 28, 2 (2012), 434\u2013443."},{"key":"e_1_2_1_66_1","volume-title":"Tackling Toxicity: Identifying and Addressing Toxic Behavior in Online Video Games","author":"Lapolla Matthew","year":"2020","unstructured":"Matthew Lapolla. 2020. Tackling Toxicity: Identifying and Addressing Toxic Behavior in Online Video Games. Seton Hall University Dissertations and Theses (ETDs), 2798 (2020), 70 pages."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1561\/0800000014"},{"key":"e_1_2_1_68_1","volume-title":"Eui Jun Jeong, and Joon Hyun Jeon","author":"Lee Sung Je","year":"2019","unstructured":"Sung Je Lee, Eui Jun Jeong, and Joon Hyun Jeon. 2019. Disruptive behaviors in online games: effects of moral positioning, competitive motivation, and aggression in \u201cLeague of Legends\u201d. Social Behavior and Personality: an international journal, 47, 2 (2019), 1\u20139."},{"key":"e_1_2_1_69_1","doi-asserted-by":"crossref","first-page":"1278738","DOI":"10.3389\/fpsyg.2023.1278738","article-title":"The influence of psychological needs and motivation on game cheating: insights from self-determination theory","volume":"14","author":"Lee Sung Je","year":"2023","unstructured":"Sung Je Lee, Eui Jun Jeong, Dan J Kim, and Jeonyoung Kong. 2023. The influence of psychological needs and motivation on game cheating: insights from self-determination theory. Frontiers in Psychology, 14 (2023), 1278738.","journal-title":"Frontiers in Psychology"},{"key":"e_1_2_1_70_1","volume-title":"Dae Young Lee, and Gyoung Mo Kim.","author":"Lee Sung Je","year":"2021","unstructured":"Sung Je Lee, Eui Jun Jeong, Dae Young Lee, and Gyoung Mo Kim. 2021. Why do some users become enticed to cheating in competitive online games? An empirical study of cheating focused on competitive motivation, self-esteem, and aggression. Frontiers in psychology, 12 (2021), 768825."},{"key":"e_1_2_1_71_1","unstructured":"Zohar Levkovitz. 2023. Content moderators alone can\u2019t clean up our toxic internet. https:\/\/www.fastcompany.com\/90515733\/content-moderators-alone-cant-clean-up-our-toxic-internet (Accessed on 04\/20\/2023)"},{"key":"e_1_2_1_72_1","first-page":"898","article-title":"Punishing the perpetrator of incivility: The differential roles of moral identity and moral thinking orientation","volume":"47","author":"Lin Xiaowan","year":"2021","unstructured":"Xiaowan Lin and Raymond Loi. 2021. Punishing the perpetrator of incivility: The differential roles of moral identity and moral thinking orientation. Journal of Management, 47, 4 (2021), 898\u2013929.","journal-title":"Journal of Management"},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the ISCRAM 2016 Conference. ISCRAM, Rio de Janeiro, Brazil.","author":"Link Daniel","year":"2016","unstructured":"Daniel Link, Bernd Hellingrath, and Jie Ling. 2016. A Human-is-the-Loop Approach for Semi-Automated Content Moderation. In Proceedings of the ISCRAM 2016 Conference. ISCRAM, Rio de Janeiro, Brazil."},{"key":"e_1_2_1_74_1","first-page":"598","article-title":"After All, They Don\u2019t Know Me","volume":"18","author":"Liu Yansheng","year":"2023","unstructured":"Yansheng Liu and Colin Agur. 2023. \u201cAfter All, They Don\u2019t Know Me\u201d Exploring the psychological mechanisms of toxic behavior in online games. Games and Culture, 18, 5 (2023), 598\u2013621.","journal-title":"Games and Culture"},{"key":"e_1_2_1_75_1","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1111\/j.1745-9133.2005.00352.x","article-title":"Better gun enforcement, less crime","volume":"4","author":"Ludwig Jens","year":"2005","unstructured":"Jens Ludwig. 2005. Better gun enforcement, less crime. Criminology & Public Policy, 4, 4 (2005), 677\u2013716.","journal-title":"Criminology & Public Policy"},{"key":"e_1_2_1_76_1","unstructured":"Thodoris Lykouris and Wentao Weng. 2024. Learning to defer in content moderation: The human-ai interplay. arXiv preprint arXiv:2402.12237."},{"key":"e_1_2_1_77_1","volume-title":"Content Moderation Experiences. arXiv e-prints, 1","author":"Lyu Yao","year":"2024","unstructured":"Yao Lyu, Jie Cai, Anisa Callis, Kelley Cotter, and John M Carroll. 2024. \"I Got Flagged for Supposed Bullying, Even Though It Was in Response to Someone Harassing Me About My Disability.\": A Study of Blind TikTokers\u2019 Content Moderation Experiences. arXiv e-prints, 1 (2024), arXiv\u20132401."},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery","author":"Ma Renkai","year":"2023","unstructured":"Renkai Ma, Yao Li, and Yubo Kou. 2023. Transparency, Fairness, and Coping: How Players Experience Moderation in Multiplayer Online Games. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Hamburg, Germany. 1\u201321."},{"key":"e_1_2_1_79_1","first-page":"424","article-title":"The Influence Of Audit Probability, Sanction Severity","volume":"4","author":"Marfiana Andri","year":"2024","unstructured":"Andri Marfiana and Rizky Aji Santoso. 2024. The Influence Of Audit Probability, Sanction Severity, And Social Norms On Enforced Tax Compliance With Patriotism As Moderation. Educoretax, 4, 4 (2024), 424\u2013439.","journal-title":"Educoretax"},{"key":"e_1_2_1_80_1","volume-title":"Handbook of Esports Medicine: Clinical Aspects of Competitive Video Gaming","author":"Migliore Lindsey","unstructured":"Lindsey Migliore. 2021. What is esports? The past, present, and future of competitive gaming. In Handbook of Esports Medicine: Clinical Aspects of Competitive Video Gaming. Springer, 1\u201316."},{"key":"e_1_2_1_81_1","volume-title":"Modulate and Activision Case Study | Modulate. https:\/\/www.modulate.ai\/case-studies\/modulate-activision-case-study [Online","author":"Inc. Modulate. 2025.","year":"2025","unstructured":"Inc. Modulate. 2025. Modulate and Activision Case Study | Modulate. https:\/\/www.modulate.ai\/case-studies\/modulate-activision-case-study [Online; accessed 2025-04-30]"},{"key":"e_1_2_1_82_1","volume-title":"Methods of coping with social desirability bias: A review. European journal of social psychology, 15, 3","author":"Nederhof Anton J","year":"1985","unstructured":"Anton J Nederhof. 1985. Methods of coping with social desirability bias: A review. European journal of social psychology, 15, 3 (1985), 263\u2013280."},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106426.3106452"},{"key":"e_1_2_1_84_1","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1177\/1461444818814252","article-title":"The meanings of racist and sexist trash talk for men of color: A cultural sociological approach to studying gaming culture","volume":"21","author":"Ortiz Stephanie M","year":"2019","unstructured":"Stephanie M Ortiz. 2019. The meanings of racist and sexist trash talk for men of color: A cultural sociological approach to studying gaming culture. New Media & Society, 21, 4 (2019), 879\u2013894.","journal-title":"New Media & Society"},{"key":"e_1_2_1_85_1","first-page":"1664","article-title":"Adolescent gaming and social media usage before and during the COVID-19 pandemic","volume":"67","author":"Paschke Kerstin","year":"2021","unstructured":"Kerstin Paschke, Maria Isabella Austermann, Kathrin Simon-Kutscher, and Rainer Thomasius. 2021. Adolescent gaming and social media usage before and during the COVID-19 pandemic. Sucht, 67 (2021), 1664\u20132856.","journal-title":"Sucht"},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the Annual Hawaii International Conference on System Sciences. IEEE, Hawaii. 3005\u20133014","author":"Patel Aashka","year":"2021","unstructured":"Aashka Patel, Christine L Cook, and Donghee Yvette Wohn. 2021. User Opinions on Effective Strategies Against Social Media Toxicity. In Proceedings of the Annual Hawaii International Conference on System Sciences. IEEE, Hawaii. 3005\u20133014."},{"key":"e_1_2_1_87_1","volume-title":"The toxic meritocracy of video games: Why gaming culture is the worst","author":"Paul Christopher A","unstructured":"Christopher A Paul. 2018. The toxic meritocracy of video games: Why gaming culture is the worst. U of Minnesota Press."},{"key":"e_1_2_1_88_1","volume-title":"Taking stock","author":"Pratt Travis C","unstructured":"Travis C Pratt, Francis T Cullen, Kristie R Blevins, Leah E Daigle, and Tamara D Madensen. 2017. The empirical status of deterrence theory: A meta-analysis. In Taking stock. Routledge, London, UK. 367\u2013395."},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0019440"},{"key":"e_1_2_1_90_1","doi-asserted-by":"crossref","first-page":"698799","DOI":"10.3389\/fpsyg.2021.698799","article-title":"Massively multiplayer online games and well-being: A systematic literature review","volume":"12","author":"Raith Lisa","year":"2021","unstructured":"Lisa Raith, Julie Bignill, Vasileios Stavropoulos, Prudence Millear, Andrew Allen, Helen M Stallman, Jonathan Mason, Tamara De Regt, Andrew Wood, and Lee Kannis-Dymand. 2021. Massively multiplayer online games and well-being: A systematic literature review. Frontiers in Psychology, 12 (2021), 698799.","journal-title":"Frontiers in Psychology"},{"key":"e_1_2_1_91_1","first-page":"205395172110461","article-title":"The fabrics of machine moderation: Studying the technical, normative, and organizational structure of Perspective API","volume":"8","author":"Rieder Bernhard","year":"2021","unstructured":"Bernhard Rieder and Yarden Skop. 2021. The fabrics of machine moderation: Studying the technical, normative, and organizational structure of Perspective API. Big Data & Society, 8, 2 (2021), 20539517211046181.","journal-title":"Big Data & Society"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/70.1.41"},{"key":"e_1_2_1_93_1","unstructured":"Teemu Saarinen. 2017. Toxic behavior in online games. Master\u2019s thesis. T. Saarinen."},{"key":"e_1_2_1_94_1","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.jeconom.2020.06.003","article-title":"Doubly robust difference-in-differences estimators","volume":"219","author":"Sant\u2019Anna Pedro HC","year":"2020","unstructured":"Pedro HC Sant\u2019Anna and Jun Zhao. 2020. Doubly robust difference-in-differences estimators. Journal of Econometrics, 219, 1 (2020), 101\u2013122.","journal-title":"Journal of Econometrics"},{"key":"e_1_2_1_95_1","doi-asserted-by":"crossref","unstructured":"Bernhard Sch\u00f6lkopf. 2022. Causality for machine learning. In Probabilistic and causal inference: The works of Judea Pearl. 765\u2013804.","DOI":"10.1145\/3501714.3501755"},{"key":"e_1_2_1_96_1","doi-asserted-by":"crossref","first-page":"457","DOI":"10.2188\/jea.JE20210145","article-title":"Using propensity scores for causal inference: pitfalls and tips","volume":"31","author":"Shiba Koichiro","year":"2021","unstructured":"Koichiro Shiba and Takuya Kawahara. 2021. Using propensity scores for causal inference: pitfalls and tips. Journal of epidemiology, 31, 8 (2021), 457\u2013463.","journal-title":"Journal of epidemiology"},{"key":"e_1_2_1_97_1","volume-title":"2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing. 617\u2013620","author":"Shim Kyong Jin","year":"2011","unstructured":"Kyong Jin Shim, Kuo-Wei Hsu, Samarth Damania, Colin DeLong, and Jaideep Srivastava. 2011. An exploratory study of player and team performance in multiplayer first-person-shooter games. In 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing. 617\u2013620."},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. Association for Computing Machinery","author":"Srikanth Maya","year":"2021","unstructured":"Maya Srikanth, Anqi Liu, Nicholas Adams-Cohen, Jian Cao, R Michael Alvarez, and Anima Anandkumar. 2021. Dynamic social media monitoring for fast-evolving online discussions. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. Association for Computing Machinery, Singapore. 3576\u20133584."},{"key":"e_1_2_1_99_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction, 3, CSCW","author":"Srinivasan Kumar Bhargav","year":"2019","unstructured":"Kumar Bhargav Srinivasan, Cristian Danescu-Niculescu-Mizil, Lillian Lee, and Chenhao Tan. 2019. Content removal as a moderation strategy: Compliance and other outcomes in the changemyview community. Proceedings of the ACM on Human-Computer Interaction, 3, CSCW (2019), 1\u201321."},{"key":"e_1_2_1_100_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3582930","article-title":"Games as social platforms","volume":"1","author":"Steinkuehler Constance","year":"2023","unstructured":"Constance Steinkuehler. 2023. Games as social platforms. ACM Games: Research and Practice, 1, 1 (2023), 1\u20132.","journal-title":"ACM Games: Research and Practice"},{"key":"e_1_2_1_101_1","volume-title":"Proceedings of the Third Workshop on Abusive Language Online. Association for Computational Linguistics","author":"Stoop Wessel","unstructured":"Wessel Stoop, Florian Kunneman, Antal van den Bosch, and Ben Miller. 2019. Detecting harassment in real-time as conversations develop. In Proceedings of the Third Workshop on Abusive Language Online. Association for Computational Linguistics, Florence, Italy. 19\u201324."},{"key":"e_1_2_1_102_1","volume-title":"The social side of gaming: How playing online computer games creates online and offline social support. Computers in Human behavior, 28, 3","author":"Trepte Sabine","year":"2012","unstructured":"Sabine Trepte, Leonard Reinecke, and Keno Juechems. 2012. The social side of gaming: How playing online computer games creates online and offline social support. Computers in Human behavior, 28, 3 (2012), 832\u2013839."},{"key":"e_1_2_1_103_1","first-page":"209","article-title":"The Principles of Esports Engagement: A Universal Code of Conduct","author":"Tseng Yen-Shyang","year":"2019","unstructured":"Yen-Shyang Tseng. 2019. The Principles of Esports Engagement: A Universal Code of Conduct? J. Intell. Prop. L., 27 (2019), 209.","journal-title":"J. Intell. Prop."},{"key":"e_1_2_1_104_1","unstructured":"Aaron D Tucker Caleb Biddulph Claire Wang and Thorsten Joachims. 2023. Bandits with costly reward observations. In Uncertainty in Artificial Intelligence. 2147\u20132156."},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376191"},{"key":"e_1_2_1_106_1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1\u201313","author":"Vaccaro Kristen","year":"2018","unstructured":"Kristen Vaccaro, Dylan Huang, Motahhare Eslami, Christian Sandvig, Kevin Hamilton, and Karrie Karahalios. 2018. The illusion of control: Placebo effects of control settings. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1\u201313."},{"key":"e_1_2_1_107_1","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1037\/apl0000178","article-title":"The dynamics of punishment and trust","volume":"102","author":"Wang Long","year":"2017","unstructured":"Long Wang and J Keith Murnighan. 2017. The dynamics of punishment and trust.. Journal of Applied Psychology, 102, 10 (2017), 1385.","journal-title":"Journal of Applied Psychology"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.54097\/8g3dj357"},{"key":"e_1_2_1_109_1","volume-title":"Findings of the Association for Computational Linguistics: ACL-IJCNLP. abs\/2106.06213","author":"Weld Henry","unstructured":"Henry Weld, Guanghao Huang, Jean Lee, Tongshu Zhang, Kunze Wang, Xinghong Guo, Siqu Long, Josiah Poon, and Soyeon Caren Han. 2021. Conda: a contextual dual-annotated dataset for in-game toxicity understanding and detection. In Findings of the Association for Computational Linguistics: ACL-IJCNLP. abs\/2106.06213, Association for Computational Linguistics, Bangkok, Thailand. 2406\u20132416. https:\/\/api.semanticscholar.org\/CorpusID:235417027"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.concog.2019.05.007"},{"key":"e_1_2_1_111_1","unstructured":"Stephen G West Jeremy C Biesanz and Steven C Pitts. 2000. Causal inference and generalization in field settings: Experimental and quasi-experimental designs.."},{"key":"e_1_2_1_112_1","volume-title":"Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery","author":"Wijkstra Michel","year":"2023","unstructured":"Michel Wijkstra, Katja Rogers, Regan L Mandryk, Remco C Veltkamp, and Julian Frommel. 2023. Help, My Game Is Toxic! First Insights from a Systematic Literature Review on Intervention Systems for Toxic Behaviors in Online Video Games. In Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery, New York, NY, USA. 3\u20139. isbn:9798400700293"},{"key":"e_1_2_1_113_1","unstructured":"LoL Wiki. 2021. Kill to Death Ratio -League of Legends Wiki - Fandom. https:\/\/leagueoflegends.fandom.com\/wiki\/Kill_to_Death_Ratio#: :text=The Kill to Death ratio other players in the game. (Accessed on 10\/09\/2024)"},{"key":"e_1_2_1_114_1","volume-title":"Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation. arxiv:2210.15723.","author":"Wojcik Stefan","year":"2022","unstructured":"Stefan Wojcik, Sophie Hilgard, Nick Judd, Delia Mocanu, Stephen Ragain, M. B. Fallin Hunzaker, Keith Coleman, and Jay Baxter. 2022. Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation. arxiv:2210.15723."},{"key":"e_1_2_1_115_1","first-page":"1359","article-title":"Contractual and relational enforcement in the aftermath of contract violations: the role of contracts and trust","volume":"14","author":"Yao Hongjiang","year":"2021","unstructured":"Hongjiang Yao, Yongqiang Chen, Yangbing Zhang, and Bo Du. 2021. Contractual and relational enforcement in the aftermath of contract violations: the role of contracts and trust. International Journal of Managing Projects in Business, 14, 6 (2021), 1359\u20131382.","journal-title":"International Journal of Managing Projects in Business"},{"key":"e_1_2_1_116_1","unstructured":"Valerie Jingwen Yu. 2024. Dynamic boundaries of acceptable play: a mixed methods examination into players\u2019 interpretations of toxic behavior in multiplayer online games."},{"key":"e_1_2_1_117_1","unstructured":"Amy X Zhang and Parth Naidu. 2024. The SIDO Performance Model for League of Legends. arXiv preprint arXiv:2403.04873."},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4089011"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3748599","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,5]],"date-time":"2025-10-05T21:06:13Z","timestamp":1759698373000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3748599"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,5]]},"references-count":118,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,10,5]]}},"alternative-id":["10.1145\/3748599"],"URL":"https:\/\/doi.org\/10.1145\/3748599","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,5]]},"assertion":[{"value":"2025-02-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}