{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T02:59:07Z","timestamp":1774321147458,"version":"3.50.1"},"reference-count":63,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,24]],"date-time":"2022-01-24T00:00:00Z","timestamp":1642982400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Fundamental Scientific Research Operation Fees of Central Universities","award":["21D111208"],"award-info":[{"award-number":["21D111208"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Crowdsourcing integrates human wisdom to solve problems. Tremendous research efforts have been made in this area. However, most of them assume that workers have the same credibility in different domains and workers complete tasks independently. This leads to an inaccurate evaluation of worker credibility, hampering crowdsourcing results. To consider the impact of worker domain expertise, we adopted a vector to more accurately measure the credibility of each worker. Based on this measurement and prior task domain knowledge, we calculated fine-grained worker credibility on each given task. To avoid tasks being assigned to dependent workers who copy answers from others, we conducted copier detection via Bayesian analysis. We designed a crowdsourcing system called SWWC composed of a task assignment stage and a truth discovery stage. In the task assignment stage, we assigned tasks wisely to workers based on worker domain expertise calculation and copier removal. In the truth discovery stage, we computed the estimated truth and worker credibility by an iterative method. Then, we updated the domain expertise of workers to facilitate the upcoming task assignment. We also designed initialization algorithms to better initialize the accuracy of new workers. Theoretical analysis and experimental results showed that our method had a prominent advantage, especially under a copying situation.<\/jats:p>","DOI":"10.3390\/fi14020037","type":"journal-article","created":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T20:38:58Z","timestamp":1643143138000},"page":"37","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Selecting Workers Wisely for Crowdsourcing When Copiers and Domain Experts Co-exist"],"prefix":"10.3390","volume":"14","author":[{"given":"Xiu","family":"Fang","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Donghua University, Shanghai 201600, China"}]},{"given":"Suxin","family":"Si","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Donghua University, Shanghai 201600, China"}]},{"given":"Guohao","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Donghua University, Shanghai 201600, China"}]},{"given":"Quan Z.","family":"Sheng","sequence":"additional","affiliation":[{"name":"School of Computing, Macquaire University, Sydney, NSW 2109, Australia"}]},{"given":"Wenjun","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Donghua University, Shanghai 201600, China"}]},{"given":"Kang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Donghua University, Shanghai 201600, China"}]},{"given":"Hang","family":"Lv","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Donghua University, Shanghai 201600, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Eickhoff, C. (2018, January 5\u20139). Cognitive Biases in Crowdsourcing. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Los Angeles, CA, USA.","DOI":"10.1145\/3159652.3159654"},{"key":"ref_2","unstructured":"Saito, S., Kobayashi, T., and Nakano, T. (March, January 27). Towards a Framework for Collaborative Video Surveillance System Using Crowdsourcing. Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion, San Francisco, CA, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Fan, J., Lu, M., Ooi, B.C., Tan, W., and Zhang, M. (April, January 31). A hybrid machine-crowdsourcing system for matching web tables. Proceedings of the 2014 IEEE 30th International Conference on Data Engineering, Chicago, IL, USA.","DOI":"10.1109\/ICDE.2014.6816716"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Tan, J.T.C., Hagiwara, Y., and Inamura, T. (2017, January 6\u20139). Learning from Human Collaborative Experience: Robot Learning via Crowdsourcing of Human-Robot Interaction. Proceedings of the Companion of the 2017 ACM\/IEEE International Conference on Human-Robot Interaction, Vienna, Austria.","DOI":"10.1145\/3029798.3038328"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1483","DOI":"10.14778\/2350229.2350263","article-title":"CrowdER: Crowdsourcing Entity Resolution","volume":"5","author":"Wang","year":"2012","journal-title":"Proc. VLDB Endow."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1040","DOI":"10.14778\/2336664.2336676","article-title":"CDAS: A Crowdsourcing Data Analytics System","volume":"5","author":"Liu","year":"2012","journal-title":"Proc. VLDB Endow."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"20","DOI":"10.2307\/2346806","article-title":"Maximum likelihood estimation of observer error-rates using the em algorithm","volume":"28","author":"Dawid","year":"1979","journal-title":"Appl. Stat."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xu, L., Hao, X., Lane, N.D., Liu, X., and Moscibroda, T. (2015, January 7\u201311). More with Less: Lowering User Burden in Mobile Crowdsourcing through Compressive Sensing. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Osaka, Japan.","DOI":"10.1145\/2750858.2807523"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kae-Nune, N., and Pesseguier, S. (2013, January 18\u201322). Qualification and Testing Process to Implement Anti-Counterfeiting Technologies into IC Packages. Proceedings of the 2013 Design, Automation & Test in Europe Conference & Exhibition (DATE), Grenoble, France.","DOI":"10.7873\/DATE.2013.237"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Demartini, G., Difallah, D.E., and Cudr\u00e9-Mauroux, P. (2012, January 16\u201320). ZenCrowd: Leveraging probabilistic reasoning and crowdsourcing techniques for large-scale entity linking. Proceedings of the 21st International Conference on World Wide Web, Lyon, France.","DOI":"10.1145\/2187836.2187900"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Franklin, M.J., Kossmann, D., Kraska, T., Ramesh, S., and Xin, R. (2011, January 12\u201316). CrowdDB: Answering queries with crowdsourcing. Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data, Athens, Greece.","DOI":"10.1145\/1989323.1989331"},{"key":"ref_12","unstructured":"Zheng, Y., Cheng, R., Maniu, S., and Mo, L. (2015, January 23\u201327). On Optimality of Jury Selection in Crowdsourcing. Proceedings of the 18th International Conference on Extending Database Technology, Brussels, Belgium."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zheng, Y., Wang, J., Li, G., Cheng, R., and Feng, J. (June, January 31). QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications. Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, Victoria, Australia.","DOI":"10.1145\/2723372.2749430"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Han, F., Tan, S., Sun, H., Srivatsa, M., Cai, D., and Yan, X. (2016, January 5\u20137). Distributed Representations of Expertise. Proceedings of the 2016 SIAM International Conference on Data Mining. Society for Industrial and Applied Mathematics, Miami, FL, USA.","DOI":"10.1137\/1.9781611974348.60"},{"key":"ref_15","unstructured":"Liu, X., He, H., and Baras, J.S. (2015, January 6\u20139). Crowdsourcing with multi-dimensional trust. Proceedings of the 2015 18th International Conference on Information Fusion, Washington, DC, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"562","DOI":"10.14778\/1687627.1687691","article-title":"Truth Discovery and Copying Detection in a Dynamic World","volume":"2","author":"Dong","year":"2009","journal-title":"Proc. VLDB Endow."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Boim, R., Greenshpan, O., Milo, T., Novgorodov, S., Polyzotis, N., and Tan, W.C. (2012, January 1\u20135). Asking the Right Questions in Crowd Data Sourcing. Proceedings of the 2012 IEEE 28th International Conference on Data Engineering, Arlington, VA, USA.","DOI":"10.1109\/ICDE.2012.122"},{"key":"ref_18","unstructured":"Chen, X., Lin, Q., and Zhou, D. (2013, January 16\u201321). Optimistic Knowledge Gradient Policy for Optimal Budget Allocation in Crowdsourcing. Proceedings of the International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Khan, A.R., and Garcia-Molina, H. (2017, January 14\u201319). CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems. Proceedings of the 2017 ACM International Conference on Management of Data, Chicago, CA, USA.","DOI":"10.1145\/3035918.3064055"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Parameswaran, A.G., Garcia-Molina, H., Park, H., Polyzotis, N., Ramesh, A., and Widom, J. (2012, January 20\u201324). CrowdScreen: Algorithms for filtering data with humans. Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, Scottsdale, AZ, USA.","DOI":"10.1145\/2213836.2213878"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gao, J., Liu, X., Ooi, B.C., Wang, H., and Chen, G. (2013, January 6\u201310). An online cost sensitive decision-making method in crowdsourcing systems. Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, Indianapolis, IN, USA.","DOI":"10.1145\/2463676.2465307"},{"key":"ref_22","unstructured":"Mo, L., Cheng, R., Kao, B., Yang, X.S., Ren, C., Lei, S., Cheung, D.W., and Lo, E. (November, January 27). Optimizing plurality for human intelligence tasks. Proceedings of the 22nd ACM International Conference on Information & Knowledge Management, San Francisco, CA, USA."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sheng, V.S., Provost, F.J., and Ipeirotis, P.G. (2008, January 24\u201327). Get another label? Improving data quality and data mining using multiple, noisy labelers. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NA, USA.","DOI":"10.1145\/1401890.1401965"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Mo, K., Zhong, E., and Yang, Q. (2013, January 11\u201314). Cross-task crowdsourcing. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, CA, USA.","DOI":"10.1145\/2487575.2487593"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Qiu, C., Squicciarini, A.C., Carminati, B., Caverlee, J., and Khare, D.R. (2016, January 24\u201328). CrowdSelect: Increasing Accuracy of Crowdsourcing Tasks through Behavior Prediction and User Selection. Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, Indianapolis, IN, USA.","DOI":"10.1145\/2983323.2983830"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.artint.2013.06.002","article-title":"POMDP-based control of workflows for crowdsourcing","volume":"202","author":"Dai","year":"2013","journal-title":"Artif. Intell."},{"key":"ref_27","unstructured":"Karger, D.R., Oh, S., and Shah, D. (2011, January 12\u201315). Iterative Learning for Reliable Crowdsourcing Systems. Proceedings of the Neural Information Processing Systems, Granada, Spain."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Qiu, S., Gadiraju, U., and Bozzon, A. (2020, January 25\u201330). Improving Worker Engagement Through Conversational Microtask Crowdsourcing. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376403"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Qiu, S., Gadiraju, U., and Bozzon, A. (2020). Just the Right Mood for HIT!\u2014Analyzing the Role of Worker Moods in Conversational Microtask Crowdsourcing, Springer.","DOI":"10.1007\/978-3-030-50578-3_26"},{"key":"ref_30","unstructured":"Zhuang, M., and Gadiraju, U. (July, January 30). In What Mood Are You Today?: An Analysis of Crowd Workers\u2019 Mood, Performance and Engagement. Proceedings of the 10th ACM Conference on Web Science, Boston, MA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Mavridis, P., Huang, O., Qiu, S., Gadiraju, U., and Bozzon, A. (2019, January 9\u201312). Chatterbox: Conversational Interfaces for Microtask Crowdsourcing. Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization, Larnaca, Cyprus.","DOI":"10.1145\/3320435.3320439"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Qiu, S., Gadiraju, U., and Bozzon, A. (2020, January 17\u201321). TickTalkTurk: Conversational Crowdsourcing Made Easy. Proceedings of the Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing, Virtual Event.","DOI":"10.1145\/3406865.3418572"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"36:1","DOI":"10.1145\/3491048","article-title":"Power of Bonus in Pricing for Crowdsourcing","volume":"5","author":"Shin","year":"2021","journal-title":"Proc. ACM Meas. Anal. Comput. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"30:1","DOI":"10.1145\/3397180","article-title":"Quality-aware Online Task Assignment in Mobile Crowdsourcing","volume":"16","author":"Miao","year":"2020","journal-title":"ACM Trans. Sens. Netw."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Fang, Y., Si, L., and Mathur, A.P. (2010, January 19\u201323). Discriminative models of integrating document evidence and document-candidate associations for expert search. Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Geneva, Switzerland.","DOI":"10.1145\/1835449.1835563"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Deng, H., King, I., and Lyu, M.R. (2008, January 15\u201319). Formal Models for Expert Finding on DBLP Bibliography Data. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Pisa, Italy.","DOI":"10.1109\/ICDM.2008.29"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Serdyukov, P., Rode, H., and Hiemstra, D. (2008, January 26\u201330). Modeling multi-step relevance propagation for expert finding. Proceedings of the 17th ACM Conference on Information and Knowledge Management, Napa Valley, CA, USA.","DOI":"10.1145\/1458082.1458232"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2163","DOI":"10.1109\/TKDE.2015.2411283","article-title":"Fine-Grained Knowledge Sharing in Collaborative Environments","volume":"27","author":"Guan","year":"2015","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1145\/347634.348775","article-title":"Working knowledge: How organizations manage what they know","volume":"2000","author":"Davenport","year":"2000","journal-title":"Ubiquity"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Mimno, D.M., and McCallum, A. (2007, January 19\u201323). Expertise modeling for matching papers with reviewers. Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, London, UK.","DOI":"10.1145\/1281192.1281247"},{"key":"ref_41","first-page":"4:1","article-title":"Learning author-topic models from text corpora","volume":"28","author":"Chemudugunta","year":"2010","journal-title":"ACM Trans. Inf. Syst."},{"key":"ref_42","first-page":"993","article-title":"Latent Dirichlet Allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Zhao, W.X., Jiang, J., Weng, J., He, J., Lim, E., Yan, H., and Li, X. (2011, January 18\u201321). Comparing Twitter and Traditional Media Using Topic Models. Proceedings of the European Conference on Information Retrieval, Dublin, Ireland.","DOI":"10.1007\/978-3-642-20161-5_34"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"361","DOI":"10.14778\/3025111.3025118","article-title":"DOCS: A Domain-Aware Crowdsourcing System Using Knowledge Bases","volume":"10","author":"Zheng","year":"2016","journal-title":"Proc. VLDB Endow."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Goel, G., Nikzad, A., and Singla, A. (2014, January 7\u201311). Allocating tasks to workers with matching constraints: Truthful mechanisms for crowdsourcing markets. Proceedings of the 23rd International Conference on World Wide Web, Seoul, Korea.","DOI":"10.1145\/2567948.2577311"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Han, L., Maddalena, E., Checco, A., Sarasua, C., Gadiraju, U., Roitero, K., and Demartini, G. (2020, January 3\u20137). Crowd Worker Strategies in Relevance Judgment Tasks. Proceedings of the 13th International Conference on Web Search and Data Mining, Houston, TX, USA.","DOI":"10.1145\/3336191.3371857"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/TKDE.2007.190745","article-title":"Truth Discovery with Multiple Conflicting Information Providers on the Web","volume":"20","author":"Yin","year":"2008","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"550","DOI":"10.14778\/2168651.2168656","article-title":"A Bayesian Approach to Discovering Truth from Conflicting Sources for Data Integration","volume":"5","author":"Zhao","year":"2012","journal-title":"Proc. VLDB Endow."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Pochampally, R., Sarma, A.D., Dong, X.L., Meliou, A., and Srivastava, D. (2014, January 22\u201327). Fusing data with correlations. Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, Snowbird, UT, USA.","DOI":"10.1145\/2588555.2593674"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"541","DOI":"10.14778\/3055540.3055547","article-title":"Truth Inference in Crowdsourcing: Is the Problem Solved?","volume":"10","author":"Zheng","year":"2017","journal-title":"Proc. VLDB Endow."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Ma, F., Li, Y., Li, Q., Qiu, M., Gao, J., Zhi, S., Su, L., Zhao, B., Ji, H., and Han, J. (2015, January 10\u201313). FaitCrowd: Fine Grained Truth Discovery for Crowdsourced Data Aggregation. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, Australia.","DOI":"10.1145\/2783258.2783314"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Galland, A., Abiteboul, S., Marian, A., and Senellart, P. (2010, January 3\u20136). Corroborating information from disagreeing views. Proceedings of the Third ACM International Conference on Web Search and Data Mining, New York, NY, USA.","DOI":"10.1145\/1718487.1718504"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1145\/3187009.3177739","article-title":"Domain-Aware Multi-Truth Discovery from Conflicting Sources","volume":"11","author":"Lin","year":"2018","journal-title":"Proc. VLDB Endow."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Miao, C., Jiang, W., Su, L., Li, Y., Guo, S., Qin, Z., Xiao, H., Gao, J., and Ren, K. (2015, January 1\u20134). Cloud-Enabled Privacy-Preserving Truth Discovery in Crowd Sensing Systems. Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems, Seoul, Korea.","DOI":"10.1145\/2809695.2809719"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Tang, X., Wang, C., Yuan, X., and Wang, Q. (2018, January 15\u201319). Non-Interactive Privacy-Preserving Truth Discovery in Crowd Sensing Applications. Proceedings of the IEEE INFOCOM 2018-IEEE Conference on Computer Communications, Honolulu, HI, USA.","DOI":"10.1109\/INFOCOM.2018.8486371"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1109\/JSAC.2017.2676898","article-title":"On Designing Data Quality-Aware Truth Estimation and Surplus Sharing Method for Mobile Crowdsensing","volume":"35","author":"Yang","year":"2017","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Xiao, M., Wu, J., Zhang, S., and Yu, J. (2017, January 1\u20134). Secret-sharing-based secure user recruitment protocol for mobile crowdsensing. Proceedings of the INFOCOM 2017-IEEE Conference on Computer Communications, Atlanta, GA, USA.","DOI":"10.1109\/INFOCOM.2017.8057032"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Jin, H., Su, L., and Nahrstedt, K. (2017, January 1\u20134). CENTURION: Incentivizing multi-requester mobile crowd sensing. Proceedings of the IEEE INFOCOM 2017-IEEE Conference on Computer Communications, Atlanta, GA, USA.","DOI":"10.1109\/INFOCOM.2017.8057111"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Wang, X., Sheng, Q.Z., Fang, X.S., Yao, L., Xu, X., and Li, X. (2015, January 19\u201323). An Integrated Bayesian Approach for Effective Multi-Truth Discovery. Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, Melbourne, Australia.","DOI":"10.1145\/2806416.2806443"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Jiang, L., Niu, X., Xu, J., Yang, D., and Xu, L. (2019, January 7\u20139). Incentivizing the Workers for Truth Discovery in Crowdsourcing with Copiers. Proceedings of the 2019 IEEE 39th International Conference on Distributed Computing Systems, Dallas, TX, USA.","DOI":"10.1109\/ICDCS.2019.00129"},{"key":"ref_61","unstructured":"Ho, C., and Vaughan, J.W. (2012, January 22\u201326). Online Task Assignment in Crowdsourcing Markets. Proceedings of the AAAI Conference on Artificial Intelligence, Toronto, ON, Canada."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.artint.2014.04.005","article-title":"Efficient crowdsourcing of unknown experts using bounded multi-armed bandits","volume":"214","author":"Stein","year":"2014","journal-title":"Artif. Intell."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"19:1","DOI":"10.1145\/2827872","article-title":"The MovieLens Datasets: History and Context","volume":"5","author":"Harper","year":"2016","journal-title":"ACM Trans. Interact. Intell. Syst."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/2\/37\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:06:47Z","timestamp":1760134007000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/2\/37"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,24]]},"references-count":63,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["fi14020037"],"URL":"https:\/\/doi.org\/10.3390\/fi14020037","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,24]]}}}