{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T13:14:37Z","timestamp":1755695677976,"version":"3.41.0"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2018,6,30]],"date-time":"2018-06-30T00:00:00Z","timestamp":1530316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2018,6,30]]},"abstract":"<jats:p>Sophisticated ubiquitous sensing systems are being used to measure motor ability in clinical settings. Intended to augment clinical decision-making, the interpretability of the machine-learning measurements underneath becomes critical to their use. We explore how visualization can support the interpretability of machine-learning measures through the case of Assess MS, a system to support the clinical assessment of Multiple Sclerosis. A substantial design challenge is to make visible the algorithm's decision-making process in a way that allows clinicians to integrate the algorithm's result into their own decision process. To this end, we present a series of design iterations that probe the challenges in supporting interpretability in a real-world system. The key contribution of this article is to illustrate that simply making visible the algorithmic decision-making process is not helpful in supporting clinicians in their own decision-making process. It disregards that people and algorithms make decisions in different ways. Instead, we propose that visualisation can provide context to algorithmic decision-making, rendering observable a range of internal workings of the algorithm from data quality issues to the web of relationships generated in the machine-learning process.<\/jats:p>","DOI":"10.1145\/3181670","type":"journal-article","created":{"date-parts":[[2018,7,16]],"date-time":"2018-07-16T13:25:21Z","timestamp":1531747521000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Visualizing Ubiquitously Sensed Measures of Motor Ability in Multiple Sclerosis"],"prefix":"10.1145","volume":"8","author":[{"given":"Cecily","family":"Morrison","sequence":"first","affiliation":[{"name":"Microsoft Research, Cambridge"}]},{"given":"Kit","family":"Huckvale","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge"}]},{"given":"Bob","family":"Corish","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge"}]},{"given":"Richard","family":"Banks","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge"}]},{"given":"Martin","family":"Grayson","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge"}]},{"given":"Jonas","family":"Dorn","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge"}]},{"given":"Abigail","family":"Sellen","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge"}]},{"given":"S\u00e2n","family":"Lindley","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge"}]}],"member":"320","published-online":{"date-parts":[[2018,7,14]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2011.6090063"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/2900423.2900664"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978966"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557353"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2015.26"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788613"},{"key":"e_1_2_1_7_1","unstructured":"O. Ciccarelli P. P. Kwok V. Wottschel D. Chard M. L Stromillo N. De Stefano A. J. Thompson D. H. Miller and D. H. Alexander. 2012. Predicting clinical conversion to multiple sclerosis in patients with clinically isolated syndrome using machine learning techniques. Multiple Sclerosis J. 18 (Oct. 2012) 30--31.  O. Ciccarelli P. P. Kwok V. Wottschel D. Chard M. L Stromillo N. De Stefano A. J. Thompson D. H. Miller and D. H. Alexander. 2012. Predicting clinical conversion to multiple sclerosis in patients with clinically isolated syndrome using machine learning techniques. Multiple Sclerosis J. 18 (Oct. 2012) 30--31."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-4422(12)70059-5"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.4017\/gt.2012.10.4.002.00"},{"volume-title":"Proceedings of the 2011 Conference on Visual Analytics Science and Technology. 151--160","author":"van den Elzen Stef","key":"e_1_2_1_10_1","unstructured":"Stef van den Elzen and Jarke J . van Wijk. 2011. BaobabView: Interactive construction and analysis of decision trees . In Proceedings of the 2011 Conference on Visual Analytics Science and Technology. 151--160 . Stef van den Elzen and Jarke J. van Wijk. 2011. BaobabView: Interactive construction and analysis of decision trees. In Proceedings of the 2011 Conference on Visual Analytics Science and Technology. 151--160."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493433"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978965"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357061"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.03.080"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2016.2593692"},{"key":"e_1_2_1_16_1","volume-title":"Barcellos","author":"Goldstein Benjamin A.","year":"2010","unstructured":"Benjamin A. Goldstein , Alan E. Hubbard , Adele Cutler , and Lisa F . Barcellos . 2010 . An application of random forests to a genome-wide association dataset: Methodological considerations & new findings. BMC Genetics 11 (Jan. 2010), 49. Benjamin A. Goldstein, Alan E. Hubbard, Adele Cutler, and Lisa F. Barcellos. 2010. An application of random forests to a genome-wide association dataset: Methodological considerations & new findings. BMC Genetics 11 (Jan. 2010), 49."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1525\/aa.1994.96.3.02a00100"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 2003 ECSCW Conference on Computer Support Cooperative Work.","author":"Hartswood Mark","year":"2003","unstructured":"Mark Hartswood , Rob Procter , Mark Rouncefield , Roger Slack , James Soutter , and Alex Voss . 2003 . \u201c Reparing\u201d the machine: A case study of the valuation of computer-aided detection tools in breast screening . In Proceedings of the 2003 ECSCW Conference on Computer Support Cooperative Work. Mark Hartswood, Rob Procter, Mark Rouncefield, Roger Slack, James Soutter, and Alex Voss. 2003. \u201cReparing\u201d the machine: A case study of the valuation of computer-aided detection tools in breast screening. In Proceedings of the 2003 ECSCW Conference on Computer Support Cooperative Work."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/358916.358995"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1159\/000360528"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/0933-3657(95)00014-W"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753529"},{"key":"e_1_2_1_23_1","unstructured":"N. Kelani. Design Studio Method. Retrieved from http:\/\/www.bigspaceship.com\/design-studio\/.  N. Kelani. Design Studio Method. Retrieved from http:\/\/www.bigspaceship.com\/design-studio\/."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2013.11.004"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858402"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10470-6_54"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701399"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030365.2030367"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.33.11.1444"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1620545.1620576"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519023"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487579"},{"key":"e_1_2_1_33_1","volume-title":"Mendell","author":"Lowes Linda P.","year":"2013","unstructured":"Linda P. Lowes , Lindsay N. Alfano , Brent A. Yetter , Lise Worthen-Chaudhari , William Hinchman , Jordan Savage , Patrick Samona , Kevin M. Flanigan , and Jerry R . Mendell . 2013 . Proof of concept of the ability of the kinect to quantify upper extremity function in dystrophinopathy. PLOS Curr . 5 (Jan. 2013). Linda P. Lowes, Lindsay N. Alfano, Brent A. Yetter, Lise Worthen-Chaudhari, William Hinchman, Jordan Savage, Patrick Samona, Kevin M. Flanigan, and Jerry R. Mendell. 2013. Proof of concept of the ability of the kinect to quantify upper extremity function in dystrophinopathy. PLOS Curr. 5 (Jan. 2013)."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2011.09.003"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557278"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557387"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466197"},{"key":"e_1_2_1_38_1","volume-title":"Saskia Marie Steinheimer, Peter Kontschieder, Antonio Criminisi","author":"Morrison Cecily","year":"2015","unstructured":"Cecily Morrison , Marcus D'Souza , Kit Huckvale , Jonas F. Dorn , Jessica Burggraaff , Christian Philipp Kamm , Saskia Marie Steinheimer, Peter Kontschieder, Antonio Criminisi , Bernard Uitdehaag , Frank Dahlke, Ludwig Kappos, and Abigail Sellen. 2015 . Usability and acceptability of ASSESS MS: A system to support the assessment of motor dysfunction in Multiple Sclerosis using depth-sensing computer vision. JMIR Human Fact . 2, 1 (2015). Cecily Morrison, Marcus D'Souza, Kit Huckvale, Jonas F. Dorn, Jessica Burggraaff, Christian Philipp Kamm, Saskia Marie Steinheimer, Peter Kontschieder, Antonio Criminisi, Bernard Uitdehaag, Frank Dahlke, Ludwig Kappos, and Abigail Sellen. 2015. Usability and acceptability of ASSESS MS: A system to support the assessment of motor dysfunction in Multiple Sclerosis using depth-sensing computer vision. JMIR Human Fact. 2, 1 (2015)."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2015.1093421"},{"key":"e_1_2_1_40_1","volume-title":"Greenes","author":"Musen Mark A.","year":"2014","unstructured":"Mark A. Musen , Blackford Middleton , and Robert A . Greenes . 2014 . Biomedical Informatics. Springer , London. Mark A. Musen, Blackford Middleton, and Robert A. Greenes. 2014. Biomedical Informatics. Springer, London."},{"key":"e_1_2_1_41_1","first-page":"S1","article-title":"GAIMS: A powerful gait analysis system satisfying the constraints of clinical routine","volume":"19","author":"Pierard S\u00e9bastien","year":"2013","unstructured":"S\u00e9bastien Pierard , Remy Phan Ba , Val\u00e9rie Delvaux , Pierre Maquet , and Marc Van Droogenbroeck . 2013 . GAIMS: A powerful gait analysis system satisfying the constraints of clinical routine . Multiple Sclerosis J. 19 , S1 (Oct. 2013), 359. S\u00e9bastien Pierard, Remy Phan Ba, Val\u00e9rie Delvaux, Pierre Maquet, and Marc Van Droogenbroeck. 2013. GAIMS: A powerful gait analysis system satisfying the constraints of clinical routine. Multiple Sclerosis J. 19, S1 (Oct. 2013), 359.","journal-title":"Multiple Sclerosis J."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 2015 Conference of the Psychology and Programming Interest Group.","author":"Sarkar Advait","year":"2015","unstructured":"Advait Sarkar . 2015 . Confidence, command, complexity: Metamodels for structured interaction with machine intelligence . In Proceedings of the 2015 Conference of the Psychology and Programming Interest Group. Advait Sarkar. 2015. Confidence, command, complexity: Metamodels for structured interaction with machine intelligence. In Proceedings of the 2015 Conference of the Psychology and Programming Interest Group."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858199"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2011.6102442"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbiomech.2004.02.047"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557268"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.03.004"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518895"},{"key":"e_1_2_1_49_1","volume-title":"Rate of agreement for manual and automated techniques for determination of new T2 lesions in children with multiple sclerosis and acute demyelination (P2.242). Neurology 82, 10 Suppl. (Apr","author":"Verhey Leonard","year":"2014","unstructured":"Leonard Verhey , Colm Elliott , Helen Branson , Cristina Philpott , Manohar Shroff , Tal Arbel , Brenda Banwell , and Douglas Arnold . 2014. Rate of agreement for manual and automated techniques for determination of new T2 lesions in children with multiple sclerosis and acute demyelination (P2.242). Neurology 82, 10 Suppl. (Apr . 2014 ), P2.242. Leonard Verhey, Colm Elliott, Helen Branson, Cristina Philpott, Manohar Shroff, Tal Arbel, Brenda Banwell, and Douglas Arnold. 2014. Rate of agreement for manual and automated techniques for determination of new T2 lesions in children with multiple sclerosis and acute demyelination (P2.242). Neurology 82, 10 Suppl. (Apr. 2014), P2.242."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2014.08.014"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gaitpost.2010.10.089"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3181670","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3181670","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:37:49Z","timestamp":1750282669000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3181670"}},"subtitle":["Reflections on Communicating Machine Learning in Practice"],"short-title":[],"issued":{"date-parts":[[2018,6,30]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,6,30]]}},"alternative-id":["10.1145\/3181670"],"URL":"https:\/\/doi.org\/10.1145\/3181670","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2018,6,30]]},"assertion":[{"value":"2016-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-07-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}