{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:25:57Z","timestamp":1750220757650,"version":"3.41.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,4,30]],"date-time":"2020-04-30T00:00:00Z","timestamp":1588204800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"PRID project SMARTLAND"},{"name":"UNIUD plan PSA"},{"name":"University of Udine, and by project HAPTEEV"},{"DOI":"10.13039\/501100001711","name":"Swiss National Science Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2020,4,30]]},"abstract":"<jats:p>Two experiments studied the role of impact sounds and vibrations in classification of materials. The task consisted of feeling on an actuated surface and listening through headphones to the recorded feedback of a ping-pong ball hitting three flat objects respectively made of wood, plastic, and metal, and then identifying their material. In Experiment 1, sounds and vibrations were recorded by keeping the objects in mechanical isolation. In Experiment 2, recordings were taken while the same objects stood on a table, causing their resonances to fade faster due to mechanical coupling with the support. A control experiment, where participants listened to and touched the real objects in mechanical isolation, showed high accuracy of classification from either sounds (90% correct) or vibrations (67% correct). Classification of reproduced bounces in Experiments 1 and 2 was less precise. In both experiments, the main effect of material was statistically significant; conversely, the main effect of modality (auditory or tactile) was significant only in the control. Identification of plastic and especially metal was less accurate in Experiment 2, suggesting that participants, when possible, classified materials by longer resonance tails. Audio-tactile summation of classification accuracy was found, suggesting that multisensory integration influences the perception of materials. Such results have prospective application to the nonvisual design of virtual buttons, which is the object of our current research.<\/jats:p>","DOI":"10.1145\/3393898","type":"journal-article","created":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T17:54:21Z","timestamp":1590429261000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Does It Ping or Pong? Auditory and Tactile Classification of Materials by Bouncing Events"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0876-4828","authenticated-orcid":false,"given":"Yuri De","family":"Pra","sequence":"first","affiliation":[{"name":"University of Udine, Udine, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1692-2603","authenticated-orcid":false,"given":"Federico","family":"Fontana","sequence":"additional","affiliation":[{"name":"University of Udine, Udine, Italy"}]},{"given":"Hanna","family":"J\u00e4rvel\u00e4inen","sequence":"additional","affiliation":[{"name":"Zurich University of the Arts, Zurich, Switzerland"}]},{"given":"Stefano","family":"Papetti","sequence":"additional","affiliation":[{"name":"Zurich University of the Arts, Zurich, Switzerland"}]},{"given":"Michele","family":"Simonato","sequence":"additional","affiliation":[{"name":"Electrolux Professional SpA, Viale Treviso, Pordenone, Italy"}]}],"member":"320","published-online":{"date-parts":[[2020,5,18]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 3rd International Conference on Human Computer Interaction Theory and Applications. DOI:https:\/\/doi.org\/10","author":"Abdikadirova Banu","year":"2019","unstructured":"Banu Abdikadirova , Evagoras Xydas , and Nurgeldy Praliyev . 2019 . Effect of frequency level on vibro-tactile sound detection . In Proceedings of the 3rd International Conference on Human Computer Interaction Theory and Applications. DOI:https:\/\/doi.org\/10 .5220\/0007347100970102 10.5220\/0007347100970102 Banu Abdikadirova, Evagoras Xydas, and Nurgeldy Praliyev. 2019. Effect of frequency level on vibro-tactile sound detection. In Proceedings of the 3rd International Conference on Human Computer Interaction Theory and Applications. DOI:https:\/\/doi.org\/10.5220\/0007347100970102"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1163\/22134808-00002429"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1288937"},{"key":"e_1_2_1_4_1","volume-title":"Vibrotactile intensity and frequency information in the Pacinian system: A psychophysical model. Perception 8 Psychophysics 67, 5 (July","author":"Bensma\u00efa Sliman J.","year":"2005","unstructured":"Sliman J. Bensma\u00efa , Mark Hollins , and Jeffrey Yau . 2005. Vibrotactile intensity and frequency information in the Pacinian system: A psychophysical model. Perception 8 Psychophysics 67, 5 (July 2005 ), 828--841. DOI:https:\/\/doi.org\/10.3758\/BF03193536 10.3758\/BF03193536 Sliman J. Bensma\u00efa, Mark Hollins, and Jeffrey Yau. 2005. Vibrotactile intensity and frequency information in the Pacinian system: A psychophysical model. Perception 8 Psychophysics 67, 5 (July 2005), 828--841. DOI:https:\/\/doi.org\/10.3758\/BF03193536"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-004-2128-2"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0012240"},{"key":"e_1_2_1_7_1","first-page":"3","article-title":"Tactile perception and friction-induced vibrations: Discrimination of similarly patterned wood-like surfaces","volume":"10","author":"Ndengue Jessica D.","year":"2017","unstructured":"Jessica D. Ndengue , Ilaria Cesini , Jenny Faucheu , Eric Chatelet , Hassan Zahouani , David Delafosse , and Francesco Massi . 2017 . Tactile perception and friction-induced vibrations: Discrimination of similarly patterned wood-like surfaces . IEEE Transactions on Haptics 10 , 3 (July 2017), 409--417. DOI:https:\/\/doi.org\/10.1109\/TOH.2016.2643662 10.1109\/TOH.2016.2643662 Jessica D. Ndengue, Ilaria Cesini, Jenny Faucheu, Eric Chatelet, Hassan Zahouani, David Delafosse, and Francesco Massi. 2017. Tactile perception and friction-induced vibrations: Discrimination of similarly patterned wood-like surfaces. IEEE Transactions on Haptics 10, 3 (July 2017), 409--417. DOI:https:\/\/doi.org\/10.1109\/TOH.2016.2643662","journal-title":"IEEE Transactions on Haptics"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/58.2.341"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the International Workshop on Haptic and Audio Interaction Design (HAID\u201919)","author":"Pra Yuri De","year":"2019","unstructured":"Yuri De Pra , Federico Fontana , Hanna J\u00e4rvel\u00e4inen , Stefano Papetti , Michele Simonato , and Riccardo Furlanetto . 2019 . Auditory and tactile recognition of resonant material vibrations in a passive task of bouncing perception . In Proceedings of the International Workshop on Haptic and Audio Interaction Design (HAID\u201919) . Yuri De Pra, Federico Fontana, Hanna J\u00e4rvel\u00e4inen, Stefano Papetti, Michele Simonato, and Riccardo Furlanetto. 2019. Auditory and tactile recognition of resonant material vibrations in a passive task of bouncing perception. In Proceedings of the International Workshop on Haptic and Audio Interaction Design (HAID\u201919)."},{"key":"e_1_2_1_10_1","volume-title":"ACM SIGGRAPH 2005 Courses (SIGGRAPH\u201905)","author":"DiFilippo Derek","year":"1985","unstructured":"Derek DiFilippo and Dinesh K. Pai . 2005. The AHI: An audio and haptic interface for contact interactions . In ACM SIGGRAPH 2005 Courses (SIGGRAPH\u201905) . ACM, New York, NY, Article 164. DOI:https:\/\/doi.org\/10.1145\/1 1985 55.1198616 10.1145\/1198555.1198616 Derek DiFilippo and Dinesh K. Pai. 2005. The AHI: An audio and haptic interface for contact interactions. In ACM SIGGRAPH 2005 Courses (SIGGRAPH\u201905). ACM, New York, NY, Article 164. DOI:https:\/\/doi.org\/10.1145\/1198555.1198616"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2002.1000274"},{"key":"e_1_2_1_12_1","volume-title":"Banks","author":"Ernst Marc O.","year":"2002","unstructured":"Marc O. Ernst and Martin S . Banks . 2002 . Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 6870 (2002), 429--433. Marc O. Ernst and Martin S. Banks. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 6870 (2002), 429--433."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 13th Sound and Music Computing Conference (SMC\u201916)","author":"Fontana Federico","year":"2016","unstructured":"Federico Fontana , Ivan Camponogara , Paola Cesari , Matteo Vallicella , and Marco Ruzzenente . 2016 . An exploration on whole-body and foot-based vibrotactile sensitivity to melodic consonance . In Proceedings of the 13th Sound and Music Computing Conference (SMC\u201916) . 143--150. Available at http:\/\/smcnetwork.org\/node\/ 2009. Federico Fontana, Ivan Camponogara, Paola Cesari, Matteo Vallicella, and Marco Ruzzenente. 2016. An exploration on whole-body and foot-based vibrotactile sensitivity to melodic consonance. In Proceedings of the 13th Sound and Music Computing Conference (SMC\u201916). 143--150. Available at http:\/\/smcnetwork.org\/node\/2009."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.5009659"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2009.03.029"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1937.10503522"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2014.11.020"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169184"},{"key":"e_1_2_1_19_1","volume-title":"Giordano and Federico Avanzini","author":"Bruno","year":"2014","unstructured":"Bruno L. Giordano and Federico Avanzini . 2014 . Perception and Synthesis of Sound-Generating Materials. Springer London , London, UK, 49--84. DOI:https:\/\/doi.org\/10.1007\/978-1-4471-6533-0_4 10.1007\/978-1-4471-6533-0_4 Bruno L. Giordano and Federico Avanzini. 2014. Perception and Synthesis of Sound-Generating Materials. Springer London, London, UK, 49--84. DOI:https:\/\/doi.org\/10.1007\/978-1-4471-6533-0_4"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.2149839"},{"key":"e_1_2_1_21_1","volume-title":"Audiotactile interactions in roughness perception. Experimental Brain Research 146 (Oct","author":"Guest Steve","year":"2002","unstructured":"Steve Guest , Caroline Catmur , Donna Lloyd , and Charles Spence . 2002. Audiotactile interactions in roughness perception. Experimental Brain Research 146 (Oct . 2002 ), 161--71. DOI:https:\/\/doi.org\/10.1007\/s00221-002-1164-z 10.1007\/s00221-002-1164-z Steve Guest, Caroline Catmur, Donna Lloyd, and Charles Spence. 2002. Audiotactile interactions in roughness perception. Experimental Brain Research 146 (Oct. 2002), 161--71. DOI:https:\/\/doi.org\/10.1007\/s00221-002-1164-z"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2046396.2046429"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31401-8_16"},{"key":"e_1_2_1_24_1","volume-title":"McKean","author":"Hettmansperger Thomas P.","year":"2010","unstructured":"Thomas P. Hettmansperger and Joseph W . McKean . 2010 . Robust Nonparametric Statistical Methods. CRC Press , Boca Raton, FL. Thomas P. Hettmansperger and Joseph W. McKean. 2010. Robust Nonparametric Statistical Methods. CRC Press, Boca Raton, FL."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/GCCE.2017.8229246"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/SMC.2015.272"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2017.7989853"},{"volume-title":"Devices, Control, and Applications","author":"Higashi Kosuke","key":"e_1_2_1_28_1","unstructured":"Kosuke Higashi , Shogo Okamoto , and Yoji Yamada . 2016. What is the hardness perceived by tapping? In Haptics: Perception , Devices, Control, and Applications , F. Bello, H. Kajimoto, and Y. Visell (Eds.). Springer International , Cham, Switzerland , 3--12. Kosuke Higashi, Shogo Okamoto, and Yoji Yamada. 2016. What is the hardness perceived by tapping? In Haptics: Perception, Devices, Control, and Applications, F. Bello, H. Kajimoto, and Y. Visell (Eds.). Springer International, Cham, Switzerland, 3--12."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1265957.1265962"},{"key":"e_1_2_1_30_1","first-page":"1","article-title":"Feeling music: Integration of auditory and tactile inputs in musical meter perception","volume":"7","author":"Huang Juan","year":"2012","unstructured":"Juan Huang , Darik Gamble , Kristine Sarnlertsophon , Xiaoqin Wang , and Steven Hsiao . 2012 . Feeling music: Integration of auditory and tactile inputs in musical meter perception . PLoS ONE 7 , 10 (2012), 1 -- 11 . DOI:https:\/\/doi.org\/10.1371\/journal.pone.0048496 10.1371\/journal.pone.0048496 Juan Huang, Darik Gamble, Kristine Sarnlertsophon, Xiaoqin Wang, and Steven Hsiao. 2012. Feeling music: Integration of auditory and tactile inputs in musical meter perception. PLoS ONE 7, 10 (2012), 1--11. DOI:https:\/\/doi.org\/10.1371\/journal.pone.0048496","journal-title":"PLoS ONE"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0960-9822(98)70120-4"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2611387"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 133--139","author":"Kim Young-Seok","year":"2006","unstructured":"Young-Seok Kim and Thenkurussi Kesavadas . 2006 . Material property recognition by active tapping for fingertip digitizing . In Proceedings of the 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 133--139 . DOI:https:\/\/doi.org\/10.1109\/HAPTIC.2006.1627071 10.1109\/HAPTIC.2006.1627071 Young-Seok Kim and Thenkurussi Kesavadas. 2006. Material property recognition by active tapping for fingertip digitizing. In Proceedings of the 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 133--139. DOI:https:\/\/doi.org\/10.1109\/HAPTIC.2006.1627071"},{"key":"e_1_2_1_34_1","volume-title":"Krotkov","author":"Klatzky Roberta L.","year":"2000","unstructured":"Roberta L. Klatzky , Dinesh K. Pai , and Eric P . Krotkov . 2000 . Perception of material from contact sounds. Presence : Teleoperators 8 Virtual Environments 9, 4 (2000), 399--410. Roberta L. Klatzky, Dinesh K. Pai, and Eric P. Krotkov. 2000. Perception of material from contact sounds. Presence: Teleoperators 8 Virtual Environments 9, 4 (2000), 399--410."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1452392.1452453"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.26.1.279"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.1291270"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.420151"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.3263606"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.2001.0888"},{"volume-title":"Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces. ACM","author":"Mart\u00edn Rodrigo","key":"e_1_2_1_41_1","unstructured":"Rodrigo Mart\u00edn , Michael Weinmann , and Matthias B. Hullin . 2018. A study of material sonification in touchscreen devices . In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces. ACM , New York, NY, 305--310. Rodrigo Mart\u00edn, Michael Weinmann, and Matthias B. Hullin. 2018. A study of material sonification in touchscreen devices. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces. ACM, New York, NY, 305--310."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2013.6548487"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2037373.2037376"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-009-1759-8"},{"volume-title":"Vibrotactile recognition by Western and Indian population groups of traditional musical scales played with the harmonium","author":"Romagnoli Marco","key":"e_1_2_1_45_1","unstructured":"Marco Romagnoli , Federico Fontana , and Ratna Sarkar . 2011. Vibrotactile recognition by Western and Indian population groups of traditional musical scales played with the harmonium . In Haptic and Audio Interaction Design, E. W. Cooper, V. V. Kryssanov, H. Ogawa, and S. Brewster (Eds.). Springer , Berlin, Germany , 91--100. Marco Romagnoli, Federico Fontana, and Ratna Sarkar. 2011. Vibrotactile recognition by Western and Indian population groups of traditional musical scales played with the harmonium. In Haptic and Audio Interaction Design, E. W. Cooper, V. V. Kryssanov, H. Ogawa, and S. Brewster (Eds.). Springer, Berlin, Germany, 91--100."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0029046"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1639909"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0091688"},{"key":"e_1_2_1_49_1","volume-title":"Parker","author":"Smith Sean E.","year":"2004","unstructured":"Sean E. Smith , Karen L. Stephan , and Simon P . Parker . 2004 . Auditory Warnings in the Military Cockpit : A Preliminary Evaluation of Potential Sound Types. Technical Report. Defense Technical Information Center , Fort Belvoir, VA. Sean E. Smith, Karen L. Stephan, and Simon P. Parker. 2004. Auditory Warnings in the Military Cockpit: A Preliminary Evaluation of Potential Sound Types. Technical Report. Defense Technical Information Center, Fort Belvoir, VA."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbr.2008.09.018"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.3758\/CABN.4.2.208"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.387544"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0030400"},{"key":"e_1_2_1_54_1","volume-title":"Brown","author":"Tucker Simon","year":"2002","unstructured":"Simon Tucker and Guy J . Brown . 2002 . Investigating the Perception of the Size, Shape and Material of Damped and Free Vibrating Plates. Technical Report. University of Sheffield . http:\/\/www.dcs.shef.ac.uk\/intranet\/research\/public\/resmes\/CS0210.pdf. Simon Tucker and Guy J. Brown. 2002. Investigating the Perception of the Size, Shape and Material of Damped and Free Vibrating Plates. Technical Report. University of Sheffield. http:\/\/www.dcs.shef.ac.uk\/intranet\/research\/public\/resmes\/CS0210.pdf."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.2307\/40285553"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.428490"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.3204305"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2009.02.013"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-459x.2004.080403.x"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312778"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3393898","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3393898","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:39:03Z","timestamp":1750199943000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3393898"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,30]]},"references-count":60,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,4,30]]}},"alternative-id":["10.1145\/3393898"],"URL":"https:\/\/doi.org\/10.1145\/3393898","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"type":"print","value":"1544-3558"},{"type":"electronic","value":"1544-3965"}],"subject":[],"published":{"date-parts":[[2020,4,30]]},"assertion":[{"value":"2019-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-05-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}