{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T12:28:24Z","timestamp":1768480104179,"version":"3.49.0"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,12,21]],"date-time":"2022-12-21T00:00:00Z","timestamp":1671580800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,12,21]]},"abstract":"<jats:p>Advanced AR\/VR headsets often have a dedicated depth sensor or multiple cameras, high processing power, and a high-capacity battery to track hands or controllers. However, these approaches are not compatible with the small form factor and limited thermal capacity of lightweight AR devices. In this paper, we present RetroSphere, a self-contained 6 degree of freedom (6DoF) controller tracker that can be integrated with almost any device. RetroSphere tracks a passive controller with just 3 retroreflective spheres using a stereo pair of mass-produced infrared blob trackers, each with its own infrared LED emitters. As the sphere is completely passive, no electronics or recharging is required. Each object tracking camera provides a tiny Arduino-compatible ESP32 microcontroller with the 2D position of the spheres. A lightweight stereo depth estimation algorithm that runs on the ESP32 performs 6DoF tracking of the passive controller. Also, RetroSphere provides an auto-calibration procedure to calibrate the stereo IR tracker setup. Our work builds upon Johnny Lee's Wii remote hacks and aims to enable a community of researchers, designers, and makers to use 3D input in their projects with affordable off-the-shelf components. RetroSphere achieves a tracking accuracy of about 96.5% with errors as low as ~3.5 cm over a 100 cm tracking range, validated with ground truth 3D data obtained using a LIDAR camera while consuming around 400 mW. We provide implementation details, evaluate the accuracy of our system, and demonstrate example applications, such as mobile AR drawing, 3D measurement, etc. with our Retrosphere-enabled AR glass prototype.<\/jats:p>","DOI":"10.1145\/3569479","type":"journal-article","created":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T15:34:01Z","timestamp":1673451241000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["RetroSphere"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3918-157X","authenticated-orcid":false,"given":"Ananta Narayanan","family":"Balaji","sequence":"first","affiliation":[{"name":"National University of Singapore, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0460-5547","authenticated-orcid":false,"given":"Clayton","family":"Kimber","sequence":"additional","affiliation":[{"name":"Google, Ireland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3187-6190","authenticated-orcid":false,"given":"David","family":"Li","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0776-6335","authenticated-orcid":false,"given":"Shengzhi","family":"Wu","sequence":"additional","affiliation":[{"name":"Google, Mountain View, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2471-9776","authenticated-orcid":false,"given":"Ruofei","family":"Du","sequence":"additional","affiliation":[{"name":"Google, San Francisco, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0508-3509","authenticated-orcid":false,"given":"David","family":"Kim","sequence":"additional","affiliation":[{"name":"Google, Zurich, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2023,1,11]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"noauthorarplannodate[n. d.].ARPlan3D: TapeMeasure Ruler FloorPlanCreator -- AppsonGooglePlay."},{"key":"e_1_2_2_2_1","unstructured":"2019. Re: Touch Controllers Battery Life Test - I Don't Believe It. https:\/\/forums.oculusvr.com\/t5\/General\/Touch-Controllers-Battery-Life-Test-I-don-t-believe-it\/m-p\/745201#M346926"},{"key":"e_1_2_2_3_1","unstructured":"2020. Plastic Infrared Emitting Diode OP294. https:\/\/www.ttelectronics.com\/products\/categories\/optoelectronics\/optoelectronics\/op294\/"},{"key":"e_1_2_2_4_1","unstructured":"2021. About ARKit XR Plugin | ARKit XR Plugin | 4.1.5. https:\/\/docs.unity3d.com\/Packages\/com.unity.xr.arkit@4.1\/manual\/"},{"key":"e_1_2_2_5_1","unstructured":"2021. Amazon AR View. https:\/\/www.amazon.com\/adlp\/arview"},{"key":"e_1_2_2_6_1","unstructured":"2021. ARCore API Reference. https:\/\/developers.google.com\/ar\/reference"},{"key":"e_1_2_2_7_1","unstructured":"2021. Augmented Reality - Apple Developer. https:\/\/developer.apple.com\/augmented-reality\/"},{"key":"e_1_2_2_8_1","unstructured":"2021. Controller | VIVE\u2122. https:\/\/www.vive.com\/eu\/accessory\/controller\/"},{"key":"e_1_2_2_9_1","unstructured":"2021. Depth Camera D435. https:\/\/www.intelrealsense.com\/depth-camera-d435\/"},{"key":"e_1_2_2_10_1","unstructured":"2021. ESP32 Wi-Fi & Bluetooth MCU I Espressif Systems. https:\/\/www.espressif.com\/en\/products\/socs\/esp32"},{"key":"e_1_2_2_11_1","unstructured":"2021. Focals by North. https:\/\/www.bynorth.com\/"},{"key":"e_1_2_2_12_1","unstructured":"2021. How Long Is the Average Human Arm? https:\/\/www.reference.com\/science\/long-average-human-arm-62c7536c5e56f385"},{"key":"e_1_2_2_13_1","unstructured":"2021. MAD Gaze - AR Smart Glasses. https:\/\/www.madgaze.com\/"},{"key":"e_1_2_2_14_1","unstructured":"2021. Microsoft HoloLens | Mixed Reality Technology for Business. https:\/\/www.microsoft.com\/en-us\/hololens"},{"key":"e_1_2_2_15_1","unstructured":"2021. Nreal - Building Mixed Reality for Everyone. https:\/\/www.nreal.ai\/"},{"key":"e_1_2_2_16_1","unstructured":"2021. Oculus Quest 2. https:\/\/en.wikipedia.org\/w\/index.php?title=Oculus_Quest_2&oldid=1014363476 Page Version ID: 1014363476."},{"key":"e_1_2_2_17_1","unstructured":"2021. Oculus Quest Accessories & Parts | Oculus. https:\/\/www.oculus.com\/quest\/accessories\/"},{"key":"e_1_2_2_18_1","unstructured":"2021. PixArt Imaging Inc. - PRODUCTS - PAJ7025R3. https:\/\/www.pixart.com\/products-detail\/46\/PAJ7025R3"},{"key":"e_1_2_2_19_1","unstructured":"2021. Pokemon GO. https:\/\/pokemongolive.com\/post\/main\/"},{"key":"e_1_2_2_20_1","unstructured":"2021. Polhemus Electromagnetic Tracking Systems. https:\/\/polhemus.com\/applications\/electromagnetics\/"},{"key":"e_1_2_2_21_1","unstructured":"2021. Polhemus G4. https:\/\/polhemus.com\/motion-tracking\/all-trackers\/g4"},{"key":"e_1_2_2_22_1","unstructured":"2021. Spark AR Studio - Create Augmented Reality Experiences | Spark AR Studio. https:\/\/sparkar.facebook.com\/ar-studio\/"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11554-014-0453-7"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01225-0_11"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICVR.2008.4625155"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2087756.2087837"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1093\/gerona\/56.9.M584"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501951"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300915"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3329714.3338126"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519911"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415881"},{"key":"e_1_2_2_33_1","unstructured":"Youchen Du Shenglan Liu Lin Feng Menghui Chen and Jie Wu. 2017. Hand Gesture Recognition With Leap Motion. arXiv:1711.04293 [cs.CV]"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/122718.122747"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511811685"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR50242.2020.00082"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359996.3364262"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.3390\/sym11121488"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","unstructured":"K. Khoshelham. 2. Accuracy Analysis of Kinect Depth Data. ISPRS - International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences 3812 (2) 133--138. https:\/\/doi.org\/10.5194\/isprsarchives-XXXVIII-5-W12-133-2011","DOI":"10.5194\/isprsarchives-XXXVIII-5-W12-133-2011"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557336"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2008.53"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICINIS.2015.35"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20082163"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971763.2971787"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","unstructured":"Audiovisuelle Medien. 2006. Implementation of a Low Cost Marker Based Infrared Optical Tracking System. (2006). https:\/\/doi.org\/10.1109\/VSMM.2001.969693","DOI":"10.1109\/VSMM.2001.969693"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.2253425"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.10.032"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2006.260904"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","unstructured":"Alex Olwal Kevin Balke Dmitrii Votintcev Thad Starner Paula Conn Bonnie Chinh and Benoit Corda. 2020. Wearable Subtitles: Augmenting Spoken Communication With Lightweight Eyewear for All-Day Captioning. In UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM. https:\/\/doi.org\/10.1145\/3379337.3415817","DOI":"10.1145\/3379337.3415817"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3463518"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369831"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/RAAD.2010.5524560"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161162"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1639601.1639620"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.2196\/12291"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993369.2993372"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3489849.3489856"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130853"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300849"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/GLOBECOM38437.2019.9013647"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4408994"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384657.3384790"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702371"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126664"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3532106.3533464"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445054"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569479","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3569479","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T20:55:35Z","timestamp":1752612935000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569479"}},"subtitle":["Self-Contained Passive 3D Controller Tracking for Augmented Reality"],"short-title":[],"issued":{"date-parts":[[2022,12,21]]},"references-count":66,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,21]]}},"alternative-id":["10.1145\/3569479"],"URL":"https:\/\/doi.org\/10.1145\/3569479","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,21]]},"assertion":[{"value":"2023-01-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}