{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T16:56:57Z","timestamp":1776099417048,"version":"3.50.1"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T00:00:00Z","timestamp":1646352000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Adobe Research"},{"DOI":"10.13039\/100009157","name":"National Institute on Disability, Independent Living, and Rehabilitation Research","doi-asserted-by":"crossref","award":["90REGE0008"],"award-info":[{"award-number":["90REGE0008"]}],"id":[{"id":"10.13039\/100009157","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Access. Comput."],"published-print":{"date-parts":[[2022,3,31]]},"abstract":"<jats:p>Most PDF documents are inaccessible for people with disabilities, creating barriers in education, science, commerce, e-government, and recreation. Documents in PDF format are considered harder to make accessible than documents in other formats, primarily due to the insufficient tools available to assist content creators. In this article, we present the research and development of Ally, a new tool to assist content creators in remediating their PDF files to improve accessibility. Ally utilizes best practices from other areas of HCI research to create a more efficient and effective interaction for remediating regions, headers, reading order, and tables in a PDF document for improved accessibility. Twenty participants attempted to complete the same PDF accessibility remediation tasks using both Ally and a standard industry tool, Adobe Acrobat Pro. Ally was almost twice as fast and three times as accurate compared to Acrobat Pro, with participants reporting a strong preference for and a much higher level of satisfaction with Ally. The approaches taken in Ally improve the ability to create accessible PDFs efficiently and accurately for the four important aspects studied, but future work will need to incorporate additional functionality, related to remediating alt text, forms, and other aspects of PDF accessibility.<\/jats:p>","DOI":"10.1145\/3507661","type":"journal-article","created":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T10:04:27Z","timestamp":1646388267000},"page":"1-52","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Development and Evaluation of a Tool for Assisting Content Creators in Making PDF Files More Accessible"],"prefix":"10.1145","volume":"15","author":[{"given":"Debashish","family":"Pradhan","sequence":"first","affiliation":[{"name":"College of Information Studies, Trace Research and Development Center, and Human-Computer Interaction Lab (HCIL), University of Maryland, South Wing College Park, MD"}]},{"given":"Tripti","family":"Rajput","sequence":"additional","affiliation":[{"name":"College of Information Studies, Trace Research and Development Center, and Human-Computer Interaction Lab (HCIL), University of Maryland, South Wing College Park, MD"}]},{"given":"Aravind Jembu","family":"Rajkumar","sequence":"additional","affiliation":[{"name":"College of Information Studies, Trace Research and Development Center, and Human-Computer Interaction Lab (HCIL), University of Maryland, South Wing College Park, MD"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6317-1582","authenticated-orcid":false,"given":"Jonathan","family":"Lazar","sequence":"additional","affiliation":[{"name":"College of Information Studies, Trace Research and Development Center, and Human-Computer Interaction Lab (HCIL), University of Maryland, South Wing College Park, MD"}]},{"given":"Rajiv","family":"Jain","sequence":"additional","affiliation":[{"name":"Adobe Research, College Park, MD"}]},{"given":"Vlad I.","family":"Morariu","sequence":"additional","affiliation":[{"name":"Adobe Research, College Park, MD"}]},{"given":"Varun","family":"Manjunatha","sequence":"additional","affiliation":[{"name":"Adobe Research, College Park, MD"}]}],"member":"320","published-online":{"date-parts":[[2022,3,4]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.lisr.2015.02.002"},{"key":"e_1_3_3_3_2","unstructured":"Document management applications\u2014Electronic document file format enhancement for accessibility\u2014Part 1: Use of ISO 32000-1 (PDF\/UA-1) . 2014. https:\/\/www.iso.org\/standard\/64599.html."},{"key":"e_1_3_3_4_2","unstructured":"PDF Association. Matterhorn Protocol 1.1. Retrieved from https:\/\/www.pdfa.org\/wp-content\/uploads\/2021\/04\/Matterhorn-Protocol-1-1.pdf."},{"key":"e_1_3_3_5_2","volume-title":"PDF\/UA in a Nutshell: Accessible documents with PDF","author":"Olaf Dr\u00fcmmer B. C.","year":"2013","unstructured":"B. C. Olaf Dr\u00fcmmer. 2013. PDF\/UA in a Nutshell: Accessible documents with PDF. PDF Association."},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2892588"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-08596-8_29"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2020.512"},{"key":"e_1_3_3_9_2","doi-asserted-by":"crossref","unstructured":"A. Jembu Rajkumar J. B. Jordan and J. Lazar. 2020. Improving PDF accessibility tools for content developers: looking towards the future. In Inclusive Design: Looking towards the Future P. Langdon J. Lazar A. Heylighen and H. Dong (Eds.). Springer-Verlag 173\u2013181.","DOI":"10.1007\/978-3-030-43865-4_18"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2993420"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/2831424"},{"key":"e_1_3_3_12_2","unstructured":"Brian Wentz Jonathan Lazar Paul T. Jaeger and Ursula Gorham. 2021. A socio-legal framework for improving the accessibility of research articles for people with disabilities. Journal of Business. & Technology Law 16 (2021) 223."},{"key":"e_1_3_3_13_2","unstructured":"Participate in the Great PDF Purge. 15 August 2019. Retrieved from https:\/\/oit.ncsu.edu\/2019\/08\/15\/participate-in-the-great-pdf-purge\/."},{"key":"e_1_3_3_14_2","volume-title":"Designing the User Interface: Strategies for Effective Human-Computer Interaction","author":"Shneiderman B.","unstructured":"B. Shneiderman, C. Plaisant, M. Cohen, S. Jacobs, N. Elmqvist, and N. Diakopoulos. Designing the User Interface: Strategies for Effective Human-Computer Interaction (6th ed.). Pearson.","edition":"6"},{"key":"e_1_3_3_15_2","unstructured":"J. Lazar D. Goldstein and A. Taylor. 2015. Ensuring Digital Accessibility Through Process and Policy. Elsevier\/Morgan Kaufmann Publishers."},{"key":"e_1_3_3_16_2","doi-asserted-by":"crossref","unstructured":"S. Harperan and A. Q. Chen. 2012. Web accessibility guidelines. World Wide Web 15 1 (2012) 61\u201388.","DOI":"10.1007\/s11280-011-0130-8"},{"key":"e_1_3_3_17_2","doi-asserted-by":"crossref","unstructured":"H. Takagi C. Asakawa K. Fukuda and J. Maeda. 2003. Accessibility designer: visualizing usability for the blind. ACM SIGACCESS Accessibility and Computing . 77\u201378 (2003) 177\u2013184.","DOI":"10.1145\/1029014.1028662"},{"key":"e_1_3_3_18_2","doi-asserted-by":"crossref","unstructured":"P. Brophy and J. Craven. 2007. Web accessibility. Library Trends 55 4 (2007) 950\u2013972.","DOI":"10.1353\/lib.2007.0029"},{"key":"e_1_3_3_19_2","volume-title":"Improving the Accessibility of Scientific Documents: Current State, User Needs, and a System Solution to Enhance Scientific PDF Accessibility for Blind and Low Vision Users","author":"Wang L. L.","year":"2021","unstructured":"L. L. Wang, I. Cachola, J. Bragg, E. Y.-Y. Cheng, C. Haupt, M. Latzke, B. Kuehl, M. van Zuylen, L. Wagner, and D. S. Weld. 2021. Improving the Accessibility of Scientific Documents: Current State, User Needs, and a System Solution to Enhance Scientific PDF Accessibility for Blind and Low Vision Users. arXiv:2105.00076."},{"key":"e_1_3_3_20_2","first-page":"241","article-title":"Disabilities and e-learning problems and solutions: An exploratory study","volume":"12","author":"Fichten C. S.","year":"2009","unstructured":"C. S. Fichten, V. Ferraro, J. V. Asuncion, C. Chwojka, M. Barile, M. N. Nguyen, R. Klomp, and J. Wolforth. 2009. Disabilities and e-learning problems and solutions: An exploratory study. J. Educ. Technol. Soc. 12, 4 (2009), 241\u2013256.","journal-title":"J. Educ. Technol. Soc."},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2828432"},{"key":"e_1_3_3_22_2","doi-asserted-by":"crossref","unstructured":"S. Zulfiqar S. Arooj U. Hayat S. Shahid and A. Karim. 2020. Automated generation of accessible PDF. In the 22nd International ACM SIGACCESS Conference on Computers and Accessibility . 1\u20133.","DOI":"10.1145\/3373625.3418045"},{"key":"e_1_3_3_23_2","doi-asserted-by":"crossref","unstructured":"S. Arooj S. Zulfiqar M. Qasim Hunain S. Shahid and A. Karim. 2020. Web-ALAP: A Web-based LaTeX Editor for Blind Individuals. In the 22nd International ACM SIGACCESS Conference on Computers and Accessibility. 1\u20136.","DOI":"10.1145\/3373625.3417009"},{"key":"e_1_3_3_24_2","doi-asserted-by":"crossref","unstructured":"D. Ahmetovic T. Armano C. Bernareggi M. Berra A. Capietto S. Coriasco S. Murru A. Ruighi and E. Taranto. 2018. Axessibility: A latex package for mathematical formulae accessibility in pdf documents. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility . 352\u2013354.","DOI":"10.1145\/3234695.3241029"},{"key":"e_1_3_3_25_2","first-page":"1","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems","year":"2019","unstructured":"A. Manzoor, S. Arooj, S. Zulfiqar, M. Parvez, S. Shahid, and A. Karim. 2019. ALAP: Accessible LaTeX based mathematical document authoring and presentation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201312."},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.462"},{"key":"e_1_3_3_27_2","doi-asserted-by":"crossref","unstructured":"X. Zhong J. Tang and A. J. Yepes. 2019. Publaynet: largest dataset ever for document layout analysis. In 2019 International Conference on Document Analysis and Recognition (ICDAR) . IEEE 1015\u20131022.","DOI":"10.1109\/ICDAR.2019.00166"},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","unstructured":"U. Uckun A. S. Aydin V. Ashok and I. V. Ramakrishnan. 2020. Breaking the Accessibility Barrier in Non-Visual Interaction with PDF Forms. In Proceedings of the ACM on Human-Computer Interaction Vol. 4. 1\u201316.","DOI":"10.1145\/3397868"},{"key":"e_1_3_3_29_2","volume-title":"Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC'18)","author":"Shindo H.","year":"2018","unstructured":"H. Shindo, Y. Munesada, and Y. Matsumoto. 2018. PDFAnno: A web-based linguistic annotation tool for pdf documents. In Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC'18)."},{"key":"e_1_3_3_30_2","volume-title":"PAWLS: PDF Annotation with Labels and Structure","author":"Neumann M.","year":"2021","unstructured":"M. Neumann, Z. Shen, and S. Skjonsberg. 2021. PAWLS: PDF Annotation with Labels and Structure. arXiv:2101.10281."},{"key":"e_1_3_3_31_2","doi-asserted-by":"crossref","unstructured":"A. Dutta and A. Zisserman. 2019. The VIA annotation software for images audio and video. In Proceedings of the 27th ACM International Conference on Multimedia . 2276\u20132279.","DOI":"10.1145\/3343031.3350535"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300523"},{"key":"e_1_3_3_33_2","article-title":"Efficient table annotation for digital articles","volume":"21","author":"Frey M.","year":"2015","unstructured":"M. Frey and R. Kern. 2015. Efficient table annotation for digital articles. D-Lib Mag. 21 (2015).","journal-title":"D-Lib Mag."},{"key":"e_1_3_3_34_2","doi-asserted-by":"crossref","unstructured":"X. Zhong J. Tang and A. Jimeno-Yepes. 2019. PubLayNet: Largest dataset ever for document layout analysis. CoRR abs\/1908.07836.","DOI":"10.1109\/ICDAR.2019.00166"},{"key":"e_1_3_3_35_2","doi-asserted-by":"crossref","unstructured":"A. Dutta and A. Zisserman. 2019. The VIA annotation software for images audio and video. In Proceedings of the 27th ACM International Conference on Multimedia . 2276\u20132279.","DOI":"10.1145\/3343031.3350535"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.15.3.419"},{"key":"e_1_3_3_37_2","doi-asserted-by":"crossref","unstructured":"E. Brenner and W. J. van Damme. 1999. Perceived distance shape and size. Vision Research 39 5 (1999) 975\u2013986.","DOI":"10.1016\/S0042-6989(98)00162-X"},{"key":"e_1_3_3_38_2","doi-asserted-by":"crossref","unstructured":"J. Tsurukawa M. Al-Sada and T. Nakajima. 2015. Filtering visual information for reducing visual cognitive load. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers . 33\u201336.","DOI":"10.1145\/2800835.2800852"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447310709336964"},{"key":"e_1_3_3_40_2","unstructured":"Tiny. 2019. TinyMCE. Retrieved from https:\/\/www.tiny.cloud\/."},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2745555.2746665"},{"key":"e_1_3_3_42_2","doi-asserted-by":"crossref","unstructured":"X. Yang E. Yumer P. Asente M. Kraley D. Kifer and C. Lee Giles. 2017. Learning to extract semantic structure from documents using multimodal fully convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 5315\u20135324.","DOI":"10.1109\/CVPR.2017.462"}],"container-title":["ACM Transactions on Accessible Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3507661","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3507661","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:15Z","timestamp":1750183815000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3507661"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,4]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,3,31]]}},"alternative-id":["10.1145\/3507661"],"URL":"https:\/\/doi.org\/10.1145\/3507661","relation":{},"ISSN":["1936-7228","1936-7236"],"issn-type":[{"value":"1936-7228","type":"print"},{"value":"1936-7236","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,4]]},"assertion":[{"value":"2021-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}