Beyond the Bar: Generative AI as a Transformative Component in Legal Document Review.

Jeremy Pickens Elevate, USA https://orcid.org/0000-0002-4447-035X Eugene Yang 0001 Roshanak Omrani Evan Curtin Tara Emory Lenora Gray Jeremy Pickens Nathan Reff Cristin Traylor Sean Underwood David D. Lewis Aron J. Ahmadia Beyond the Bar: Generative AI as a Transformative Component in Legal Document Review. 4779-4788 2024 IEEE Big Data https://doi.org/10.1109/BigData62323.2024.10826089 conf/bigdataconf/2024 db/conf/bigdataconf/bigdataconf2024.html#YangOCEGPRTULA24 Lenora Gray David D. Lewis Jeremy Pickens Eugene Yang 0001 High Recall Retrieval Via Technology-Assisted Review. 2024 SIGIR https://doi.org/10.1145/3626772.3661376 conf/sigir/2024 db/conf/sigir/sigir2024.html#GrayLPY24 2987-2988 Jack G. Conrad Daniel W. Linna Jr. Jason R. Baron Hans Henseler Paheli Bhattacharya Aileen Nielsen Jyothi K. Vinjumur Jeremy Pickens Amanda Jones Proceedings of the Third International Workshop on Artificial Intelligence and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA 2023) co-located with the 19th International Conference on Artificial Intelligence and Law (ICAIL 2023), Braga, Portugal, June 19, 2023. LegalAIIA@ICAIL CEUR-WS.org 2023 CEUR Workshop Proceedings 3423 https://ceur-ws.org/Vol-3423 https://nbn-resolving.org/urn:nbn:de:0074-3423-7 db/conf/icail/legalaiia2023.html Eugene Yang 0001 Jeremy Pickens David D. Lewis ECIR 2022 Tutorial: Technology-Assisted Review for High Recall Retrieval. 597-600 2022 ECIR (2) https://doi.org/10.1007/978-3-030-99739-7_75 conf/ecir/2022-2 db/conf/ecir/ecir2022-2.html#YangPL22 Jack G. Conrad Jeremy Pickens Second International Workshop on AI and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA 2021). 48 2021 ASAIL/LegalAIIA@ICAIL https://ceur-ws.org/Vol-2888/paper5.pdf conf/icail/2021asail db/conf/icail/asail2021.html#ConradP21 Jeremy Pickens Thomas C. Gricks III On the Effectiveness of Portable Models versus Human Expertise under Continuous Active Learning. 69-76 2021 ASAIL/LegalAIIA@ICAIL https://ceur-ws.org/Vol-2888/paper10.pdf conf/icail/2021asail db/conf/icail/asail2021.html#PickensG21 Kevin D. Ashley Katie Atkinson Luther Karl Branting Enrico Francesconi Matthias Grabmair Vern R. Walker Bernhard Waltl Adam Zachary Wyner Jack G. Conrad Jeremy Pickens Jason R. Baron Hans Henseler Daniel W. Linna Jr. Jyothi K. Vinjumur Joint Proceedings of the Workshops on Automated Semantic Analysis of Information in Legal Text (ASAIL 2021) & AI and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA 2021) held online in conjunction with 18th International Conference on Artificial Intelligence and Law (ICAIL 2021), São Paolo, Brazil (held online), June 21 & 25, 2021. ASAIL/LegalAIIA@ICAIL CEUR-WS.org CEUR Workshop Proceedings 2888 2021 https://ceur-ws.org/Vol-2888 https://nbn-resolving.org/urn:nbn:de:0074-2888-5 db/conf/icail/asail2021.html

Laura Dietz Bhaskar Mitra 0001 Jeremy Pickens Hana Anber Sandeep Avula Asia Biega Adrian Boteanu Shubham Chatterjee Jeff Dalton 0001 Shiri Dori-Hacohen John Foley Henry Feild Ben Gamari Rosie Jones Pallika Kanani Sumanta Kashyapi Widad Machmouchi Matthew Mitsui Steve Nole Alexandre Tachard Passos Jordan Ramsdell Adam Roegiest David Smith Alessandro Sordoni Report on the First HIPstIR Workshop on the Future of Information Retrieval. 62-75 2019 53 SIGIR Forum 2 https://doi.org/10.1145/3458553.3458560 db/journals/sigir/sigir53.html#DietzMPAABBCDDD19

Jack G. Conrad Jeremy Pickens First International Workshop on AI and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA 2019). 1 2019 LegalAIIA@ICAIL https://ceur-ws.org/Vol-2484/workshop.pdf conf/icail/2019legalaiia db/conf/icail/legalaiia2019.html#ConradP19 Jack G. Conrad Jeremy Pickens Amanda Jones Jason R. Baron Hans Henseler Proceedings of the First Workshop on AI and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA 2019) the 17th International Conference on Artificial Intelligence and Law (ICAIL 2019), Montreal, Canada, June 17, 2019. LegalAIIA@ICAIL CEUR-WS.org CEUR Workshop Proceedings 2484 2019 https://ceur-ws.org/Vol-2484 https://nbn-resolving.org/urn:nbn:de:0074-2484-8 db/conf/icail/legalaiia2019.html

Laura Dietz Bhaskar Mitra 0001 Jeremy Pickens Hana Anber Sandeep Avula Asia Biega Adrian Boteanu Shubham Chatterjee Jeff Dalton 0001 Shiri Dori-Hacohen John Foley Henry Feild Ben Gamari Rosie Jones Pallika Kanani Sumanta Kashyapi Widad Machmouchi Matthew Mitsui Steve Nole Alexandre Tachard Passos Jordan Ramsdell Adam Roegiest David Smith Alessandro Sordoni Report on the First HIPstIR Workshop on the Future of Information Retrieval. 2019 abs/1912.09910 CoRR http://arxiv.org/abs/1912.09910 db/journals/corr/corr1912.html#abs-1912-09910

Jeremy Pickens Thomas C. Gricks Andrew Bye Break up the Family: Protocols for Efficient Recall-Oriented Retrieval Under Legally-Necessitated Dual Constraints. 3302-3309 2018 IEEE BigData https://doi.org/10.1109/BigData.2018.8622323 conf/bigdataconf/2018 db/conf/bigdataconf/bigdataconf2018.html#PickensGB18

Leif Azzopardi Jeremy Pickens Chirag Shah 0001 Laure Soulier Lynda Tamine Report on the Second International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol?2017 @ CHIIR). 122-127 2017 51 SIGIR Forum 3 https://doi.org/10.1145/3190580.3190599 db/journals/sigir/sigir51.html#AzzopardiPSST17

Leif Azzopardi Jeremy Pickens Chirag Shah 0001 Laure Soulier Lynda Tamine Second International Workshop On the Evaluation of Collaborative Information Seeking and Retrieval (Ecol'17). 429-431 2017 CHIIR https://doi.org/10.1145/3020165.3022164 conf/chiir/2017 db/conf/chiir/chiir2017.html#AzzopardiPSST17

Laure Soulier Lynda Tamine Tetsuya Sakai Leif Azzopardi Jeremy Pickens Report on the First International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol'2015). 42-48 2016 50 SIGIR Forum 1 https://doi.org/10.1145/2964797.2964805 db/journals/sigir/sigir50.html#SoulierTSAP16

Jeremy Pickens Tom Gricks Bayu Hardi Mark Noel John Tredennick An Exploration of Total Recall with Multiple Manual Seedings. 2016 TREC http://trec.nist.gov/pubs/trec25/papers/catres-TR.pdf conf/trec/2016 db/conf/trec/trec2016.html#PickensGHNT16 Leif Azzopardi Jeremy Pickens Tetsuya Sakai Laure Soulier Lynda Tamine ECol 2015: First international workshop on the Evaluation on Collaborative Information Seeking and Retrieval. 1943-1944 2015 CIKM https://doi.org/10.1145/2806416.2806881 conf/cikm/2015 db/conf/cikm/cikm2015.html#AzzopardiPSST15 Jeremy Pickens Tom Gricks Bayu Hardi Mark Noel A Constrained Approach to Manual Total Recall. 2015 TREC http://trec.nist.gov/pubs/trec24/papers/catres-TR.pdf conf/trec/2015 db/conf/trec/trec2015.html#PickensGHN15 Leif Azzopardi Jeremy Pickens Tetsuya Sakai Laure Soulier Lynda Tamine Proceedings of the 2015 Workshop on Evaluation on Collaborative Information Retrieval and Seeking, ECol 2015, Melbourne, Australia, October 23, 2015 ECol@CIKM ACM 2015 978-1-4503-3788-5 https://dl.acm.org/citation.cfm?id=2812376 db/conf/cikm/ecol2015.html William Webber Jeremy Pickens Assessor disagreement and text classifier accuracy. 929-932 2013 SIGIR https://doi.org/10.1145/2484028.2484156 conf/sigir/2013 db/conf/sigir/sigir2013.html#WebberP13 Gene Golovchinsky Juan M. Fernández-Luna Juan F. Huete Meredith Ringel Morris Jeremy Pickens Julio C. Rodríguez Cano 3rd international workshop on collaborative information retrieval (CIR2011). 2629-2630 2011 CIKM https://doi.org/10.1145/2063576.2064047 conf/cikm/2011 db/conf/cikm/cikm2011.html#GolovchinskyFHMPC11 Jeremy Pickens Social and collaborative information seeking: panel. 2647-2648 2011 CIKM https://doi.org/10.1145/2063576.2064057 conf/cikm/2011 db/conf/cikm/cikm2011.html#Pickens11 Matthew L. Cooper John Adcock Andreas Girgensohn Jeremy Pickens Lynn Wilcox Multimedia information retrieval at FX Palo Alto Laboratory. 78811B 2011 Multimedia on Mobile Devices / Multimedia Content Access: Algorithms and Systems https://doi.org/10.1117/12.878615 conf/ei-mobmu/2011 db/conf/ei-mobmu/ei-mobmu2011.html#CooperAGPW11 Scott A. Carter Francine Chen 0001 Aditi S. Muralidharan Jeremy Pickens DiG: a task-based approach to product search. 303-306 2011 IUI https://doi.org/10.1145/1943403.1943451 conf/iui/2011 db/conf/iui/iui2011.html#CarterCMP11

Gene Golovchinsky Meredith Ringel Morris Jeremy Pickens Introduction to the special issue. 629-631 2010 46 Inf. Process. Manag. 6 https://doi.org/10.1016/j.ipm.2009.11.001 db/journals/ipm/ipm46.html#GolovchinskyMP10

Chirag Shah 0001 Jeremy Pickens Gene Golovchinsky Role-based results redistribution for collaborative information retrieval. 773-781 2010 46 Inf. Process. Manag. 6 https://doi.org/10.1016/j.ipm.2009.10.002 db/journals/ipm/ipm46.html#ShahPG10

Jeremy Pickens Matthew Cooper 0002 Gene Golovchinsky Reverted indexing for feedback and expansion. 1049-1058 2010 CIKM https://doi.org/10.1145/1871437.1871571 conf/cikm/2010 db/conf/cikm/cikm2010.html#PickensCG10 Gene Golovchinsky Jeremy Pickens Interactive information seeking via selective application of contextual knowledge. 145-154 2010 IIiX https://doi.org/10.1145/1840784.1840806 conf/iiix/2010 db/conf/iiix/iiix2010.html#GolovchinskyP10

Gene Golovchinsky Pernilla Qvarfordt Jeremy Pickens Collaborative Information Seeking. 47-51 2009 42 Computer 3 https://doi.org/10.1109/MC.2009.73 http://doi.ieeecomputersociety.org/10.1109/MC.2009.73 db/journals/computer/computer42.html#GolovchinskyQP09

Jeremy Pickens Gene Golovchinsky Meredith Ringel Morris Proceedings of 1st International Workshop on Collaborative Information Seeking http://arxiv.org/abs/0908.0583 2009 CoRR abs/0908.0583 db/journals/corr/corr0908.html#abs-0908-0583

Gene Golovchinsky Jeremy Pickens Maribeth Back A Taxonomy of Collaboration in Online Information Seeking http://arxiv.org/abs/0908.0704 2009 CoRR abs/0908.0704 db/journals/corr/corr0908.html#abs-0908-0704

Jeremy Pickens Gene Golovchinsky Ranked feature fusion models for ad hoc retrieval. 893-900 2008 CIKM https://doi.org/10.1145/1458082.1458200 conf/cikm/2008 db/conf/cikm/cikm2008.html#PickensG08 John Adcock Matthew Cooper 0002 Jeremy Pickens Experiments in interactive video search by addition and subtraction. 465-474 2008 CIVR https://doi.org/10.1145/1386352.1386412 conf/civr/2008 db/conf/civr/civr2008.html#AdcockCP08 John Adcock Jeremy Pickens FXPAL collaborative exploratory video search system. 551-552 2008 CIVR https://doi.org/10.1145/1386352.1386426 conf/civr/2008 db/conf/civr/civr2008.html#AdcockP08 Jeremy Pickens Gene Golovchinsky Meredith Ringel Morris Collaborative information retrieval. 440 2008 JCDL https://doi.org/10.1145/1378889.1378985 conf/jcdl/2008 db/conf/jcdl/jcdl2008.html#PickensGM08 Jeremy Pickens Gene Golovchinsky Chirag Shah 0001 Pernilla Qvarfordt Maribeth Back Algorithmic mediation for collaborative exploratory search. 315-322 2008 SIGIR https://doi.org/10.1145/1390334.1390389 conf/sigir/2008 db/conf/sigir/sigir2008.html#PickensGSQB08 Jeremy Pickens John Adcock Matthew Cooper 0002 Andreas Girgensohn L Interactive Search Experiments for TRECVID 2008. 2008 TRECVID http://www-nlpir.nist.gov/projects/tvpubs/tv8.papers/fxpal.pdf conf/trecvid/2008 db/conf/trecvid/trecvid2008.html#PickensACG08 John Adcock Jeremy Pickens Matthew Cooper 0002 Lisa Anthony Francine Chen 0001 Pernilla Qvarfordt FXPAL Interactive Search Experiments for TRECVID 2007. 2007 TRECVID http://www-nlpir.nist.gov/projects/tvpubs/tv7.papers/fxpal.pdf conf/trecvid/2007 db/conf/trecvid/trecvid2007.html#AdcockPCACQ07 Jeremy Pickens Andrew MacFarlane 0001 Term context models for information retrieval. 559-566 2006 conf/cikm/2006 CIKM https://doi.org/10.1145/1183614.1183694 db/conf/cikm/cikm2006.html#PickensM06 Tim Crawford Jeremy Pickens Geraint A. Wiggins Dimensionality Reduction in Harmonic Modeling for Music Information Retrieval. 233-248 2005 conf/cmmr/2005 CMMR https://doi.org/10.1007/11751069_21 https://www.wikidata.org/entity/Q57653998 db/conf/cmmr/cmmr2005.html#CrawfordPW05 Jeremy Pickens Costas S. Iliopoulos Markov Random Fields and Maximum Entropy Modeling for Music Information Retrieval. 207-214 2005 conf/ismir/2005 ISMIR http://ismir2005.ismir.net/proceedings/1007.pdf db/conf/ismir/ismir2005.html#PickensI05 Juan Pablo Bello Jeremy Pickens A Robust Mid-Level Representation for Harmonic Content in Music Signals. 304-311 2005 conf/ismir/2005 ISMIR http://ismir2005.ismir.net/proceedings/1038.pdf db/conf/ismir/ismir2005.html#BelloP05 Jeremy Pickens Classifier Combination for Capturing Musical Variation. 648-651 2005 conf/ismir/2005 ISMIR http://ismir2005.ismir.net/proceedings/2010.pdf db/conf/ismir/ismir2005.html#Pickens05 Jeremy Pickens Key-specific shrinkage techniques for harmonic models. 2003 conf/ismir/2003 ISMIR http://ismir2003.ismir.net/papers/Pickens.pdf db/conf/ismir/ismir2003.html#Pickens03 Victor Lavrenko Jeremy Pickens Polyphonic music modeling with random fields. 120-129 2003 conf/mm/2003 ACM Multimedia https://doi.org/10.1145/957013.957041 db/conf/mm/mm2003.html#LavrenkoP03 Victor Lavrenko Jeremy Pickens Music modeling with random fields. 389-390 2003 conf/sigir/2003 SIGIR https://doi.org/10.1145/860435.860515 db/conf/sigir/sigir2003.html#LavrenkoP03 Jeremy Pickens Tim Crawford Harmonic models for polyphonic music retrieval. 430-437 2002 conf/cikm/2002 CIKM https://doi.org/10.1145/584792.584863 db/conf/cikm/cikm2002.html#PickensC02 Jeremy Pickens Juan Pablo Bello Tim Crawford Matthew J. Dovey Giuliano Monti Mark B. Sandler Polyphonic Score Retrieval Using Polyphonic Audio Queries: A Harmonic Modeling Approach. 2002 conf/ismir/2002 ISMIR http://ismir2002.ismir.net/proceedings/02-FP04-6.pdf db/conf/ismir/ismir2002.html#PickensBCDMS02 Jeremy Pickens Feature Selection for Polyphonic Music Retrieval. 428-429 2001 conf/sigir/2001 SIGIR db/conf/sigir/sigir2001.html#Pickens01 https://doi.org/10.1145/383952.384070 Jeremy Pickens A Comparison of Language Modeling and Probabilistic Text Information Retrieval Approaches to Monophonic Music Retrieval. 2000 conf/ismir/2000 ISMIR http://ismir2000.ismir.net/papers/pickens_paper.pdf db/conf/ismir/ismir2000.html#Pickens00 Jeremy Pickens W. Bruce Croft An exploratory analysis of phrases in text retrieval. 1179-1195 2000 RIAO conf/riao/2000 db/conf/riao/riao2000.html#PickensC00 https://dl.acm.org/doi/10.5555/2856151.2856173 John Adcock Aron J. Ahmadia Hana Anber Lisa Anthony Kevin D. Ashley Katie Atkinson Sandeep Avula Leif Azzopardi Maribeth Back Jason R. Baron Juan Pablo Bello Paheli Bhattacharya Asia J. BiegaAsia Biega Adrian Boteanu Karl BrantingLuther Karl Branting Andrew Bye Julio C. Rodríguez Cano Scott A. Carter Shubham Chatterjee Francine Chen 0001 Jack G. Conrad Matthew Cooper 0002Matthew L. Cooper Tim Crawford W. Bruce Croft Evan Curtin Jeff Dalton 0001 Laura Dietz Shiri Dori-Hacohen Matthew J. Dovey Tara Emory Henry Allen FeildHenry Feild Juan M. Fernández-Luna John Foley Enrico Francesconi Ben Gamari Andreas Girgensohn Gene Golovchinsky Matthias Grabmair Lenora Gray Tom GricksThomas C. Gricks Thomas C. Gricks III Bayu Hardi Hans Henseler Juan F. Huete Costas S. Iliopoulos Amanda Jones Rosie Jones Pallika Kanani Sumanta Kashyapi Victor Lavrenko David D. Lewis Daniel W. Linna Jr. Andrew MacFarlane 0001 Widad Machmouchi Bhaskar Mitra 0001 Matthew Mitsui Giuliano Monti Meredith Ringel Morris Aditi S. Muralidharan Aileen Nielsen Mark Noel Steve Nole Roshanak Omrani Alexandre Tachard Passos Pernilla Qvarfordt Jordan Ramsdell Nathan Reff Adam Roegiest Tetsuya Sakai Mark B. Sandler Chirag Shah 0001 David Smith Alessandro Sordoni Laure Soulier Lynda Tamine-LechaniLynda Tamine Cristin Traylor John Tredennick Sean Underwood Jyothi K. Vinjumur Vern R. Walker Bernhard Waltl William Webber Geraint A. Wiggins Lynn Wilcox Adam Z. WynerAdam Zachary Wyner Eugene Yang 0001