Scaling Speech Technology to 1, 000+ Languages.

Alexis Conneau

Vineel Pratap Andros Tjandra Bowen Shi 0002 Paden Tomasello Arun Babu Sayani Kundu Ali Elkahky Zhaoheng Ni Apoorv Vyas Maryam Fazel-Zarandi Alexei Baevski Yossi Adi Xiaohui Zhang 0007 Wei-Ning Hsu Alexis Conneau Michael Auli Scaling Speech Technology to 1, 000+ Languages. 97:1-97:52 2024 25 J. Mach. Learn. Res. https://jmlr.org/papers/v25/23-1318.html db/journals/jmlr/jmlr25.html#PratapTSTBKENVF24

Ju-Chieh Chou Chung-Ming Chien Wei-Ning Hsu Karen Livescu Arun Babu Alexis Conneau Alexei Baevski Michael Auli Toward Joint Language Modeling for Speech Units and Text. 6582-6593 2023 EMNLP (Findings) https://doi.org/10.18653/v1/2023.findings-emnlp.438 https://aclanthology.org/2023.findings-emnlp.438 conf/emnlp/2023f db/conf/emnlp/emnlp2023f.html#ChouCHLBCBA23 Armen Aghajanyan Lili Yu Alexis Conneau Wei-Ning Hsu Karen Hambardzumyan Susan Zhang Stephen Roller Naman Goyal 0001 Omer Levy Luke Zettlemoyer Scaling Laws for Generative Mixed-Modal Language Models. 265-279 2023 ICML https://proceedings.mlr.press/v202/aghajanyan23a.html conf/icml/2023 db/conf/icml/icml2023.html#AghajanyanYCHHZ23 Michael Hassid Tal Remez Tu Anh Nguyen Itai Gat Alexis Conneau Felix Kreuk Jade Copet Alexandre Défossez Gabriel Synnaeve Emmanuel Dupoux Roy Schwartz 0001 Yossi Adi Textually Pretrained Speech Language Models. 2023 NeurIPS http://papers.nips.cc/paper_files/paper/2023/hash/c859b99b5d717c9035e79d43dfd69435-Abstract-Conference.html conf/nips/2023 db/conf/nips/neurips2023.html#HassidRNGCKCDSD23

Armen Aghajanyan Lili Yu Alexis Conneau Wei-Ning Hsu Karen Hambardzumyan Susan Zhang Stephen Roller Naman Goyal 0001 Omer Levy Luke Zettlemoyer Scaling Laws for Generative Mixed-Modal Language Models. 2023 abs/2301.03728 CoRR https://doi.org/10.48550/arXiv.2301.03728 db/journals/corr/corr2301.html#abs-2301-03728

Michael Hassid Tal Remez Tu Anh Nguyen Itai Gat Alexis Conneau Felix Kreuk Jade Copet Alexandre Défossez Gabriel Synnaeve Emmanuel Dupoux Roy Schwartz 0001 Yossi Adi Textually Pretrained Speech Language Models. 2023 abs/2305.13009 CoRR https://doi.org/10.48550/arXiv.2305.13009 db/journals/corr/corr2305.html#abs-2305-13009

Vineel Pratap Andros Tjandra Bowen Shi 0002 Paden Tomasello Arun Babu Sayani Kundu Ali Elkahky Zhaoheng Ni Apoorv Vyas Maryam Fazel-Zarandi Alexei Baevski Yossi Adi Xiaohui Zhang 0007 Wei-Ning Hsu Alexis Conneau Michael Auli Scaling Speech Technology to 1, 000+ Languages. 2023 abs/2305.13516 CoRR https://doi.org/10.48550/arXiv.2305.13516 db/journals/corr/corr2305.html#abs-2305-13516

Ju-Chieh Chou Chung-Ming Chien Wei-Ning Hsu Karen Livescu Arun Babu Alexis Conneau Alexei Baevski Michael Auli Toward Joint Language Modeling for Speech Units and Text. 2023 abs/2310.08715 CoRR https://doi.org/10.48550/arXiv.2310.08715 db/journals/corr/corr2310.html#abs-2310-08715

Andros Tjandra Diptanu Gon Choudhury Frank Zhang 0001 Kritika Singh Alexis Conneau Alexei Baevski Assaf Sela Yatharth Saraf Michael Auli Improved Language Identification Through Cross-Lingual Self-Supervised Learning. 6877-6881 2022 ICASSP https://doi.org/10.1109/ICASSP43922.2022.9747667 conf/icassp/2022 db/conf/icassp/icassp2022.html#TjandraCZSCBSSA22 Ye Jia Yifan Ding Ankur Bapna Colin Cherry Yu Zhang 0033 Alexis Conneau Nobu Morioka Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation. 1721-1725 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-10938 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#JiaDBC0CM22 Arun Babu Changhan Wang Andros Tjandra Kushal Lakhotia Qiantong Xu Naman Goyal 0001 Kritika Singh Patrick von Platen Yatharth Saraf Juan Pino 0001 Alexei Baevski Alexis Conneau Michael Auli XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale. 2278-2282 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-143 https://www.wikidata.org/entity/Q109637760 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#BabuWTLXGSPSPBC22 Alexis Conneau Ankur Bapna Yu Zhang 0033 Min Ma Patrick von Platen Anton Lozhkov Colin Cherry Ye Jia Clara Rivera Mihir Kale Daan van Esch Vera Axelrod Simran Khanuja Jonathan H. Clark Orhan Firat Michael Auli Sebastian Ruder Jason Riesa Melvin Johnson XTREME-S: Evaluating Cross-lingual Speech Representations. 3248-3252 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-10007 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#ConneauBZMPLCJR22 Alexis Conneau Min Ma Simran Khanuja Yu Zhang 0033 Vera Axelrod Siddharth Dalmia Jason Riesa Clara Rivera Ankur Bapna FLEURS: FEW-Shot Learning Evaluation of Universal Representations of Speech. 798-805 2022 SLT https://doi.org/10.1109/SLT54892.2023.10023141 conf/slt/2022 db/conf/slt/slt2022.html#ConneauMKZADRRB22

Ankur Bapna Colin Cherry Yu Zhang 0033 Ye Jia Melvin Johnson Yong Cheng Simran Khanuja Jason Riesa Alexis Conneau mSLAM: Massively multilingual joint pre-training for speech and text. 2022 abs/2202.01374 CoRR https://arxiv.org/abs/2202.01374 db/journals/corr/corr2202.html#abs-2202-01374

Alexis Conneau Ankur Bapna Yu Zhang 0033 Min Ma Patrick von Platen Anton Lozhkov Colin Cherry Ye Jia Clara Rivera Mihir Kale Daan van Esch Vera Axelrod Simran Khanuja Jonathan H. Clark Orhan Firat Michael Auli Sebastian Ruder Jason Riesa Melvin Johnson XTREME-S: Evaluating Cross-lingual Speech Representations. 2022 abs/2203.10752 CoRR https://doi.org/10.48550/arXiv.2203.10752 db/journals/corr/corr2203.html#abs-2203-10752

Ye Jia Yifan Ding Ankur Bapna Colin Cherry Yu Zhang 0033 Alexis Conneau Nobuyuki Morioka Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation. 2022 abs/2203.13339 CoRR https://doi.org/10.48550/arXiv.2203.13339 db/journals/corr/corr2203.html#abs-2203-13339

Alexis Conneau Min Ma Simran Khanuja Yu Zhang 0033 Vera Axelrod Siddharth Dalmia Jason Riesa Clara Rivera Ankur Bapna FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech. 2022 abs/2205.12446 CoRR https://doi.org/10.48550/arXiv.2205.12446 db/journals/corr/corr2205.html#abs-2205-12446

Xian Li 0003 Changhan Wang Yun Tang 0002 Chau Tran Yuqing Tang Juan Miguel Pino Alexei Baevski Alexis Conneau Michael Auli Multilingual Speech Translation from Efficient Finetuning of Pretrained Models. 827-838 2021 ACL/IJCNLP (1) https://doi.org/10.18653/v1/2021.acl-long.68 https://aclanthology.org/2021.acl-long.68 conf/acl/2021-1 db/conf/acl/acl2021-1.html#LiWTTTPBCA20 Qiantong Xu Alexei Baevski Tatiana Likhomanenko Paden Tomasello Alexis Conneau Ronan Collobert Gabriel Synnaeve Michael Auli Self-Training and Pre-Training are Complementary for Speech Recognition. 3030-3034 2021 ICASSP https://doi.org/10.1109/ICASSP39728.2021.9414641 conf/icassp/2021 db/conf/icassp/icassp2021.html#XuBLTCCSA21 Beliz Gunel Jingfei Du Alexis Conneau Veselin Stoyanov Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning. 2021 ICLR https://openreview.net/forum?id=cu7IUiOhujH conf/iclr/2021 db/conf/iclr/iclr2021.html#GunelDCS21 Changhan Wang Anne Wu Juan Pino 0001 Alexei Baevski Michael Auli Alexis Conneau Large-Scale Self- and Semi-Supervised Learning for Speech Translation. 2242-2246 2021 Interspeech https://doi.org/10.21437/Interspeech.2021-1912 conf/interspeech/2021 db/conf/interspeech/interspeech2021.html#WangWPBAC21 Alexis Conneau Alexei Baevski Ronan Collobert Abdelrahman Mohamed Michael Auli Unsupervised Cross-Lingual Representation Learning for Speech Recognition. 2426-2430 2021 Interspeech https://doi.org/10.21437/Interspeech.2021-329 conf/interspeech/2021 db/conf/interspeech/interspeech2021.html#ConneauBCMA21 Jingfei Du Edouard Grave Beliz Gunel Vishrav Chaudhary Onur Celebi Michael Auli Veselin Stoyanov Alexis Conneau Self-training Improves Pre-training for Natural Language Understanding. 5408-5418 2021 NAACL-HLT https://doi.org/10.18653/v1/2021.naacl-main.426 https://aclanthology.org/2021.naacl-main.426/ conf/naacl/2021 db/conf/naacl/naacl2021.html#DuGGCCASC21 Alexei Baevski Wei-Ning Hsu Alexis Conneau Michael Auli Unsupervised Speech Recognition. 27826-27839 2021 NeurIPS https://proceedings.neurips.cc/paper/2021/hash/ea159dc9788ffac311592613b7f71fbb-Abstract.html conf/nips/2021 db/conf/nips/neurips2021.html#BaevskiHCA21 Naman Goyal 0001 Jingfei Du Myle Ott Giri Anantharaman Alexis Conneau Larger-Scale Transformers for Multilingual Masked Language Modeling. 29-33 2021 RepL4NLP@ACL-IJCNLP https://doi.org/10.18653/v1/2021.repl4nlp-1.4 https://aclanthology.org/2021.repl4nlp-1.4 conf/rep4nlp/2021 db/conf/rep4nlp/rep4nlp2021.html#GoyalDOAC21

Changhan Wang Anne Wu Juan Miguel Pino Alexei Baevski Michael Auli Alexis Conneau Large-Scale Self- and Semi-Supervised Learning for Speech Translation. 2021 abs/2104.06678 CoRR https://arxiv.org/abs/2104.06678 db/journals/corr/corr2104.html#abs-2104-06678

Naman Goyal 0001 Jingfei Du Myle Ott Giri Anantharaman Alexis Conneau Larger-Scale Transformers for Multilingual Masked Language Modeling. 2021 abs/2105.00572 CoRR https://arxiv.org/abs/2105.00572 db/journals/corr/corr2105.html#abs-2105-00572

Alexei Baevski Wei-Ning Hsu Alexis Conneau Michael Auli Unsupervised Speech Recognition. 2021 abs/2105.11084 CoRR https://arxiv.org/abs/2105.11084 db/journals/corr/corr2105.html#abs-2105-11084

Ankur Bapna Yu-An Chung Nan Wu Anmol Gulati Ye Jia Jonathan H. Clark Melvin Johnson Jason Riesa Alexis Conneau Yu Zhang 0033 SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training. 2021 abs/2110.10329 CoRR https://arxiv.org/abs/2110.10329 db/journals/corr/corr2110.html#abs-2110-10329

Arun Babu Changhan Wang Andros Tjandra Kushal Lakhotia Qiantong Xu Naman Goyal 0001 Kritika Singh Patrick von Platen Yatharth Saraf Juan Pino 0001 Alexei Baevski Alexis Conneau Michael Auli XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale. 2021 abs/2111.09296 CoRR https://arxiv.org/abs/2111.09296 db/journals/corr/corr2111.html#abs-2111-09296

Alexis Conneau Shijie Wu Haoran Li 0007 Luke Zettlemoyer Veselin Stoyanov Emerging Cross-lingual Structure in Pretrained Language Models. 6022-6034 2020 ACL https://doi.org/10.18653/v1/2020.acl-main.536 https://aclanthology.org/2020.acl-main.536/ conf/acl/2020 db/conf/acl/acl2020.html#ConneauWLZS20 Alexis Conneau Kartikay Khandelwal Naman Goyal 0001 Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov Unsupervised Cross-lingual Representation Learning at Scale. 8440-8451 2020 ACL https://doi.org/10.18653/v1/2020.acl-main.747 https://aclanthology.org/2020.acl-main.747/ https://www.wikidata.org/entity/Q109615827 conf/acl/2020 db/conf/acl/acl2020.html#ConneauKGCWGGOZ20 Guillaume Wenzek Marie-Anne Lachaux Alexis Conneau Vishrav Chaudhary Francisco Guzmán Armand Joulin Edouard Grave CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data. 4003-4012 2020 LREC https://aclanthology.org/2020.lrec-1.494/ conf/lrec/2020 db/conf/lrec/lrec2020.html#WenzekLCCGJG20

Alexis Conneau Alexei Baevski Ronan Collobert Abdelrahman Mohamed Michael Auli Unsupervised Cross-lingual Representation Learning for Speech Recognition. 2020 abs/2006.13979 CoRR https://arxiv.org/abs/2006.13979 db/journals/corr/corr2006.html#abs-2006-13979

Jingfei Du Edouard Grave Beliz Gunel Vishrav Chaudhary Onur Celebi Michael Auli Ves Stoyanov Alexis Conneau Self-training Improves Pre-training for Natural Language Understanding. 2020 abs/2010.02194 CoRR https://arxiv.org/abs/2010.02194 db/journals/corr/corr2010.html#abs-2010-02194

Qiantong Xu Alexei Baevski Tatiana Likhomanenko Paden Tomasello Alexis Conneau Ronan Collobert Gabriel Synnaeve Michael Auli Self-training and Pre-training are Complementary for Speech Recognition. 2020 abs/2010.11430 CoRR https://arxiv.org/abs/2010.11430 db/journals/corr/corr2010.html#abs-2010-11430

Beliz Gunel Jingfei Du Alexis Conneau Ves Stoyanov Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning. 2020 abs/2011.01403 CoRR https://arxiv.org/abs/2011.01403 db/journals/corr/corr2011.html#abs-2011-01403

Alexis Conneau Learning distributed representations of sentences using neural networks. (Apprentissage et applications de représentations multilingues distribuées). 2019 Le Mans University, France https://tel.archives-ouvertes.fr/tel-02504543 Alexis Conneau Guillaume Lample Cross-lingual Language Model Pretraining. 7057-7067 2019 NeurIPS https://proceedings.neurips.cc/paper/2019/hash/c04c19c2c2474dbf5f7ac4372c5b9af1-Abstract.html http://papers.nips.cc/paper/8928-cross-lingual-language-model-pretraining conf/nips/2019 db/conf/nips/nips2019.html#ConneauL19 Isabelle Augenstein Spandana Gella Sebastian Ruder Katharina Kann Burcu Can Johannes Welbl Alexis Conneau Xiang Ren 0001 Marek Rei Proceedings of the 4th Workshop on Representation Learning for NLP, RepL4NLP@ACL 2019, Florence, Italy, August 2, 2019. RepL4NLP@ACL Association for Computational Linguistics 2019 978-1-950737-35-2 https://aclanthology.org/volumes/W19-43/ https://aclanthology.org/W19-4300/ db/conf/rep4nlp/rep4nlp2019.html

Guillaume Lample Alexis Conneau Cross-lingual Language Model Pretraining. 2019 abs/1901.07291 CoRR http://arxiv.org/abs/1901.07291 db/journals/corr/corr1901.html#abs-1901-07291

Guillaume Wenzek Marie-Anne Lachaux Alexis Conneau Vishrav Chaudhary Francisco Guzmán Armand Joulin Edouard Grave CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data. 2019 abs/1911.00359 CoRR http://arxiv.org/abs/1911.00359 db/journals/corr/corr1911.html#abs-1911-00359

Shijie Wu Alexis Conneau Haoran Li 0007 Luke Zettlemoyer Veselin Stoyanov Emerging Cross-lingual Structure in Pretrained Language Models. 2019 abs/1911.01464 CoRR http://arxiv.org/abs/1911.01464 db/journals/corr/corr1911.html#abs-1911-01464

Alexis Conneau Kartikay Khandelwal Naman Goyal 0001 Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov Unsupervised Cross-lingual Representation Learning at Scale. 2019 abs/1911.02116 CoRR http://arxiv.org/abs/1911.02116 db/journals/corr/corr1911.html#abs-1911-02116

Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni What you can cram into a single \$&!#* vector: Probing sentence embeddings for linguistic properties. 2126-2136 2018 ACL (1) https://aclanthology.org/P18-1198/ https://doi.org/10.18653/v1/P18-1198 conf/acl/2018-1 db/conf/acl/acl2018-1.html#BaroniBLKC18 Alexis Conneau Ruty Rinott Guillaume Lample Adina Williams Samuel R. Bowman Holger Schwenk Veselin Stoyanov XNLI: Evaluating Cross-lingual Sentence Representations. 2475-2485 2018 EMNLP https://doi.org/10.18653/v1/d18-1269 https://aclanthology.org/D18-1269/ https://www.wikidata.org/entity/Q109615877 conf/emnlp/2018 db/conf/emnlp/emnlp2018.html#ConneauRLWBSS18 Guillaume Lample Myle Ott Alexis Conneau Ludovic Denoyer Marc'Aurelio Ranzato Phrase-Based & Neural Unsupervised Machine Translation. 5039-5049 2018 EMNLP https://aclanthology.org/D18-1549/ conf/emnlp/2018 db/conf/emnlp/emnlp2018.html#LampleOCDR18 Guillaume Lample Alexis Conneau Ludovic Denoyer Marc'Aurelio Ranzato Unsupervised Machine Translation Using Monolingual Corpora Only. 2018 ICLR (Poster) https://openreview.net/forum?id=rkYTTf-AZ conf/iclr/2018 db/conf/iclr/iclr2018.html#LampleCDR18 Guillaume Lample Alexis Conneau Marc'Aurelio Ranzato Ludovic Denoyer Hervé Jégou Word translation without parallel data. 2018 ICLR (Poster) https://openreview.net/forum?id=H196sainb conf/iclr/2018 db/conf/iclr/iclr2018.html#LampleCRDJ18 Alexis Conneau Douwe Kiela SentEval: An Evaluation Toolkit for Universal Sentence Representations. 2018 LREC conf/lrec/2018 db/conf/lrec/lrec2018.html#ConneauK18 http://www.lrec-conf.org/proceedings/lrec2018/summaries/757.html Douwe Kiela Alexis Conneau Allan Jabri Maximilian Nickel Learning Visually Grounded Sentence Representations. 408-418 2018 NAACL-HLT https://doi.org/10.18653/v1/n18-1038 https://aclanthology.org/N18-1038/ conf/naacl/2018-1 db/conf/naacl/naacl2018-1.html#KielaCJN18

Alexis Conneau Douwe Kiela SentEval: An Evaluation Toolkit for Universal Sentence Representations. 2018 abs/1803.05449 CoRR http://arxiv.org/abs/1803.05449 db/journals/corr/corr1803.html#abs-1803-05449

Guillaume Lample Myle Ott Alexis Conneau Ludovic Denoyer Marc'Aurelio Ranzato Phrase-Based & Neural Unsupervised Machine Translation. 2018 abs/1804.07755 CoRR http://arxiv.org/abs/1804.07755 db/journals/corr/corr1804.html#abs-1804-07755

Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni What you can cram into a single vector: Probing sentence embeddings for linguistic properties. 2018 abs/1805.01070 CoRR http://arxiv.org/abs/1805.01070 db/journals/corr/corr1805.html#abs-1805-01070

Alexis Conneau Guillaume Lample Ruty Rinott Adina Williams Samuel R. Bowman Holger Schwenk Veselin Stoyanov XNLI: Evaluating Cross-lingual Sentence Representations. 2018 abs/1809.05053 CoRR http://arxiv.org/abs/1809.05053 db/journals/corr/corr1809.html#abs-1809-05053

Alexis Conneau Holger Schwenk Loïc Barrault Yann LeCun Very Deep Convolutional Networks for Text Classification. 1107-1116 2017 EACL (1) https://doi.org/10.18653/v1/e17-1104 https://aclanthology.org/E17-1104/ conf/eacl/2017-1 db/conf/eacl/eacl2017-1.html#SchwenkBCL17 Alexis Conneau Douwe Kiela Holger Schwenk Loïc Barrault Antoine Bordes Supervised Learning of Universal Sentence Representations from Natural Language Inference Data. 670-680 2017 EMNLP https://doi.org/10.18653/v1/d17-1070 https://aclanthology.org/D17-1070/ conf/emnlp/2017 db/conf/emnlp/emnlp2017.html#ConneauKSBB17

Alexis Conneau Douwe Kiela Holger Schwenk Loïc Barrault Antoine Bordes Supervised Learning of Universal Sentence Representations from Natural Language Inference Data. 2017 abs/1705.02364 CoRR http://arxiv.org/abs/1705.02364 db/journals/corr/corr1705.html#ConneauKSBB17

Douwe Kiela Alexis Conneau Allan Jabri Maximilian Nickel Learning Visually Grounded Sentence Representations. 2017 abs/1707.06320 CoRR http://arxiv.org/abs/1707.06320 db/journals/corr/corr1707.html#KielaCJN17

Alexis Conneau Guillaume Lample Marc'Aurelio Ranzato Ludovic Denoyer Hervé Jégou Word Translation Without Parallel Data. 2017 abs/1710.04087 CoRR http://arxiv.org/abs/1710.04087 db/journals/corr/corr1710.html#abs-1710-04087

Flavian Vasile Elena Smirnova Alexis Conneau Meta-Prod2Vec: Product Embeddings Using Side-Information for Recommendation. 225-232 2016 RecSys https://doi.org/10.1145/2959100.2959160 conf/recsys/2016 db/conf/recsys/recsys2016.html#VasileSC16

Alexis Conneau Holger Schwenk Loïc Barrault Yann LeCun Very Deep Convolutional Networks for Natural Language Processing. 2016 abs/1606.01781 CoRR http://arxiv.org/abs/1606.01781 db/journals/corr/corr1606.html#ConneauSBL16

Flavian Vasile Elena Smirnova Alexis Conneau Meta-Prod2Vec - Product Embeddings Using Side-Information for Recommendation. 2016 abs/1607.07326 CoRR http://arxiv.org/abs/1607.07326 db/journals/corr/corr1607.html#VasileSC16

Yossi Adi Armen Aghajanyan Giri Anantharaman Isabelle Augenstein Michael Auli Vera Axelrod Arun Babu Alexei Baevski Ankur Bapna Marco Baroni Loïc Barrault Antoine Bordes Samuel R. Bowman Burcu Can Onur Celebi Vishrav Chaudhary Yong Cheng Colin Cherry Chung-Ming Chien Ju-Chieh Chou Diptanu Gon Choudhury Yu-An Chung Jonathan H. Clark Ronan Collobert Jade Copet Siddharth Dalmia Alexandre Défossez Ludovic Denoyer Yifan Ding Jingfei Du Emmanuel Dupoux Ali Elkahky Daan van Esch Maryam Fazel-Zarandi Orhan Firat Itai Gat Spandana Gella Naman Goyal 0001 Edouard Grave Anmol Gulati Beliz Gunel Francisco Guzmán Karen Hambardzumyan Michael Hassid Wei-Ning Hsu Allan Jabri Hervé Jégou Ye Jia Melvin Johnson Armand Joulin Mihir Kale Katharina Kann Kartikay Khandelwal Simran Khanuja Douwe Kiela Felix Kreuk Germán Kruszewski Sayani Kundu Marie-Anne Lachaux Kushal Lakhotia Guillaume Lample Yann LeCun Omer Levy Haoran Li 0007 Xian Li 0003 Tatiana Likhomanenko Karen Livescu Anton Lozhkov Min Ma Abdel-rahman MohamedAbdelrahman Mohamed Nobuyuki MoriokaNobu Morioka Tu Anh Nguyen Zhaoheng Ni Maximilian Nickel Myle Ott Juan Pino 0001Juan Miguel Pino Patrick von Platen Vineel Pratap Marc'Aurelio Ranzato Marek Rei Tal Remez Xiang Ren 0001 Jason Riesa Ruty Rinott Clara Rivera Stephen Roller Sebastian Ruder Yatharth Saraf Roy Schwartz 0001 Holger Schwenk Assaf Sela Bowen Shi 0002 Kritika Singh Elena Smirnova Veselin StoyanovVes Stoyanov Gabriel Synnaeve Yun Tang 0002 Yuqing Tang Andros Tjandra Paden Tomasello Chau Tran Flavian Vasile Apoorv Vyas Changhan Wang Johannes Welbl Guillaume Wenzek Adina Williams Anne Wu Nan Wu Shijie Wu Qiantong Xu Lili Yu Luke Zettlemoyer Frank Zhang 0001 Susan Zhang Xiaohui Zhang 0007 Yu Zhang 0033