We always knew that Chomsky was wrong about language models, it’s nice to have a paper showing you just how wrong he was! #ACL2024 best papsr.
Pascale Fung
161 posts
Pascale Fung
@pascalefung
Cofounder and CRIO of AMI Labs. Chair Professor of ECE, HKUST. Fellow of AAAI, ACL, IEEE, ISCA.
Paris, France
Joined August 2010
00:00- “Machine learning sucks!” Keynote by @ylecun at the AI Symposium: New Horizons 2023 at the Asia Society in Hong Kong.
- Looking for interns for Meta-FAIR in Paris in 2025 on multimodal reasoning, reasoning benchmarking, NLP, and AI safety. Yes Paris, City of Light and Reasoning.
- Our research on embodied AI agents that can perceive, learn, act and interact in the virtual and physical worlds. #metaAI #AIAgent #embodied #worldmodel #superintelligemce
- #ACL2024 was great. But very few papers were asking hard scientific questions. A lot of “LLM engineering”. In particular, university labs should really defocus on this type of engineering as industry labs, though not publishing every minute detail, are doing way more advanced
- I told President @EmmanuelMacron that I started my AI research career from a small project on automatic speech recognition at #EcoleCentraleParis when I was a student.
- I have long hoped to bring top US and China AI researchers together for a scientific exchange. This finally happened with @ylecun, Harry Shum, Feng Junlan (chief AI scientist, China Mobile), Li Hang (Head of Research Bytedance) and Zhou Jingren (CTO of Alibaba Cloud)
- So this paper got a 1 from a reviewer from #EMNLP - never gotten a 1 before ever, and is rejected. So I am sharing its arxiv version for feedback. I did get a bunch when I shared it with people in person before. TIA. arxiv.org/abs/2404.07900
- Do humans need language for #reasoning and #planning? It really depends. We “reasons and plan” a lot of physical and artistic activities without thinking in language (eg dance, swimming, painting, playing an instrument…) but language helps us teach/learn how to do them.
- The keynote speaker talked for about an hour but cut me off after 10 seconds of my question. If you can’t take a question don’t give a keynote! #ACL2024
- Excellent #acl2024 keynote by Barbara Plank on how to work with the inherent (and beautiful) variation in languages that leads to uncertainty in LLMs and other AI models. Exactly what NLP needs to hear.
- It’s 2024, NLP people need to work on the phenomenon of language as manifested in LLMs and other AI models - so that we can make scientific progress - instead of *still* being on the bandwagon of shitting on AGI/LLM endlessly. It’s boring. #acl2024
