One of the major perks of academia is that you get to travel to exciting locations and spend time in different locations of corporate hotel chains working on your slides late at night.
Tal Linzen
16.3K posts
Tal Linzen
@tallinzen
Professor @nyuling and @NYUDataScience, research scientist @GoogleAI, inventor of the word "bertology"
- I'm thrilled to announce that I'll be moving to NYU in September 2020 for a joint position in @NYUDataScience and @nyuling!
- I'll be recruiting a PhD student through the NYU Data Science program this year! Two areas I'm particularly interesed in working on with a student in the next few years are:
- So a nice thing that just happened is I got tenure!
- Attention is all you need, except residual connections, layer norm, position embeddings, extra feedforward layers, multiple heads, and masking future words
- If you were wondering what it's like to be a computational linguist: I got an email yesterday with the title "URGENT: NEED VERBS"
- This reaction by Geoff Pullum to the astonishing progress in speech recognition is probably shared by most linguists (me included).
- Please stop using BERT, or any other model that gets both the left and right context of a word, to simulate results from human left-to-right reading experiments! It's a non-starter even if BERT is a famous model and also easy to download! Thanks!
- I'll be recruiting a PhD student through the NYU Data Science program (to start in Fall 2021). Would love to chat about it "at" #acl2020nlp. Email me if interested in a computational psycholinguistics ∩ deep learning PhD (even if you're not attending the conference)!
- slides from my short #phildeeplearning talk yesterday, "What, if Anything, Can Large Language Models Teach Us About Human Language Acquisition?":
- At 10k followers I will reveal which type of neural network you're permitted to use to model human reading
- So, on the topic of the Apple puzzle reasoning paper: we got pretty similar results in our recent paper on recognizing context-free languages as an LLM eval, a task that also requires the model to follow an algorithm (which I think is what LLM folks mean by "reasoning").
- Time for the yearly a reminder that, if you're fortunate enough to have more than one PhD offer, it is not frivolous to decide where to go based on the school's location!
