Pinned
Most influential LLM papers and the ideas they introduced (post 2017)
A long thread 🧵
Pramod Goyal
3,419 posts
Pramod Goyal
@goyal__pramod
Trying to change the world one line at a time
- Btw, this is the best book ever on Linear Algebra. Extremely interactive and beautiful visuals
- A beautiful visual blog, where you can change values, interact, and see what each head does exactly inside the transformer.
- One of the best technical blogs I have ever read period!
- Now that Google has released a text diffusion model, it's time to read this paper.
- A beautiful paper that goes through Diffusion step by step, explaining the entire math of it from the beginning.
- Today is the day I truly understood why attention works Not just for words, but images, audio, video. But everything else.
- Some blogs change your perception, and this one by Andrej Karpathy is one of those.
- The best way to learn PyTorch is by building something with it. Consider checking out my blog where I help you, build transformers using PyTorch from scratch
- There is no better blog (that I have found) which explains intuitively WHY momentum works.
