Pinned
New video!
The attention mechanism is well known for its use in Transformers. But where does it come from? It's origins lie in fixing a strange problems of RNNs. Watch the video to learn about it!
youtu.be/lOrTlKrdmkQ
00:00
Vivek Verma
324 posts
Vivek Verma
@vcubingx
- IT'S FINALLY OUT! After months of work, I'm happy to announce that the first video in a series on visualizing deep learning is out. It's on visualizing the structure of a neural network. RTs appreciated :) youtu.be/UOvPeC8WOt8
- Life update: Iโve taken up a job as a researcher on the post-training team at @OpenAI, working on reinforcement learning, function calling and other efforts! Iโve also graduated from @UCBerkeley where Iโm grateful for a wonderful four years of learning and fun ๐
- New video! Ever wondered how a partially scanned barcode is still goes through? Or just wanna see a neat application of some abstract math? This video introduces Reed-Solomon Codes, through some seemingly unrelated topics. youtu.be/1pQJkt7-R4Q
00:00 - New video! This one's on visualizing derivatives of complex functions. Turns out, there's some beautiful ways we can visualize the un-graphable. youtu.be/0CHZMY02Dhk
00:00 - Replying to @InertialObservrHere's another brachistochrone thingy I dug up: if you place a ball on any point on the curve, it will always take the same amount of time to reach the end.
00:00 - New video! I introduce the idea of a neural language model, building up to the recurrent neural network. Recurrence-based language models were the cream of the crop till 2016 (before transformers), and were even used by Google Translate until then. youtu.be/rTz6hadM1Lg
00:00 - New Video! Excited to be starting a new series on natural language processing! This first video, aims to explain what a Language Model is, through the N-Gram Language Model. Stay tuned for more! Iโll be posting the next chapter next Monday (April 8) youtu.be/1il-s4mgNdI
00:00 - I'm returning. New video this Friday, October 15th at 7:00 AM PDT.
00:00 - I'm taking a short break from making videos. I wanna make sure I put in as much effort as I can to get into an undergraduate program that I'll be happy spending the next 4 years at. When I come back, it'll be strong. Expect some mind-blowing videos :)
- This is still one of my favorite animations: The line integral of a vector field, visualized:
00:00
