Can someone create an opensource and completely free versions of these things:
1. Duolingo
2. Google one
3. Figma
4. AWS
5. Brilliant
Thanks in advance!
It's so fascinating that LLMs don't actually do any math, they literally just remember.
For instance, they can't even do something as basic as 2+2, they have just seen it in the training data, so they literally just predict the next token, that is 4, by pattern matching.
But
Fun question to ask in an ml interview, “Why do embedding dimensions come in neat sizes like 768 or 1024, but never 739?”
If they can't answer it, it's fine but if they do, you've stumbled upon a real gem.