Simo Ryu (@cloneofsimo) / X

Simo Ryu

5,332 posts

Simo Ryu

@cloneofsimo

I like cats, math and codes [email protected]

Seoul, Republic of Korea

github.com/cloneofsimo

Joined May 2022

Pinned
Simo Ryu
@cloneofsimo
Mar 4
This was work done last year, but my lazy ass uploaded it just this week It was huge fun working on this project.
Hanch Han
@hanchchch
Mar 4
yesterday, @cloneofsimo and I released a tech report on the video pretraining research we worked on last year. we believe sharing our experience with the community building video models will be of great help! arxiv.org/abs/2603.00173
18K
Simo Ryu
@cloneofsimo
Apr 6, 2025
damn,.... this is so incredibly cool use case for discrete diffusion model
00:00
2.6M
Simo Ryu
@cloneofsimo
Aug 19, 2025
> used windows for 25 years > bought mac-mini, used it for 3 days > I have mac supremacy now Its insane that I missed out mac *is* infinitely better.
1.1M
Simo Ryu
@cloneofsimo
Oct 24, 2025
ai company: mine gold nvidia: sell shovels google: mine gold, sell shovel, distribute gold, export gold, make shovel, rent shovel, make jewlery, sell jewlery, distribute the jewlery, other jewleries, make cars that ships the jewlery, make chips that make the cars, make recsys to
465K
Simo Ryu
@cloneofsimo
Oct 2, 2025
We get transfered SO MANY STUFF out of the box from our ancestors, its ridiculous. My favorite example is that empirically, we seem to have "snake detection module" hard-wired to our brain (that detects snake faster than other things) We are, in so many ways, literally
roon
@tszzl
Oct 2, 2025
people forget about the Baldwin effect when reasoning about the difference between evolution and learning when you recapitulate learning that your ancestors did, when you learn to see, walk, and speak in an unbroken line for thousands of generations, it gets easier each time
529K
Simo Ryu
@cloneofsimo
Sep 21, 2024
* comes to SF * goes to random dinner * @karpathy is on the next table????
154K
Simo Ryu
@cloneofsimo
Jan 25, 2025
As a foregner its really weird to see americans saying this is huge L for America or something If you read their paper, all methodologies really just came from google (Shazeer to be honest), openai and Meta (MoE, Transformer, MTP, scaling law, pytorch, even the improved NCCL,
280K
Simo Ryu
@cloneofsimo
May 8, 2025
This company: * Monopoly on search market * Monopoly on entire fucking videos on the planet * Oligopoly on self driving cars, music streaming, emails, office tools, video calls, etc etc * Literally half of entire ads on earth * Literally have private SoTA language models, video
408K
Simo Ryu
@cloneofsimo
Aug 6, 2025
How does google do it man they are supposed to be large company, like large slow, with bureaucracy and shit but they somehow manage to pull off like 1000 mega-talented startups with infinite money glitch
Philip J. Ball
@philipjohnball
Aug 5, 2025
Good Knight 🏰⚔️🛡️
00:00
135K
Simo Ryu
@cloneofsimo
Sep 26, 2025
"Skylar, all the models I trained, I..." "If I need to hear you poisoned these minors with dophamine short-forms for the family one more time...." "I liked watching reward_normalized_teenager_engagements go up on wandb dashboard. I was good at it. I was... alive"
flux
@fluxtheorist
Sep 26, 2025
Replying to @ABAtanasov
Imagine doing an entire PhD, having multiple NeurIPS/ICLR/ICML papers, a very high TC, and tons of respect… Only to end up working on the digital version of meth specifically targeted at minors and old people
119K
Simo Ryu
@cloneofsimo
Nov 7, 2024
This is periodic reminder / recommendation to read this paper inside out. It is still the most helpful paper ive ever read. You may have not have encountered it because its not super popular like "Attention is all you need", but you WILL thank me. Despite the paper's title,
255K
Simo Ryu
@cloneofsimo
Sep 26, 2025
So apparently this 600 pages book has all the niche shit about matrix that linalg class dont teach you
nor
@norxornor
Sep 26, 2025
Replying to @norxornor and @cloneofsimo
Also, matrix analysis by Horn and Johnson is a great resource for other such cool results
159K
Simo Ryu
@cloneofsimo
Sep 26, 2025
Replying to @cloneofsimo
We can collectively decide to not poison our children. This isn't difficult choice. Please make this happen if you are in position of power.
530K
Simo Ryu
@cloneofsimo
Oct 20, 2025
So apparently normies think mathematician do like, high school trigonometry and freshman calculus?
Mustafa
@oprydai
Oct 18, 2025
how a mathematician sees the world
56K