Pinned
Gd dominates ridge regression but not sgd! Surprising that such simple things aren't known for linear regression
Jason Lee
3,820 posts
Jason Lee
@jasondeanlee
Associate Professor CS/stats UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on LLMs and deep learning. PhD at Stanford.
- Why... Who even uses perplexityIf Apple buys Perplexity, that would be its biggest ever acquisition
- Answer: model is complete junk, it's a hallucination machine. Overfit to reasoning benchmarks and has absolutely zero recall abilityIs the gpt-OSS stronger than qwen or kimi or Chinese open models?
- Wtf does thinking machines lab even do??BREAKING: Mira Murati's Thinking Machines Lab raised $2 billion at $10 billion valuation we are so back.
- O1-pro is pretty useless for research work. It runs for near 10 min per prompt and either 1) freezes, 2) didn't follow the instructions and returned some bs, or 3) just made some simple error in the middle that's hard to find. @OpenAI @sama @markchen90 refund me my $200
- Such bs. The majority of math majors or even math phds and faculty could not win a gold in imo.Replying to @GaryMarcusWhat most people don't realize is that IMO (and IOI, though to a different extent) aren't particularly hard. They're aimed at high schoolers, so anyone with decent uni education should be able to solve most of them.
- Canceled my chatgpt pro subscription
- Will be at ICML starting Wed. I am open to any offers of 100m+.
- Returning to the bay area after 9 years! Moving to UC Berkeley in statistics and eecs! It's been a great 6 years at Princeton, but I am so happy to be back! Finally there will be edible sushi!
- Proud to have not contributed to Gpt-oss.
- Our latest post explores on-policy distillation, a training approach that unites the error-correcting relevance of RL with the reward density of SFT. When training it for math reasoning and as an internal chat assistant, we find that on-policy distillation can outperform other
- All icml rejected!
- I know all 3. Will work for 99mSee below on what Zuckerberg is looking for in star recruits worth $100m pay packages for Meta’s plans in Artificial Intelligence. But weren’t some people saying calculus is no longer useful in the AI age? 🤔
