Pinned
Joseph Suarez 🐡
9,528 posts
I build sane open-source RL tools. MIT PhD, creator of Neural MMO and founder of PufferAI. DM for business: non-LLM sim engineering, RL R&D, infra & support.
Joined March 2019
- I don't like courses. Most were a waste of time. Yes, even at Stanford. If you're new to ML, take CS231N.your honor i object, i dont know about harvard but stanford literally releases SOTA courses
- The world runs on TypeScript & JavaScript. Our bet is that AI engineering will follow suit. The growth in @aisdk downloads and adoption has been astonishing. When we wrote the Ship AI keynote it was at 3.4M weekly downloads. A couple weeks later, it’s now at 4.1M 😳
- You have to have been in ML for over a decade to really understand how bad this was. From 2015-2018ish, any time anything went wrong in an experiment, at least someone would say "local minimum"sent this to my dad this morning. It is really incredible how much you can learn today if you want to learn. There are no barriers except for yourself
- I don't care if Karpathy is down on RL. He, Carmack, Ilya, and Alec Radford could all show up in person to tell me I'm wasting my time and I'd still keep doing it. Because damn it this tech is too cool not to exist.
- Welcome to RL. If the pink curve overtakes the green curve, we'll have big news
- Whenever there's an Internet spike, it launches flechettes out of the roof
- If you ask me to do this I will 1) not be able to 2) assume you're a moron who tf remembers toy algos from CS101 with 0 application
- RL really sucks. It takes 10 hours just to learn breakout. ... a few years ago. It's <30 seconds on 1 GPU now in PufferLib and still dropping. Write faster code.
00:00 - PufferLib 3.0: We trained reinforcement learning agents on 1 Petabyte / 12,000 years of data with 1 server. Now you can, too! Our latest release includes algorithmic breakthroughs, massively faster training, and 10 new environments. Live demos on our site. Volume on for trailer!
00:00 - Accidentally said "you all are status obsessed hollywood wannabees" instead of "you're literally building the future bro" and they kicked me out of SF














