Nothing beats the adrenaline rush of debugging numerics on a job as big as GPT4.5. It was an honor to work on this project with such talented teammates!
it's very hard to get the math and ML right on a run as big as GPT-4.5, and requires difficult work at the intersection of ML and systems.
@ColinWei11 , Yujia Jin, and @MikhailPavlov5 did excellent work to make this happen!