user avatar
Dustin Tran
@dustinvtran
post-training lead at xAI. ex-google
San Francisco, CA
Joined June 2013
Posts
  • Pinned
    user avatar
    We are hiring & rapidly grow post-training at xAI! The team is at the frontier of RLHF, agents, and reasoning efficiency—in just a few months, we climbed from nothing to #2-3 @arena, #1 Search Arena & other tool use benchmarks, #1-2 in creative writing, and are Pareto-optimal on
  • user avatar
    I departed Google DeepMind after 8 years. So many fond memories—from early foundational papers in Google Brain (w/ @NoamShazeer @ashVaswani @lukaszkaiser on Image Transformer, Tensor2Tensor, Mesh TensorFlow) to lead Gemini posttraining evals to catch up & launch in 100 days, then
  • user avatar
    2023 has already seen more advances in AI than any other year. This velocity will only increase
  • user avatar
    My favorite oxymoron in machine learning: "empirically proven".
  • user avatar
    I'm so appreciative that ML is at a state where open-source code, freely available conference videos/proceedings, and now even open reviews are becoming the norm. That's not a luxury all research fields have.
  • user avatar
    "Simple, Distributed, and Accelerated Probabilistic Programming". The #NIPS2018 paper for Edward2. Scaling probabilistic programs to 512 TPUv2 cores and 100+ million parameter models. arxiv.org/abs/1811.02091 github.com/google-researc…
  • user avatar
    Videos are now available for the 2017 Deep Learning (and RL) Summer Schools in Montreal
  • user avatar
    Grok4 Fast maximizing intelligence density.
  • user avatar
    Recap of the trendiest conversation topic at NeurIPS in the past 7 years 2015: Bayes / RL / OpenAI 2016: Deep RL & Autoregressive generative models 2017: "DL is alchemy" 2018: Glow & Neural ODEs 2019: Understanding DL 2020: GPT-3 2021: people had conversations..? 2022: ChatGPT
  • user avatar
    Starting today, I am at Google full-time as a Research Scientist. See everyone in the Bay Area!
  • user avatar
    Speaking of interesting facts from analyzing conferences: Google is 3-10x the size of any other AI research lab. That's not even including DeepMind which ranks 3rd.
  • user avatar
    What gripes do you have with LaTeX's default, and what you always add to papers? Here are mine: 1. Cleveref. Don't use "Section \ref{sec:intro}". Use \Cref{sec:intro}. This makes writing less error prone and it makes "Section" part of the hyperlink!
  • user avatar
    Excited to introduce TensorFlow Probability. Official tools for probabilistic reasoning and statistical analysis in the TF ecosystem.
    Introducing TensorFlow Probability: empowering ML researchers and practitioners to build sophisticated models quickly, leveraging state-of-the-art hardware Read about it on the TensorFlow blog ↓ goo.gl/1CQtU2
  • user avatar
    It’s surprising that in 2022, there remains little movement away from LaTeX toward a new language. It has some of the most unintuitive designs and syntax you’d expect in a language today.