Richard Sutton (@RichardSSutton) / X

Richard Sutton

437 posts

Richard Sutton

@RichardSSutton

Student of mind and nature, libertarian, chess player, cancer survivor. @ Keen, UAlberta, Amii, Openmindresearch.org, The Royal Society, Turing Award

Edmonton, Alberta, Canada

Joined October 2010

Pinned
Richard Sutton
@RichardSSutton
Jul 20, 2023
AI researchers seek to understand intelligence well enough to create beings of greater intelligence than current humans. Reaching this profound intellectual milestone will enrich our economies and challenge our societal institutions. It will be unprecedented and
279K
Richard Sutton
@RichardSSutton
Jan 27, 2025
Free Palestine.
574K
Richard Sutton
@RichardSSutton
Nov 18, 2022
Stand with the people of Iran.
Richard Sutton
@RichardSSutton
Sep 26, 2025
Dwarkesh and I had a frank exchange of views. I hope we moved the conversation forward. Dwarkesh is a true gentleman.
Dwarkesh Patel
@dwarkesh_sp
Sep 26, 2025
.@RichardSSutton, father of reinforcement learning, doesn’t think LLMs are bitter-lesson-pilled. My steel man of Richard’s position: we need some new architecture to enable continual (on-the-job) learning. And if we have continual learning, we don't need a special training
00:00
655K
Richard Sutton
@RichardSSutton
Mar 5, 2025
awards.acm.org/about/2024-tur… Machines that learn from experience were explored by Alan Turing almost eighty years ago, which makes it particularly gratifying and humbling to receive an award in his name for reviving this essential but still nascent idea.
Andrew Barto and Richard Sutton are the recipients of the 2024 ACM A.M. Turing Award for developing...
From awards.acm.org
227K
Richard Sutton
@RichardSSutton
Feb 25, 2025
"What we want is a machine that can learn from experience." ---Alan Turing, 1947
112K
Richard Sutton
@RichardSSutton
Sep 1, 2025
My acceptance speech at the Turing award ceremony: Good evening ladies and gentlemen. The main idea of reinforcement learning is that a machine might discover what to do on its own, without being told, from its own experience, by trial and error. As far as I know, the first
183K
Richard Sutton
@RichardSSutton
Jul 5, 2025
It turns out the Turing Award is actually a silvery bowl from Tiffanys.
123K
Richard Sutton
@RichardSSutton
Dec 27, 2023
I've studied intelligence all my long life, yet still I feel I learned important things about intelligence by reading this book. Thank you, Max Bennett.
191K
Richard Sutton
@RichardSSutton
Jun 19, 2025
All the more so.
Sun
@BillySun28
Jun 19, 2025
Replying to @RichardSSutton
Dear Prof.Sutton, I recently bought one of your classic reinforcement learning book. But I would like to ask you, in the current era when deep reinforcement learning and large language models are prevalent, is it still necessary to read this book carefully?
148K
Richard Sutton
@RichardSSutton
Oct 22, 2025
Learning is the derivative of knowledge.
110K
Richard Sutton
@RichardSSutton
Mar 3, 2022
If you take all the fields that study intelligent decision making—from neuroscience to AI, psychology to control theory, economics to operations research—do their theories have much in common? I think so, as I explain in this new short paper: arxiv.org/pdf/2202.13252…
Richard Sutton
@RichardSSutton
Sep 3, 2025
Dwarkesh Patel is 100% right on this: AI's utility is very strongly dependent on continual learning. youtu.be/nyvmYnz6EAg?si…
435K
Richard Sutton
@RichardSSutton
Nov 24, 2024
The original RL algorithms, inspired by natural learning, were online and incremental—they were streaming in the sense that they learned from each increment of experience as it happened, then discarded it, never to be processed again. The streaming algorithms were simple and
Mohamed Elsayed
@mhmd_elsaye
Nov 22, 2024
Would you believe that deep RL can work without replay buffers, target networks, or batch updates? Our recent work gets deep RL agents to learn from a continuous stream of data one sample at a time without storing any sample. Joint work with @Gautham529 and @rupammahmood.
GIF
129K