I am really excited to reveal what @GoogleDeepMind's Open Endedness Team has been up to 🚀. We introduce Genie 🧞, a foundation world model trained exclusively from Internet videos that can generate an endless variety of action-controllable 2D worlds given image prompts.
Harder, Better, Faster, Stronger, Real-time! We are excited to reveal Genie 3, our most capable real-time foundational world model. Fantastic cross-team effort led by @jparkerholder and @shlomifruchter. Below some interactive worlds and capabilities that were highlights for me
Like everyone else I am extremely excited and optimistic about AI progress. But since there seems to be the misconception that it is really easy to make predictions about the future for exponential trends (let's just draw lines on a log scale), this is a reminder that while
We're missing (at least one) major paradigm for LLM learning. Not sure what to call it, possibly it has a name - system prompt learning?
Pretraining is for knowledge.
Finetuning (SL/RL) is for habitual behavior.
Both of these involve a change in parameters but a lot of human
I am proud to announce the release of the NetHack Learning Environment (NLE)! NetHack is an extremely difficult procedurally-generated grid-world dungeon-crawl game that strikes a great balance between complexity and speed for single-agent reinforcement learning research. 1/
After seven years, I have returned to @DeepMind today 🔥 Excited about what lies ahead, and catching up with many old friends and new ones over the coming months!
I have published an introduction to Einstein summation (einsum) notation for Deep Learning. Einsum is the Swiss Army knife for all kinds of tensor operations. It is available in @TensorFlow and with v0.4 now also in @PyTorch.
rockt.github.com/2018/04/30/ein…