Happy to announce that the 3rd Embodied AI Workshop is happening on June 19th at #CVPR2022. Lots of exciting speakers and 13 (!!!) challenges. Check out our website (embodied-ai.org), dive into a challenge, and save the date!
Luca Weihs
330 posts
Luca Weihs
@LucaWeihs
Now part of @AnthropicAI. Prev: Co-Founder @ Vercept, RS @allen_ai; stat PhD @UW; math undergrad @UCBerkeley. All opinions my own.
Seattle, WA
Joined August 2019
- (New paper!) Do popular video understanding and embodied models have infant-level physical reasoning abilities? Not as far as we can tell Paper: openreview.net/pdf?id=9NjqD9i… Site: allenai.org/project/inflev…
Can an AI understand the physical world as well as an infant can? @LucaWeihs, @anikembhavi and their team introduce a new benchmark for developing AI with better physical-world reasoning - learn more about it on the AI2 blog: ai2.medium.com/be7fe1f13665 - After many fantastic years at Ai2, I am so excited to say I have started a new company with some of the most intelligent, driven, and joyful people I know: Kiana (@ehsanik), Ross (@inkynumbers), and Matt (@mattdeitke).🚨BREAKING: A mysterious virus is spreading. Unfortunately, Ross Girshick (@inkynumbers), @mattdeitke, @LucaWeihs, and I recently got infected. 🦠 This brain-targeting virus causes highly irrational behavior. Common symptoms include: 🛑 Quitting well-paying jobs 🛑 Leaving
- What can embodied AI agents learn from gameplay? Our #ICLR2021 paper (openreview.net/forum?id=UuchY…) shows that by playing hide-and-seek, agents learn representations rivaling (self-)supervised approaches. We test our agent's with a suite of tasks inspired by experiments for infants.
00:00 - Excited to see that our work on ProcTHOR has won a #NeurIPS2022 Outstanding Paper award! blog.neurips.cc/2022/11/21/ann… This was a team effort but a huge shout out to Matt Deitke who really drove the work (mattdeitke.com)!Biased but this is truly an incredible piece of work. Using ProcTHOR has really felt like the equivalent of moving from MNIST to ImageNet for Embodied AI. No longer do we have to choose between large+static or small+interactive envs. ProcTHOR: why not large+diverse+interactive?
- The 3rd Embodied-AI Workshop is being held @CVPR in just 3 days (June 19th, starting at 9am) we have 6 amazing invited speakers, a poster session, multiple Q&A panels, and lots of challenge results! See our website embodied-ai.org for our day-of timeline and more details
- This project changed the way I think about training robotic agents (>100k procedural ProcTHOR houses) + (40k annotated Objaverse assets) + (end2end imitation learning on millions of shortest path trajectories in sim) = An agent that works in the real world w/o fine-tuning.🚀 Imitating shortest paths in simulation enables effective navigation and manipulation in the real world. Our findings fly in the face of conventional wisdom! This is a big joint effort from PRIOR @allen_ai (6 first authors!). spoc-robot.github.io
00:00 - I'm thrilled to announce that our paper on Visual Room Rearrangement has been accepted as an oral to #CVPR2021! Paper: arxiv.org/abs/2103.16544 Website & Code: ai2thor.allenai.org/rearrangement/ Video: youtube.com/watch?v=1APxaO… M. Deike, @anikembhavi, @RoozbehMottaghi, @allen_ai, #AI2THOR
- Our SPOC codebase (#CVPR2024) is now open source 🎉! This includes everything you need to train a performant agent that transfers to the real world: 💾 IL training data, 🦾training code, and 🏃CHORES eval benchmark Code: github.com/allenai/spoc-r… Website: spoc-robot.github.io
- Join us tomorrow (June 18th) at the 5th Embodied AI workshop @CVPR! * Star-studded lineup of 6 exciting speakers (@anikembhavi, @brian_ichter, @rapideRobot, @SongShuran, @chris_j_paxton, @ericjang11) * 6 challenges * Invited panel, hosted by Ade Famoti embodied-ai.org
- Join us at the **5th** Embodied AI Workshop in Seattle on June 18 #CVPR2024 🔊 Exciting invited speakers, 🥷 6+ challenges (with cash prizes), 📋 poster session, and 👽 lots more! 📜Workshop paper submission details coming soon Website: embodied-ai.orgI'm happy to announce the fifth annual Embodied AI Workshop at CVPR! Our theme is open world embodied AI, and we'll have six speakers on how we can make that happen, and six challenges where approaches can prove that they can! #cvpr2024 #embodiedai embodied-ai.org
- Biased but this is truly an incredible piece of work. Using ProcTHOR has really felt like the equivalent of moving from MNIST to ImageNet for Embodied AI. No longer do we have to choose between large+static or small+interactive envs. ProcTHOR: why not large+diverse+interactive?Massive datasets have enabled many recent advancements in computer vision and NLP. ProcTHOR presents a platform to enable similar success stories in Robotics and Embodied AI in general. ProcTHOR website: procthor.allenai.org Details: arxiv.org/pdf/2206.06994…
- Loved working with Zaid as he led this exciting project at Ai2! LLM-based coding agents are remarkably capable when given well-grounded plans but generating such plans from arbitrarily large code-bases is extremely challenging to do efficiently, the solution: MutaGReP✨ Introducing MutaGReP (Mutation-guided Grounded Repository Plan Search) - an approach that uses LLM-guided tree search to find realizable plans that are grounded in a target codebase without executing any code! Ever wanted to provide an entire repo containing 100s of 1000s of
00:00 - The Embodied-AI Workshop @ #CVPR2021 is happening tomorrow (June 20th). We have 8 fantastic speakers, 3 live Q&A panels, and results from 10(!) challenges. More details on our webpage: embodied-ai.org. A live stream of the workshop will run at youtu.be/fz40rCEuM8I
