Philipp Wu (@philippswu) / X

Philipp Wu

461 posts

Philipp Wu

@philippswu

PhD @Berkeley_AI advised by @pabbeel. Previously @MetaAI @covariantai.

Berkeley, CA

Joined November 2018

Pinned
Philipp Wu
@philippswu
Sep 25, 2023
🎉Excited to share a fun little hardware project we’ve been working on. GELLO is an intuitive and low cost teleoperation device for robot arms that costs less than $300. We've seen the importance of data quality in imitation learning. Our goal is to make this more accessible 1/n
00:00
162K
Philipp Wu
@philippswu
Apr 28, 2023
Introducing Masked Trajectory Modeling (MTM), a new general-purpose framework for sequential decision making. A single transformer trained with MTM can exhibit multiple capabilities by simply choosing different masking patterns at inference time. Accepted at ICML 2023. 🧵👇
00:00
93K
Philipp Wu
@philippswu
Sep 2, 2024
Really nice article from @EricJang about actuators in robotics. Great to see @1x_tech place such an emphasis on design. Safety through compliance and backdrivability were some of the core themes behind our BLUE project back in the day (berkeleyopenrobotics.github.io). Some thoughts 👇
Eric Jang
@ericjang11
Sep 1, 2024
Two robot arms move at the same speed, driven by different actuators with the same mass. The first arm collides with a table with a gentle tap. The second arm collides with the table, destroying both arm and table. Read this blog post to see why! 🦾💥 evjang.com/2024/08/31/mot…
59K
Philipp Wu
@philippswu
Feb 10, 2023
In Daydreamer, we found it helpful to protect the robot in situations like this👇. Sharing the turtle shell I designed and hope it will be useful to other researchers! github.com/wuphilipp/robo…
00:00
31K
Philipp Wu
@philippswu
May 8, 2024
New work with @YideShentu! We present Latent Code as Bridges🌉 or LCB. We leverage LLMs for robotics by finetuning the LLM to output latent embeddings to control the lower level policy. This hierarchical approach enables end2end training while maintaining the advantages of LLMs!
00:00
21K
Philipp Wu
@philippswu
Nov 6, 2023
We have released the hardware files and instructions for GELLO 🦾! See the updated website wuphilipp.github.io/gello_site/. Here's a video of me assembling it start to finish in 30 min! GELLO is also at CoRL this week, see 👇 for details
00:00
32K
Philipp Wu
@philippswu
Jun 29, 2022
Excited to share our paper DayDreamer! We test the Dreamer algorithm on 4 robots and learn from scratch with no simulators. Really enjoyed collaborating with @AleEscontrela and @danijarh to make this a reality. Thanks to @Ken_Goldberg and @pabbeel for their guidence and support!
Danijar Hafner
@danijarh
Jun 29, 2022
A dream come true! We introduce DayDreamer, where we apply world models for fast end-to-end learning on 4 physical robots, without simulators. We learn quadruped walking from scratch in 1 hour. We also learn to pick & place balls directly from pixels and sparse rewards 🤖🌏👇
GIF
Philipp Wu
@philippswu
Oct 15, 2024
Remote teleop with haptic force feedback being showcased at IROS during Oussama’s keynote talk! Live demo of a robot ultrasound reading in California from a human operator in UAE!
00:00
5.7K
Philipp Wu
@philippswu
Nov 13, 2023
We have also released the code for GELLO: Please see github.com/wuphilipp/gell…. Please share if you make and use GELLO in your own projects! Contributions are welcome and appreciated!
Philipp Wu
@philippswu
Nov 6, 2023
We have released the hardware files and instructions for GELLO 🦾! See the updated website wuphilipp.github.io/gello_site/. Here's a video of me assembling it start to finish in 30 min! GELLO is also at CoRL this week, see 👇 for details
00:00
GitHub - wuphilipp/gello_software
From github.com
12K
Philipp Wu
@philippswu
Mar 7, 2024
A new arm has been added to the GELLO family by @a_dob 🎉! This GELLO is designed for the AR4, by Annin Robotics (anninrobotics.com), a low cost desktop sized robot you can build yourself! Seems like a fun option to explore for researchers and hackers!
4.2K
Philipp Wu
@philippswu
Oct 14, 2024
At IROS 2024 in amazing Abu Dhabi! Will be presenting LCB and GELLO. Details in 🧵
6.7K
Philipp Wu
@philippswu
Sep 25, 2023
Replying to @philippswu
We can also use GELLO for fine-grained manipulation tasks like extracting some floss. 11/n
00:00
16K
Philipp Wu
@philippswu
Aug 9, 2024
Heading to the @RL_Conference to present our work Semi-Supervised One Shot Imitation Learning 🏹 More details below! Looking forward to catching up and chatting with old friends and new, let me know if you’re around! #RLC2024
9.4K
Philipp Wu
@philippswu
Jul 18, 2022
Our recent work, DayDreamer, is featured on MIT @techreview! Really happy to see the excitement around robot learning on hardware! w/ @AleEscontrela @danijarh @pabbeel @Ken_Goldberg
technologyreview.com
This robot dog just taught itself to walk
AI could help robots learn new skills and adapt to the real world quickly.