RoboResin

Home Diagnostic Dashboard
Fleet Task Generator
Robot 3D Viewer

Inspiration

Star Wars Droids

Problem Statement

Robots are revolutionizing the world. Organiziations will soon need to orchestrate and monitor large robotic fleets with different models and capabilities.

What it does

RoboResin is a platform that provides a suite of RoboOps tools. Our star feature is the ability to orchestrate a fleet of any number of robots. In fact, all of our code is super modular and extensible. Further, we provide real-time monitoring funcionality.

How we built it

The robotic orchestration is powered by an LLM with MCP. Essentially, a user gives their prompt on what they want the robotic fleet to do. Then, all the robots' sensor information, including camera image, past state information, and the goal is fed into an LLM (Claud 4 Sonnet) once every second. The model executes tools command as per our spec, issuing no or a command to each robot for them to run over the next 1 second cycle. After a goal state is detected, the orchestration ends.

Throughout this process, we rely on the RURL (RoboResin Universal Robot Language) with defining a robot's capabilities using config.json, accepting commands, providing diagnostic and camera information, etc. The RURL standard we propose seeks to standardize robot interfacing.

Challenges we ran into

Hardware, Hardware, Hardware. From swapping faulty cameras, to flashing microSSD's >10 times, robot repair, and writing up the RURL API for each robot, we spent a lot of time fixing the Hardware.

This is a large distributed project with many, many moving pieces, and we had to diagnose embedded software, network proxy's, multi-modal prompting (cohere has no model with image + MCP tools together, they should mention that!),

Accomplishments that we're proud of

Delivering a solid and polished product that is creative.

What we learned

A lot. From working with robots, to desiging the RURL standard, to booting up raspberry PI's, working with sensors like GPS, making a livestream feed, and more!

What's next for RoboResin

Take this to the next level. This project is an MVP, showcasing the possibilities. Enterprise-grade RoboResin needs to come; imagine a firefighting scene, with drones whizzing by, spot robots jumping through obstables, and large humanoids clearing debris, all while as a hive-mind to rescue survivors. There is a lot to solve in Robotic software, and the biggest challenge is the platform to glue them all together, and that's where you'll find RoboResin.