Coding is easy. It's the rest of it that's hard. We built VibeWrapper to simplify the workflow for common development tasks such as making Google searches, pushing code to GitHub, taking screenshots, and pulling up PDF and code files from your file system. VibeWrapper even removes API codes before pushing, which is integral for code security. To build it, we used Google's Gemini API, OpenAI's Whisper API, the Arduino IDE and Arduino Mega 2560 board, and Python.

One of the challenges we faced was having our LLM be deterministic enough to execute commands and determine workflow. Another challenge was creating a reliable connection between our Python scripts and our hardware. We wanted a physical pushbutton switch to trigger voice-activated workflows, which meant integrating Arduino code with our Python system.

We are excited to actually use what we built for DubHacks. Towards the end of the hackathon, our developers were using VibeWrapper to commit and push the final changes for VibeWrapper, and it worked phenomenally. With just the push of a button and a simple voice command, VibeWrapper can handle nearly anything within the developer workflow. Next, we want to expand the functionality of VibeWrapper to work for a wide variety of people and workflows. Additionally, we want to improve upon the hardware, implementing a dashboard for the user to see visually some things that are happening instead of simply having four HEX displays and a pushbutton.

Built With

Share this project:

Updates