Inspiration
I was inspired by a vibe coding workshop largely attended by non-developers.
We've been seeing an increasing number of non-developers adopt technical tooling like Cursor, often after using more accessible vibe coding tools like Bolt. Clippy for AI tools is an agent that works with users like an experienced colleague living in your browser. It's also helpful for developers new to AI-powered tooling to quickly ramp up.
What it does
It can see your screen and discuss what you're working on with you.
How we built it
It works like Cluely (the app that helps you cheat on technical interviews), but for learning.
Challenges we ran into
Voice activity detection (VAD) is hard to get right, especially for interruptions.
Accomplishments that we're proud of
When it works, it feels like a glimpse into AI-assisted onboarding at the operating system level.
What we learned
Dynamic conversation is tricky!
What's next for Clippy for AI tools
The codebase needs some love and attention. Latency can be reduced too.
Log in or sign up for Devpost to join the conversation.