Logo
Tech Stack
Benefits

ChatBrains: Voice-Based Mobile IDE for Developers

Inspiration

The inspiration for ChatBrains came from the increasing need for flexibility in coding workflows. Many developers find themselves brimming with ideas or wasting time while away from their desk. We wanted to create a tool that brings the power of a desktop IDE to mobile devices, enabling developers to stay productive on the go. Combining voice interaction with seamless syncing to JetBrains products felt like the perfect solution to bridge this gap.

What it does

ChatBrains is a voice-driven mobile IDE that allows developers to work on their codebase through natural language. It enables users to:

Conceptualize ideas and translate them into code using voice commands.
Working on their issues on the go.
Finishing the tasks back at the desk on their familiar IntelliJ IDE

How we built it

Frontend: Built with Kotlin Compose Multiplatform, ensuring a smooth and consistent UI across iOS and Android.
Backend: Developed in TypeScript, log in via GitHub, and interact with your issues and code using our AI-Agents implemented in LangChain for efficient coding on the go.
AI Processing: Leveraging OpenAI's APIs for understanding natural language and generating intelligent code responses, enhanced by smart RAG Retrieval of your code and issues.
Integration: Enable you to seamlessly continue developing on your branches switching between mobile & desktop.

Challenges we ran into

AI Agents: Develop a smart AI that is aware of the code but not killed through context limits. Making smart recommendations and actually helping to code.
Voice interaction: We wanted to use Realtime API from OpenAI, but as it's still in Beta and lacking Documentation, we went the traditional route with Transcribing, Text Generation, and Text2Speech.
JetBrains Integration: First time doing it.
Kotlin Multiplatform: Starting difficulties (Gradle issues), using Native tools (Microphone)

Accomplishments that we're proud of

Successfully enabling voice-driven coding on mobile devices.
Creating an intuitive and developer-friendly UI for mobile coding workflows.
Implementing 3 big independent code pieces and seeing them come together in a flawless End-to-end experience between mobile and desktop.

What we learned

The potential of voice-driven workflows in boosting productivity for developers.
Kotlin Compose Multiplatform
Voice-based interaction with OpenAI.
Langchain/Langgraph AI Agents
Building a JetBrains Tool integration