dExtra Tools

Inspiration

We were inspired by the Dexterity demo so we decided to try and add additional functionality to the Dex extension.

What it does

We added three tools. The first tool is a working memory system for the Dex sidebar agent. The second tool is a planning agent that the LLM can talk to to further help the user accomplish a task. The final tool

How we built it

We built out MCP tools in the backend. If we needed a websocket action for the frontend which did not exist (i.e get_selected_text), Kevin (dex co-founder) would implement the action and update the extension.

Challenges we ran into

We only had access to the MCP server, not the extension code. Debugging was hard (initially), but it was also hard to make timely yet meaningful progress since we had to work around this.

Accomplishments that we're proud of

We are proud of learning how to work with an existing product instead of creating something from scratch. Dexterity is an incredibly interesting software and we enjoyed working on it!