Proto AI

• 

  Generates Visuals Proactively based on what's on your screen

• 

  Proactive Notifications

• 

  Proactively gives feedback

• 

  Search using sources

• 

• 

  Data Visualization

• 

• 

• 

• 

  Searches Web (Prompt: What's going on in the world?)

• 

• 

  Calendar from Outlook Proactively

• 

  Search

Try Proto AI at https://proto.calcgpt.ai

https://docs.google.com/presentation/d/1VzCq7_KtYxBfATGOOVQ2wpsm8mVAof0o1AswxKRylBM/edit?usp=sharing

What it does

Proto AI is a proactive AI agent that watches your screen continuously and intelligently suggest feedback, generate graphs, visuals, games, and animations, and search the internet for answers.

How we built it

We built it using Python FastAPI, native HTML, and deployed using Google Cloud Run.

Challenges we ran into

The biggest challenge was prompting to ensure the AI intelligently suggested feedback based on the limited context.

Accomplishments that we're proud of

We are proud that it works!

What we learned

We learned that effective prompting is key to LLM powered apps.

What's next for Proto AI

We want to implement these features:

• Give the AI a web browser to do things autonomously, proactively in the background.
• Desktop app.
• Add planning, memories, and better visuals.

Built With

• fastapi
• gemini
• google-cloud
• html
• python