Inspiration
We're data engineers! We've been building agentic AI for big data the past few months, recently shipping a tool called Captain! (runcaptain.com).
We've thus far assembled an amazing distributed agentic swarm approach for providing reliable results across BIG DATA. We know that tools like Snowflake and Databricks have been major players and market capturers in this space. That is why we aim to reliably work and coexist with both Data Warehouse platforms and handle search reliably. 📊
This time, we decided we'd try building out an intelligent integration with Snowflake by building a tool called Snowcone! 🍧
What it does
Snowcone🍧is an MCP-based agent platform, specializing in visualizing and deriving meaning from a Snowflake Data Warehouse. That means we handle:
- Standard Chat, Retrieval, and Generative Querying for Search w/ Follow up
- An MCP server for high-quality, D3Js visualizations (100+ beautiful graphs and charts)
- Intelligent, infinite drill down in structured data at high speeds
How we built it
This was technically challenging!!
For front-end: NextJs, D3Js, V0
For backend and infrastructure: We used FastAPI MCP, by tadata, Snowflake with a sample dataset containing Sales Information for a small enterprise, Claude for generative querying and agentic tool calling. We have an automated, self replenishing architecture on AWS using Lambdas to replenish a pool of EC2s occupied by potential users, Snowflake running on a US West-2 Deployment, communication using Boto3 for automation and communication between the backend and the AWS account.
Challenges we ran into
Consistency in responses, AWS IAM roles affecting Lambda automations, tool call errors (Claude hallucinates on occasion), but we properly guardrailed against this.
Accomplishments that we're proud of
We're proud that we assembled a highly intelligent agentic workflow for Snowflake tool calls! In under 12 hours we've built robust tooling around SQL data structures in a Snowflake environment. This is going to help us when we're working with Snowflake in the industry.
What's next for Snowcone
We can now offer this tooling on our own platform that we're building here in SF! Snowcone is going to be used by our current user base for our platform runcaptain.com. This will allow for a Snowflake integration to be the first outside integration available on our platform!🥳
Built With
- amazon-web-services
- boto3
- claude
- d3.js
- ec2
- eventbridge
- fastapi
- lambda
- mcp
- python
- snowflake
Log in or sign up for Devpost to join the conversation.