Inspiration
I've always wanted an assistant for when reading research papers or when starting cool projects on github. This is the solution, for now.
What it does
Personal assistant for projects and research papers.
Allows you to upload an image and get a response associated to a question for that image, as well as just upload a regular question.
How we built it
Using the power of Cohere's classify endpoint as well as the chat beta, and with the power of openAI's CLIP, you can get very accurate responses driven by immage understanding and prompt intent. All this with the addition of citations from sources found. All citations from cohere are augmented with metaphor's search API which brings a great addition of powerful resources to leverage
Challenges we ran into
Frontend development and some search errors at first.
Accomplishments that we're proud of
A fully functional app!
What we learned
Learned alot about many aspects of the Cohere developer API.
What's next for CogniLeap
Make a better frontend and extrapolate to more applications!
Log in or sign up for Devpost to join the conversation.