Memorify

Inspiration

Our hackathon project was inspired by the incredible pattern recognition capabilities and visual literacy inherent in human cognition. We decided to combine the nostalgia of a photo album with the practicality of a Rolodex, enhanced by the magic of AI.

What it does

The system receives a journal entry and contact details for individuals mentioned in the entry from the user. It subsequently generates a contact book containing the contact information for each person referenced in the entry, accompanied by a personalized avatar. Users have the option to select avatars from The Simpsons, Marvel, or Looney Tunes, based on the personality of each contact. With each new journal entry, the contact book grows, including details of mentioned individuals. Users can easily access a consolidated view of all entries featuring a specific contact, providing a comprehensive overview of interactions.

How we built it

We utilized React and Tailwind CSS for the frontend designed initially on Figma and used Django and Kintone at the backend. We used Cohere's Generate API endpoint to analyze a journal entry. Firstly, it suggests a suitable title for the entry. Next, it identifies people mentioned in the entry along with their associated personality traits and characteristics. After obtaining this information, the app inputs final details such as contact information for each character using rolodex functionality. Users can choose from three pre-set art styles for the visuals they want to generate for the characters, aiming for a nostalgic feel.

Upon submission, Midjourney AI is employed to create a unique cartoon avatar for each person. In addition to this, the app enhances the visuals to more accurately represent the personalities and traits of the characters. Overall, the app transforms textual descriptions into engaging visuals, including personalized cartoon avatars and visual representations of each character's traits.

Challenges we ran into

Despite numerous attempts, our initial concept proved impractical to execute, prompting us to undertake a significant pivot and move in a slightly different direction.

Accomplishments that we're proud of

Integrated a wide variety of APIs: kintone, cohere, midjourney
Created aesthetically appealing UI that reinvented a rolodex in a fun and imaginative way using the power of AI
Captured the sentiment of nostalgia by incorporating memories into avatars

What we learned

Implementing the Cohere API
Using Kintone to simplify files upload and download
how to adapt to the rapid pace of hackathons when developing

What's next for Memorify

Implement a search feature to loop up contacts based on hobbies, passions and personalities. This was already implemented at backend using cohere's re-rank endpoint and we would like to see it in live action!
Optimising image generation using multithreading!