Health Receipt

Nutrition and Eco score for a food item
Information about the scores and references
Home - Gives a recipe recommendation based on order history
Order History
Scanning a new Receipt
Items Identified by OCR
Account Settings

Inspiration and Beginning

The journey of developing our food transparency app began with a simple yet powerful idea: to empower consumers with the knowledge they need to make informed decisions about the food they buy and consume. Inspired by the vision of Open Food Facts, we were driven by the belief that everyone should have access to transparent information about the products they consume daily. This vision resonated deeply with our team, igniting a passion to contribute to a more transparent and sustainable food system.

What it does

Health Receipt is a revolutionary app designed to provide consumers with comprehensive information about the food products they purchase. Its core functionalities include:

OCR-Based Receipt Scanning: Using optical character recognition (OCR) technology, Health Receipt scans grocery store receipts to extract detailed information about the food items listed.
Nutrition Information: The app retrieves nutrition facts for each scanned product, including calorie count, macronutrient breakdown, and ingredient list.
Eco-Scores and Packaging Information: Health Receipt evaluates the environmental impact of each product by analyzing packaging materials and carbon footprint, providing users with eco-scores to guide sustainable purchasing decisions.
Allergen Warnings: The app identifies potential allergens present in scanned products, helping users with dietary restrictions make safe choices.
Recipe Creation: Health Receipt offers a unique feature that allows users to generate recipes based on the ingredients scanned from their receipts, promoting creative and healthy meal planning.

How we built it

Typescript: We chose TypeScript for its strong typing system and scalability, enabling us to write cleaner and more maintainable code.
Bun: The backend of Health Receipt is powered by Bun, providing a fast and efficient server environment for processing user requests and handling data.
npm: We utilized npm, the package manager for JavaScript, to integrate various libraries and dependencies into our project, streamlining development and ensuring compatibility.
Convex: Leveraging the Convex framework, we implemented features such as text search, server functions, and real-time updates, enhancing the performance and functionality of our app's backend.
Google Vision API: For OCR functionality, we integrated the Google Vision API, which enabled us to extract text data from grocery store receipts with high accuracy and reliability.
Together AI: Collaborating with Together AI, we incorporated innovative features like recipe creation into Health Receipt, enriching the user experience and adding value to the app.

Challenges we ran into

Throughout the hackathon, we encountered numerous challenges that tested our perseverance and problem-solving skills. From overcoming technical hurdles to refining user interfaces for optimal usability, each obstacle presented an opportunity for growth and innovation. One of our significant challenges was ensuring the accuracy and reliability of OCR data extraction, requiring meticulous fine-tuning and validation processes.

With each hurdle overcame, we emerged stronger and more resilient, fueled by our passion for catalyzing positive change in the food industry.

Accomplishments that we're proud of

Our integration with the Open Food Facts database has enabled us to contribute to the broader movement for food transparency. By leveraging this vast repository of product data, we're facilitating greater transparency and accountability within the food industry.

What we learned

Through the development of Health Receipt, we gained invaluable insights into the importance of teamwork and collaboration. Our team dynamics played a crucial role in driving the project forward, with each member contributing their unique strengths and expertise. We learned to leverage individual strengths to overcome challenges and capitalize on opportunities, fostering a supportive and cohesive working environment. Additionally, we became more attuned to recognizing and addressing our team's weaknesses, embracing a culture of continuous improvement and open communication. Ultimately, our journey with Health Receipt reinforced the significance of teamwork in achieving shared goals and delivering impactful solutions to real-world problems.