Grocery Vision

Forgot your grocery list? See items you need to buy through the eyes of a camera when you're away from home

Comment

Inspiration

Have you ever been in a situation where you forgot what's in your fridge while you go shopping for groceries? Well, worry no more, because with Grocery Vision, you can quickly see what's currently in your fridge and what groceries you need to buy!

What it does

Every time when a fridge door opens and closes, images are taken of the items available in the fridge. Using image recognition, a list of items available and missing in the fridge is generated and provided to the user in an app.

How we built it

  • Light sensor: Senses when the fridge light is on or off, which is when the contents of the fridge might change
  • M5Cam: Takes images of the items in the fridge
  • Google Cloud Vision API: Recognizes items in the fridge and stores the list in the cloud
  • Domain.com: The user can see the list in an app (http://groceryvision.tech/)

Challenges we ran into

The biggest challenge is definitely getting the hardware to set up. Some of the hardware equipment ran out, so we had to come up with alternative replacements.

Accomplishments that we're proud of

Getting the Cloud Vision API to produce a list of items in an image.

What we learned

  • How to overcome the challenge of successfully setting up hardware
  • How to set up APIs using Google Cloud

What's next for Grocery Vision

  • Sort the food items into different categories
  • Connect the different components of the project together

Built With

Share this project:

Updates