Inspiration
As a group of skincare enthusiasts, our inspiration came with the shared experience of spending lots of money on skincare, just to not use it if it it didn't match well with our skin. With SkinSync, it is not only helpful for users that are shopping and on the go, but it also allows people to efficiently find skincare that is right for them in a cost-effective way.
What it does
SkinSync is an app for on-the-go help for users to decide if their current skincare product is right for them. For first time users, SkinSync will ask users a variety of questions asking about their skin type and will save this information. The main functionality of SkinSync is object detection where users can scan the current skincare product. We extract the text presented in an uploaded picture of a skincare product and analyze the product's ingredients with their saved skin type to see if this product is compatible with the user's skin type.
How we built it
For our backend, we built our database storing user information and preferences utilizing Firestore and Firebase. We also utilized Tesseract OCR packages for text extraction and OpenAI for ingredient analysis. Our front end consisted of utilizing Typescript and React components.
Challenges we ran into
Some challenges we ran into is utilizing the object detection and connecting our website with OpenAI
Accomplishments that we're proud of
Accomplishments we are proud of is successfully implementing Tesseract OCR packages and incorporating that into various interactive modals throughout the website.
What we learned
Through this project we learned how flexible an app must be for it to accommodate to most users. Especially in the realm of skincare, which is different for individual, we had to learn and make design decisions to keep this website functional and useful.
What's next for SkinSync
Currently SkinSync is a web-application and we would like to deploy it as a mobile app. Although many users do shop online these days, we would also like to make an app version for users on the go. Another thing we would like to implement for SkinSync is to create more personalized user questions that is catered to acne and wrinkles to broaden our target audience.
Built With
- firebase
- firestore
- react
- typescript
Log in or sign up for Devpost to join the conversation.