Count on us

Inspiration

Pill counters are a rarity in pharmacies because of how expensive they are. We came up the idea with using augmented reality to speed and and increase the quality and efficiency of pharmacist that work in retail that have to fill prescriptions.

What it does

It takes a picture of what the pharmacists is looking at (pills) and it identifies them and counts the amount of pills on the table.

How we built it

We used Microsoft's Hololens integrating it with custom vision. We trained a program with over 400 pictures that we took and labeled them manually respectively.

Challenges we ran into

It was very challenging to write a function that takes the live pictures and then send the image to Microsoft API.

What we learned

We learend how to train a machine learning algorithm and how to create an app for Hololens.

What's next for Count On Us

Right now we are only logging the number on the console in the future we would like to display it on the screen of the Hololens. Make the user experience better, add more pills to our databases and increase our algorithm accuracy. We also want tp be able to show live the pharmacist the amount of pills.

Built With

• c#