Inspiration

Every house has a TV that is under-utilized. We would like to use this awesome screen in almost every home to elevate the voice assistant experience through augmented reality

What it does

It is a combination of a Kinnect and a voice assistant which is much more aware that current home devices. It further enhances the user experience and takes it to the next level at very affordable rate, with minimalist setup.

How we built it

We interfaced an Alexa echo dot with the raspberry pi connected with a PIR sensor and a camera, to achieve the voice interaction, AR module, and motion awareness to the DotAwareAR

Challenges we ran into

Learning to use Alexa skills. Gathering resources in limited time and interfacing three devices in three different systems into one aware system.

Accomplishments that we're proud of

We have successfully given personalized commands to echo dot and have learnt and implemented responses through AR.

What we learned

How to develop Alexa skills. Augmented Reality through JS. Building Polygons using Three.js

What's next for DotAwareAR

Having the camera follow the user using servo motors and motion sensing, implementing facial recognition for user specific queries and responses.

5 yo description

A system that adds a screen with interactive characters to the usual Alexa dot commands

peer description

It is a combination of a Kinnect and a voice assistant which is much more aware that current home devices. It further enhances the user experience and takes it to the next level at very affordable rate, with minimalist setup.

Senior Engineer Description

A combination of microcontroller, camera modules, echo dot, alexa skill APIs enhanced with Augmented reality JS modules that result in an enhanced voice assistant with an AR powered screen for expressiveness.

Built With

• alexa
• alexa-skills
• camera
• node.js
• python
• raspberry-pi