Inspiration
There is so much to manage at home, but with our busy lives (and so much travel!) many responsibilities end up shifted to service providers such as pet sitters, cleaners, movers, home care aides, repair technicians, and house sitters. Instead of hoping your providers get the job done right, let's give them better, contextualized instructions and stop worrying if Fluffy gets the right treats or if your Monstera is overwatered.
What it does
Users will set anchors as points of interest for service providers, with notes telling them what they need to do. They can also create a task list to go through, which can be linked to created points. The service provider can then use this information for training in the space, and also while working for reminders.
How we built it
We made use of a variety of presence platform tools, such as spatial anchors for locking items to the room space and the MRUK room based spawning to randomize items based on classifications, in addition to scene mesh, hand tracking, and passthrough.
Challenges we ran into
The scene mesh still gets stuck on reflections. A flat floor sometimes has a bump which makes things appear like they are floating when using a collider with the scene mesh. It also has issues with larger spaces.
Accomplishments that we're proud of
We are very happy with the MRUK spawning capabilities while combining it with the voice SDK for voice recognition and generation.
What we learned
We learned how to make use of the MRUK spawner to do room object context based spawning, as well as how to make use of the scene mesh for a simplified occlusion system.
What's next for Home Care Helper
We plan on adding colocation for task assignment and collaboration. Spatial notes for recording movement and notes. A web/mobile app to assist. Lastly, a possible future AR Meta Ray Ban integration.
Log in or sign up for Devpost to join the conversation.