Inspiration
The project draws its inspiration from the enchanting world of Harry Potter, specifically the living paintings that add a magical touch to the walls of Hogwarts. This sparked the idea to transform mundane home assistants into something more interactive and lively. The goal was to make everyday interactions with technology not just functional but also entertaining, making our digital companions feel like a more integral and responsive part of our homes.
What it does
The essence of this project is to bring to life a collection of avatars, each with their unique theme, designed to either automate various household chores or provide a warm greeting. These avatars are not mere static figures; instead, they embody the concept of interactive assistants that can adapt and respond to the homeowner's presence and commands, making everyday tasks more engaging and enjoyable.
How we built it
The creation of this project involved the integration of several technologies and platforms. The graphical user interface was developed using Pygame, a choice that, while challenging due to our initial unfamiliarity, offered the flexibility we needed. Raspberry Pi devices were employed both for facial-detection and as screens to display our themed avatars. Laptops served a similar purpose, enhancing the project's accessibility and integration into the home environment. Communication with the motor and light was facilitated through Arduino boards, with serial communication bridging the gap between the Arduinos and Raspberry Pi's. A central server, established using Flask, played a pivotal role in orchestrating the interactions between the different components, ensuring a seamless experience.
Challenges we ran into
One of the primary hurdles we encountered was our lack of experience with Pygame. Venturing into uncharted territory was daunting, yet it was a deliberate choice to push the boundaries of our technical skills and explore new possibilities. This challenge was a testament to our commitment to innovation and our willingness to learn and adapt in the face of difficulties.
Accomplishments that we're proud of
Among the highlights of this project are the themes and the aesthetic appeal of our avatars. Crafting these characters with attention to detail and a keen sense of design was not only a creative endeavour but also a technical achievement. We are immensely proud of the personality and life we were able to infuse into each avatar, making them not just tools but companions within the home.
What we learned
This project was a profound learning experience, deepening our understanding of Pygame and familiarizing us with Flask for server management. We navigated the complexities of serial communication and message passing between various scripts and hardware components, gaining insights into the intricate dance of coordination required to bring our vision to life.
What's next for home buddies
Looking ahead, we are excited about the potential of leveraging Large Language Models (LLMs) to enhance the capabilities of our avatars. Our ambition is to evolve these Home Buddies into more general-purpose assistants, capable of undertaking a wider array of tasks and interactions. This next step will not only expand their utility but also bring us closer to a future where our homes are not just smart but also intuitively responsive and genuinely interactive.
Log in or sign up for Devpost to join the conversation.