Inspiration ✨
The inspiration for this project emerged from a dual perspective — one rooted in addressing challenges faced by individuals with disabilities and another aimed at improving overall efficiency in communication. From a disabled perspective, the goal was to alleviate the difficulties posed by manual inputs and limited physical abilities. The vision was to empower individuals through a voice-activated interface, ensuring inclusivity and accessibility in scheduling meetings and appointments.
What it does 🚀
Elysium, our innovative voice-activated calendar assistant, seamlessly integrates with Google Calendar and Telegram APIs to transform spoken commands into well-structured meeting invites using OpenAI GPT-3. It empowers users, especially those with disabilities, by providing a hands-free experience for scheduling appointments and meetings. Elysium's capabilities extend beyond individual scheduling, offering efficient mass communication applications for businesses and organizations. With features like asynchronous messaging, Markdown-like markup, and precise datetime calculations, Elysium redefines how users interact with their calendars, making scheduling intuitive, accessible, and inclusive.
How I built it 🛠️
The development of Elysium involved a collaborative and multidimensional approach, combining expertise in natural language processing, calendar integration, and voice-activated technology. The key steps in building Elysium are as follows:
Voice-Activated Interface:
- Leveraged the SpeechRecognition library to convert spoken commands into text, enabling a seamless voice-activated interface.
Natural Language Processing with GPT-3:
- Integrated OpenAI's GPT-3 language model to generate well-structured meeting invitations based on user inputs, enhancing the natural language processing capabilities.
Telegram Integration:
- Created a custom bot using Telegram's BotFather and utilized the python-telegram-bot library for programmatic messaging, enabling communication through the Telegram API.
Google Calendar Integration:
- Set up a Google Cloud Platform (GCP) project, enabled the Google Calendar API, and obtained API credentials for direct event creation in Google Calendar.
Asynchronous Messaging with Asyncio:
- Implemented asynchronous messaging using Python's asyncio module, allowing non-blocking message dispatch for efficient background operations.
Markdown-like Markup for Messages:
- Formatted messages using Telegram's Markdown-like markup language for visually appealing and structured content presentation.
Accessibility Considerations:
- Addressed accessibility challenges, particularly for individuals with disabilities, by emphasizing hands-free operation and exploring integration with Google's Speech to Text API for improved name interpretation.
Challenges I ran into 🧗
- Integrating multiple APIs, including Google Calendar and Telegram, necessitated addressing complexities in API communication and ensuring seamless interoperability.
What's next for ElysiumAI ⏳
Enhanced Language Processing: Continuously refine and expand language processing capabilities, particularly in interpreting specific names and diverse linguistic inputs.
Google's Speech to Text API Integration: Integrate Google's Speech to Text API to improve the system's ability to accurately interpret voice commands and enhance accessibility for users.
User Feedback Implementation: Gather user feedback and insights to refine user interface design, improve user experience, and address any additional challenges users may encounter.
Built With
- chatgpt
- google-calendar
- google-cloud
- openai
- pyaudio
- pycharm
- python
- speech
- speech-recognition
- speechapi
- telegram
Log in or sign up for Devpost to join the conversation.