Lyrique - " AI Song generator "

Main Page
Result Page

Inspiration

Music is a universal language, and we wanted to explore how AI can create personalized songs based on voice inputs. We were also inspired by the idea of integrating AR/VR to enhance the listening experience with immersive visuals. Our goal was to merge AI-generated music with interactive media arts, pushing the boundaries of mixed reality experiences.

What it does

Lyrique is an AI-powered song generator that creates music based on voice input. Users provide a prompt and voice and the system generates a complete song with lyrics and melody. The project also aims to incorporate AR music visualization to bring songs to life with dynamic sound waves, enhancing the interactive media experience.

How we built it

Frontend: Built using React.js for an intuitive and user-friendly interface.
Backend: Developed with Python (Flask/FastAPI) to process voice inputs and generate songs.
AI Integration: Used OpenAI's API for lyric and melody generation.
Hosting & Deployment: Leveraged Vercel for running backend services and hosting.
Version Control: Managed and collaborated through GitHub. AR Exploration: Attempted to integrate WebAR (8thWall / AR.js) for music visualization. Not successful

Challenges we ran into

Difficulty in fine-tuning AI to generate high-quality, coherent music. AR music visualization was challenging due to compatibility issues and technical limitations. Syncing voice inputs with generated song output in real-time. Ensuring a smooth user experience across different devices.

Accomplishments that we're proud of

Successfully integrating AI to generate songs based on voice input. Building a functional web application with seamless frontend-backend communication. Deploying the project on Vercel for easy access. Learning and experimenting with AR/VR for future enhancements.

What we learned

How to work with OpenAI's API for creative applications.
The complexities of real-time audio processing and AI-generated music.
The potential and limitations of WebAR for music visualization.
The importance of iterative testing and debugging in AI-driven projects.

What's next for Lyrique

Improving AI-generated melodies and lyrics for better coherence. Fully implementing AR music visualization for a more immersive experience.
Exploring new AI models for enhanced song production.
Expanding the project to support multiple genres and styles.
Advancing towards the Interactive Media Arts: Mixed Reality (AR/VR) track, refining our approach to creating dynamic user experiences that redefine innovation and revolutionize digital design solutions.