Viewkea

Inspiration

What inspired us was the magical concept of The Magic Brush — the ability to bring objects to life with just your imagination. We aimed to recreate this experience in a VR environment, allowing users to create and customize their own furniture and textures just by using their natural language. The goal was to provide a fully customizable workspace where creativity is limitless.

What it does

The project creates a god-like virtual room where users can speak naturally to summon and customize furniture. Simply describe what you want, and the system generates the 3D furniture and textures instantly. User can spawn furniture based on voice, especially used for preparation before visitingIKEA. This is a local multiplayer experience for your family to enjoy setting up your house and/or workspace.

How we built it

We built our system by: Tracing network requests from the web to understand how to structure our own Using voice input for real-time dictation to convert user prompts into usable commands Calling external APIs (Meshy) to generate 3D furniture models and custom textures Dynamically loading and applying those textures within the VR scene

Challenges we ran into

We used Meshy initially for a VR project but had to scrap it 8 hours before the hackathon because meta and unity and meshy, it did not have a good api. Long texture rendering times, especially when using high-resolution custom textures Complexity of API calls, including authentication, formatting, and real-time response handling Balancing performance and realism in a VR environment while keeping the experience seamless