Inspiration
We've all been there: it's your turn to check through TSA and suddenly you have your durian (!!) confiscated from you! Not only is it difficult for travelers to keep track of the legality of all their items in the midst of chaotic travel plans, but the TSA also still relies only on human verification to detect hazardous luggage. In fact, investigations have found that the TSA misses more than 70% of knifes, guns, and explosives that app through our airports. Travel Safe solves both these issues to help passengers pack and make air transportation safer for everyone.
What it does
Travel Safe uses a virtual reality headset and object detection to create a mixed-reality experience, giving users real-time information on luggage items. By using video streaming from the headset along with a custom trained computer vision model, Travel Safe helps users locate any hazardous or illegal items with just one look.
How we built it
On the headset, the augmented reality was designed using C# and Unity. On the backend, the computer vision model was trained in Python with YoloV8 and the video processing is handled through JavaScript websocket connections.
Challenges we ran into
Working with virtual reality proved to be our largest challenge due to the added level of complexity from working with the Meta Quest's video feed and having to display bounding boxes real-time in augmented reality. This required us to required us to create workarounds for grabbing the Quest's video feed and learn a lot about 3D development in Unity.
Accomplishments that we're proud of
For all of out team, this was the first time we worked with developing for VR and using the Meta Quest. However, we are proud that we were able to create a product that demonstrates the incredible capabilities of virtual reality in assisting with human tasks.
What's next for Travel Safe
In the future, we look to continue improving Travel Safe by enhancing its object detection model with an even larger dataset and also extending its applicability beyond just aviation.
Log in or sign up for Devpost to join the conversation.