Inspiration

As many of us grow older, we have more and more memories we all want to cherish and relive again. Sometimes, its that random photo from the past your phone brings up tha fills you up with nostalgia from the past. Why not find an immersive way to relive that experience all over again using today's tech.

This is what our project ReLive set out to do allowing you to relive the experience of those nostalgic past photos in the form of a digital photo album of 360° immersive experiences through VR and Google cardboard mimicking a View-master like experience.

What it does

ReLive allows one to upload your precious nostalgic photos on to our web application. Our web application then takes those photos transforms those photos into a viewable 360 immersive VR viewer. Like a photo album, users can flip through pictures. However, unlike a photo album, users can their phone with the ReLive web app in Google Cardboard for an immersive nostalgic VR experience and ReLive those memories again today. In addition, like the classic View-Master, one can press the action button on the Cardboard viewer to flip through each photos and ReLive them one at a time.

Think photo album and viewmaster of the past meets the power of virtual reality and smartphones of today.

How we built it

Used barebones HTML, CSS and Javascript to build the website. Used Firebase to store user inputted images and the songs we are to play for each image. We then fetched these images and used a JS library (panolense.js) to convert the images into a panorama in order to give the 3d visual effect. We then made this compatible with Google Cartboard so that the user can view and relive the memeory/ image in VR right infront of them.

Challenges we ran into

The main challenge we faced was integrating everythig together. We were calling OpenAI's API for image captioning for sentiment analysis and passing that into Choere's API to give a song suggestion. We also had to get the image from the user and fetch it again. All this was being done in different envirnments and languages (API's in Jupyter Notebook) and the web app's backend in JS, so it was extremely challenging to put everything together (consideirng that we still are beginners!).

Accomplishments that we're proud of

Getting the project up and running, especially the full VR immersive expereince, as this was our first time dealing with this type of stuff, especially doing it on a website.

What we learned

We learned a lot of skills, like how to use Firebase, its access issues, backend development, VR, and API's.

What's next for ReLive

Changing the environment from a panorama to an actual 3d rendered model of the image for VR using Unity so that the expereince is more immerisive.

Built With

Share this project:

Updates