echotour

Logo
Logo
Starting screen

Note that the SSL certificate may not yet be active at time of viewing, so in that case you will have to access the site at http. Also, make sure that you enable access to your microphone.

How to use

Click play to start the experience.
After the prompt, click the microphone to dictate. (Currently the only valid location is "Lafferre") 2.5. If dictation is interpreted incorrectly, you must dictate again by clicking the microphone.
Once dictation is confirmed, your physical position will be communicted and further choices will be prompted that you can choose from. Repeat step 3 as long as you'd like the tour to continue. You can dictate "leave" at any time to quit the experience.

Inspiration

We were inspired to create an innovation with maps and help with the lack of tools for those with disabilities. Also that, when there are tools, they aren't always straightforward to use. Specifically, we wanted to make a solution for the visually impaired and provide them with an experience that will help them be independent and safe.

What it does

Gives the user a guided audio tour using speech recognition and text-to-speech.

How we built it

We created a web application with JavaScript, HTML, CSS, and the Web Speech API based on AI. We utilized a linked data structure to simulate a graph to represent the space and used directional logic to keep track of the correct steps of the tour.

Challenges we ran into

Implementing the Web Speech API due to its inherent asynchronous nature
Managing the current value and reference of nodes as we traversed the graph

Accomplishments that we're proud of

Successfully implementing the Web Speech API
Successful traversal of the graph with directionality maintained
Creating a friendly and easy-to-use UI
Correctly mapping out the first floor of Lafferre Hall into a graph (because Lafferre is a maze)

What we learned

How to effectively implement speech recognition and text-to-speech
Distributing roles effectively and delegating work
How to leverage certain JavaScript functions and event-driven programming
How the Document Object Model works in more detail

What's next for echotour

The possibilities for echotour are extensive. Not only could it be used to map out any location or space, but it could also be used for other purposes like games for the visually impaired or memory-based strategy games for anyone to play locally or with others. Furthermore, we want to find ways to integrate it with what's already out there, like visual tours, museum tours, art gallery tours, etc and to make it generally more accessible to all people, with or without disabilities.