Ping Path

Helping the visually impaired better navigate the world with LiDAR, machine learning, and spatial audio to increase independence, confidence, and safety for the visually impaired.

Comment 3

Inspiration

Grant and I wanted to explore new tech and make an innovative product that will impact people's lives.

What it does

PingPath pings pathways throughout one's surroundings to guide visually impaired people using LiDAR and machine learning. PingPath can guide the visually impaired to nearby objects such as a chair or other furniture, the nearest door (and detect if it's open), follow people such as a waiter at a restaurant, and detect general obstacles or hazards such as stairs. We also support devices without LiDAR by allowing users to load world data that were generated on a LiDAR device, which can be used by restaurants, universities, and other establishments to provide public maps to users so that more people are able to benefit from the app. Further, we implemented Siri shortcuts and tested voice-over for extra emphasis on accessibility. PingPath increases independence, confidence, and safety for the visually impaired.

How we built it

We built PingPath with countless hours of coding, research, and a few too many Dr. Peppers. We used Swift to develop the app with frameworks such as SwiftUI, RealityKit, RoomPlan, and CoreML, all of which include new features from Apple's WWDC. We also used Firebase Cloud Storage to give users the option to store and share the LiDAR world data they generate while using the app. Additionally, we spoke with visually impaired people to receive feedback on the idea and implement any features they desired.

Challenges we ran into

We had issues with persistence; for example, maintaining world data from device to device so users can map out the world around them for others to use who do not have a device with LiDAR.

Accomplishments that we're proud of

We are proud that we could create such a complex app in such little time—unlike our last hackathon, we stuck to our plan, and I think we executed it well!

What we learned

We learned to stick to our plan and adapt to problems, such as changing a feature if there's an issue.

What's next for Ping Path

PingPath is already in beta testing, and next, we plan to launch on the App Store. We plan to further develop our business model and eventually launch a startup.

Compatible Devices

Pro iPhones and iPads with a LiDAR sensor, all iPhones and iPads will be supported after the hackathon

Built With

Share this project:

Updates