-
-
Patient sign-in portal
-
Doctor's AR perspective of patient, along with their medical info
Inspiration
During the pandemic, the onset of social distancing guidelines has shifted people’s ways of life and has encouraged the use of virtual meetings as a replacement for in-person interaction. A main issue is that medical appointments have become less accessible and it is difficult for doctors to interact and assist their patients. Medical practitioner have found it more difficult to “convey compassion” through a screen, hindering their performance and service. Using EchoAR as a platform to build AR apps, we have developed a project that will address the challenges in a post COVID-19 world.
What it does
Our application is designed to bring greater convenience to virtual doctor appointments. During an appointment, doctors will be able to view their patient utilizing augmented reality, and retrieve their profile information and medical history on the spot.
How I built it
Our MVP is built using EchoAR and Agora.io which leverages AR.js with Aframe which are JavaScript libraries used to create AR web experiences. Agora.io handles the live streaming of the video call while EchoAR is used to render the 3D models in the doctors view. The patient instantiates the appointment room from the broadcaster endpoint and the doctor is able to view both the patient, associated relevant medical information, and surroundings in one screen where the patients video is streamed for the doctor and patient to interact within their appointment
Challenges I ran into
The set up for unity took a long time (waiting for everything to install) so that set us back and made our work less efficient. We also ran into challenges when trying to integrate all the different platforms with each other and had issues with software versions and compatibility.
Accomplishments that I'm proud of
Learning to build an AR app for the first time was quite challenging since we have never worked on any sort of these platforms before. However, we were still able to end up with a cool project so it feels accomlishing!
What I learned
We learned about the applications of AR and how to leverage this technology for our project. Additionally, we learned a lot about the Unity, EchoAR, and Agora.io platforms.
What's next for Dr. App
The next steps we plan to take include expanding into hospitals, providing dual way video support, offering customization, and applying it to work training or instructional settings. As COVID-19 continues to trouble the medical industry, Dr. App will help alleviate the issues associated with virtual doctor appointments.
Log in or sign up for Devpost to join the conversation.