Glance

Filter videos for your children with a glance and be at ease of the content they are watching.

Comment

Inspiration

Many parents have concerns about what content their children are watching on YouTube. We created Glance to aid parents in checking age appropriateness of content for their children. Our aim is to allow parents to filter content with ease.

What it does

The web app takes in a youtube video from the user and generates a summary of the transcript. Any sensitive content: threatening language, insults, obscenities, identity-based hate, or sexually explicit language are highlighted in red in the generated transcript. Parents can then look at the generated report at a glance to see if they want to allow their children to watch the video.

How we built it

The web application was designed with Figma and built with React and Ant Design on the frontend, and with nodejs and express on the backend. The web app takes in a youtube url and sends it to the backend for processing.

These are the steps taking place in the backend.

  1. The youtube link is first checked in the cache (through Redis) to see if a response exists.
  2. If not, the youtube video is downloaded on the server.
  3. The video is then converted to another audio format.
  4. The video is then transcribed using Microsoft Azure AI
  5. The transcript is then filtered by a toxicity model (powered by tensor flow) to check for harmful sentences in the transcript.
  6. A summary of the transcript is generated using cohere.
  7. The summary along with toxicity status of each sentence in the transcript is sent to the frontend.

Throughout the entire process, socket.io is used to give updates about what stage the backend is on the frontend.

Challenges we ran into

Had trouble converting the video into an audio format that could be used by Microsoft's Azure api. We had trouble get Redis on a team member's pc.

Accomplishments that we're proud of

Executing on our goal of providing a useful application to empower parents and protect children was a true reward in and of itself.

What we learned

We learned a lot about collaboration, the way these different technologies come together and working as a team in a fast paced environment.

What's next for Glance

  • Creating a mobile app for Glance
  • Improving report functionality to make Useful data even more digestible for the user
  • Support other platforms like vimeo, dailymotion...etc
Share this project:

Updates