Inspiration
In the age of rapid communication, social media platforms such as TikTok, Instagram, and YouTube have risen to the top in short-form media. These clips can circulate the internet and go viral. However, many of these viral videos often lead to the spreading of misinformation. How can someone quickly and easily check if a video they see is misleading?
What it does
Detects misinformation in TikTok posts with AI. It provides a summary on potential misinformation present and links to any relevant articles about the topic.
How we built it
The webpage was built in React while the backend utilized Flask and several AI libraries. These include OpenCV, LLama, ChatGPT, Assembly-AI, and a CDN is used to host video frames while processing. Additionally, web scraping of the fact-checking site snopes.com is done so that certain claims can be backed up with sources if they have been checked by snopes.com.
Challenges we ran into
Obtaining the audio file from TikTok posts proved difficult, and the subsequent challenge involved aiming for high accuracy in detecting false information using the OpenAI API. However, by utilizing several APIs we were able to provide more context to improve the reliability. Additionally, scraping snopes.com for relevant articles provides sources for claims and prevents AI hallucination. We also had to learn how to use asynchronous programming to improve the speed of the program.
Accomplishments that we're proud of
We are proud of our ability to integrate several different APIs to tackle this difficult problem. The UI for the webpage was designed with care and user-friendly.
What we learned
Our group learned to implement several APIs in our backend along with web scraping and image processing while collaborating with each other to hook up the frontend and backend.
What's next for Miss Info
Develop a language model to aim for higher accuracy.
Built With
- assembly-ai
- flask
- natural-language-processing
- python
- react
Log in or sign up for Devpost to join the conversation.