Inspiration
Safety is a fundamental concern, especially for women navigating public spaces or unfamiliar environments. Google Shield was conceived to address this issue by providing an always-on, proactive safety system. The idea behind this project is to create a silent, real-time guardian that continuously monitors the user's surroundings for potential risks and takes immediate action when necessary. It empowers women by ensuring their safety without requiring manual intervention, leveraging AI to detect danger and activate safety measures autonomously.
What It Does
Google Shield is an AI-powered safety assistant that operates quietly in the background, ensuring continuous protection throughout the day. The system uses a combination of environmental data sources, including:
- Sound levels: Detects sudden increases in noise, such as shouting or distress, which may indicate a threat.
- Motion detection: Monitors unusual movement patterns, helping to detect signs of aggression or a potential altercation.
- Location tracking: Tracks the user’s location, providing vital information in case of an emergency.
When the system detects a potential risk, it activates speech-to-text transcription via Whisper AI to capture key audio data, sending it to an AI model for risk assessment. Based on the analysis, Google Shield determines the risk level and triggers the appropriate safety measures, such as:
- Sending alerts to emergency contacts
- Sharing the user's real-time location
- Activating alarms or sending notifications
The system’s seamless operation ensures that users can continue their daily routines with minimal disruption while being constantly safeguarded.
How We Built It
We built Google Shield using a combination of modern technologies to ensure real-time processing, reliability, and seamless integration:
- Backend & Frontend: Developed using Next.js, which provides a unified environment for both server-side and client-side code to ensure a smooth user experience.
- AI & Risk Assessment: Powered by Existence AI, which analyzes real-time data to determine the risk level and triggers necessary actions.
- Speech-to-Text: Utilized Whisper AI for accurate speech transcription, converting audio data into text for further analysis.
- Location & Motion Detection: Integrated GPS APIs and device motion sensors to monitor the user's location and detect unusual movement patterns.
- Safety Alerts: Leveraged Twilio for sending emergency alerts, sharing location data, and communicating with emergency contacts.
Together, these technologies create a cohesive system that allows Google Shield to continuously monitor the user's environment, make intelligent risk assessments, and take automated protective actions.
Challenges We Ran Into
While building Google Shield, we faced several technical challenges:
Real-time Processing: One of the biggest hurdles was ensuring that the system could run in the background without draining device resources. We focused on optimizing the performance of speech-to-text functionality and motion detection algorithms to minimize battery consumption while maintaining high accuracy.
Risk Detection Accuracy: Fine-tuning the AI model to accurately assess risk based on ambient sounds, motion, and location was complex. It was crucial to avoid false positives (e.g., interpreting normal conversations as distress signals) and false negatives (missing a real threat). We continuously trained the model to improve detection accuracy.
Privacy Concerns: Handling sensitive data, such as location and speech, raised privacy concerns. We implemented end-to-end encryption to ensure that user data is securely transmitted and stored, adhering to the highest standards of data protection.
Accomplishments We're Proud Of
We are proud to have developed a minimum viable product (MVP) that integrates AI-based risk detection, real-time monitoring, and automated safety actions for women. Notable accomplishments include:
- AI-powered Risk Assessment: The system is capable of analyzing environmental data (sound, motion, location) to determine real-time threats.
- Autonomous Safety Measures: Google Shield can autonomously alert emergency contacts, share location data, and activate alarms when a risk is detected.
- Privacy and Security: We ensured that user data is protected with end-to-end encryption, respecting user privacy while offering maximum safety.
This MVP serves as a first step toward empowering women with a proactive safety tool that works silently and continuously in the background.
What We Learned
Through the development of Google Shield, we gained valuable insights into:
- Real-time Environmental Data Processing: We learned how to integrate and process multiple data streams (sound, motion, location) to make quick, accurate decisions in real time.
- AI for Risk Assessment: We deepened our understanding of training AI models to evaluate risk and make decisions based on complex environmental inputs.
- Speech-to-Text for Safety: Integrating Whisper AI taught us how to use speech-to-text technology for continuous, real-time monitoring of audio data, ensuring prompt and accurate risk detection.
- Data Privacy and Security: We reinforced the importance of safeguarding sensitive user data through encryption and secure data storage protocols.
What's Next for Google Shield
Looking ahead, we plan to expand and improve Google Shield by focusing on:
- Enhanced Risk Detection: Refining the AI model to improve detection accuracy, especially in detecting more subtle signs of danger or stress, such as abnormal walking patterns or sudden changes in speed.
- Additional Features: We intend to integrate wearable devices, which could trigger alerts in case of sudden physical distress, or incorporate automatic dialing of emergency services in critical situations.
- User Feedback: Gathering real-world user feedback to improve the system’s usability, refine risk detection, and adapt the system to diverse scenarios and environments.
This is an exciting first step towards creating a safer, more empowered world for women, and we are committed to continuously improving Google Shield to ensure it offers the highest level of protection.
Log in or sign up for Devpost to join the conversation.