Inspiration
Teenagers spend a large part of their social life online through games, chat platforms, and shared virtual spaces. These environments allow creativity and connection, but they also expose young users to risks such as manipulation, harassment, and grooming. Most platforms rely on reporting systems, which means protection often begins only after harm has already occurred. We wanted to rethink that model. Instead of reacting to incidents, we asked how a platform could prevent unsafe interactions in the first place. Our inspiration was to design a social environment where safety is part of the structure, detecting concerning behavior patterns early and interrupting them before escalation.
What it does
Cupcake Catcher is a safety-first social platform prototype designed for teenagers. The system focuses on early prevention by:
- restricting messaging to approved or verified connections
- analyzing behavioral patterns associated with grooming
- filtering inappropriate language
- flagging suspicious activity such as rapid friend requests or attempts to move conversations off-platform
- alerting moderators and guardians when risk thresholds are reached The goal is not surveillance but early intervention, stopping risky interactions before they develop into harmful situations.
How we built it
We created a web application using a React frontend with Tailwind CSS styling and a Node.js backend. Instead of training a machine learning model with sensitive data, we implemented an explainable rule-based safety engine. The system monitors interaction patterns such as:
- frequency of private messaging
- friend request velocity
- age-gap contact attempts
- requests for personal or external contact information When a threshold is triggered, the platform automatically restricts communication and generates alerts in our simulated guardian and moderator interface. We also implemented automatic language filtering and permission-based messaging to reduce unwanted contact.
Challenges we ran into
The biggest challenge was balancing safety with usability. A system that is too restrictive discourages teens from using it, while a system that is too open fails to protect them. Another difficulty was building a realistic detection model without access to real-world datasets. We addressed this by designing an explainable behavioral pattern system based on documented grooming behaviors rather than keyword matching alone. We also worked to design the interface so it felt supportive and welcoming rather than invasive or surveillance-like.
Accomplishments that we're proud of
- Designing a preventative safety architecture rather than a simple moderation tool
- Building behavioral pattern detection instead of relying only on keyword filtering
- Creating guardian alerts without exposing private message content
- Demonstrating that protection can occur before harm instead of after a report We’re especially proud that our prototype shows how thoughtful system design can make online social spaces safer for young users.
What we learned
We learned that online safety is not only a moderation problem it is a design problem. Many risks occur because platforms allow unsafe interaction patterns to form before any warning signs are noticed.Through this project, we saw how structure, permissions, and early pattern detection can prevent harmful situations without heavily monitoring users. We also learned the importance of balancing protection with privacy, and how small UX decisions can influence whether a system feels supportive or intrusive. Building Cupcake Catcher showed us that preventative safety systems require both technical solutions and thoughtful user experience design.
What's next for cupcake catcher
Our prototype shows that safety can be built into a platform’s design instead of added after problems occur. Next, we plan to expand beyond a single app and develop Cupcake Catcher as a cross-platform safety companion that protects teens across the digital spaces they already use. Future work includes:
- optional tools with guardian consent
- early detection of risky interaction patterns
- unified safety alerts for families
- educational prompts that help teens recognize manipulation partnerships with youth safety and digital well-being organizations Long term, Cupcake Catcher aims to become a preventative digital wellbeing tool that helps families notice concerning patterns early and intervene before harm occurs, while still respecting privacy and autonomy.
Built With
- css
- express.js
- javascript
- node.js
- postgresql
- react
- rest
- tailwind
- vite
Log in or sign up for Devpost to join the conversation.