π Unmute1ai β Calm Tech Productivity Engine
"Not a productivity app. A nervous system recalibration."
Built for the NYC Self-Improving Agents Hackathon β a neurodivergent-first productivity engine that eliminates executive dysfunction through agentic AI, zero-shame design, and radical local privacy.
π§ The Problem
Neurodivergent high-performers (ADHD, autism, dyslexia spectrum) experience executive dysfunction as a wall β not laziness. Existing tools punish non-completion with red badges, streaks, and guilt spirals. Unmute1ai is different: it meets users in the frozen moment and gently moves them forward.
ποΈ Architecture Overview
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β UNMUTE1AI SYSTEM β
β β
β ββββββββββββββββ ββββββββββββββββ ββββββββββββββββ β
β β FRONTEND β β AGENT LAYER β β DATA LAYER β β
β β β β β β β β
β β React + Vite βββββΊβ DeepThink βββββΊβ AES-256-GCM β β
β β Tailwind CSS β β (Gemini 3.1) β β Local Vault β β
β β WCAG 2.2 AAA β β β β β β
β ββββββββββββββββ β Arctic-2 β β IndexedDB β β
β β (Snowflake) β β (encrypted) β β
β ββββββββββββββββ β β ββββββββββββββββ β
β β OBSERVABILITYβ β Weave Traces β β
β β β β (W&B) β ββββββββββββββββ β
β β W&B DashboardβββββΊβ β β ACCESSIBILITYβ β
β β Self-Improve β ββββββββββββββββ β β β
β β Feedback Loopβ β User1st U1AI β β
β ββββββββββββββββ β Real-time β β
β β WCAG 2.2 AAA β β
β ββββββββββββββββ β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
π€ Sponsor Integrations
1. Google DeepMind β Gemini 3.1 Pro (DeepThink Engine)
The heart of the "Unstick Me" feature. When a user is frozen, they press one button. Gemini 3.1 Pro's long-context reasoning decomposes their stated goal into exactly 3 Vibe Units β small, neurologically safe micro-tasks with estimated cognitive load scores.
- Model:
gemini-3.1-provia Google AI Studio API - Location:
src/agents/deepThink.ts - Prompt Strategy: Chain-of-thought decomposition with explicit cognitive load calibration
- Output Schema:
{ vibeUnits: [{ id, title, estimatedMinutes, cognitiveLoad: 'low'|'medium' }] }
2. Snowflake β Arctic-2 (Silent Speech Synthesis)
Arctic-2 handles the "Whisper Input" mode β users can sub-vocalize or speak softly and the model transcribes with <50ms perceived latency via streaming chunks.
- Integration:
src/hooks/useSilentSpeech.ts - Architecture: WebSocket streaming to Snowflake Arctic-2 endpoint
- Latency Target: <50ms first-token via chunked streaming
- Fallback: Standard Web Speech API when offline
3. Weights & Biases β Weave Traces (Self-Improving Loop)
Every agentic reasoning step is wrapped in a W&B Weave trace. A nightly job analyzes friction points (tasks abandoned, "Unstick Me" re-presses) and automatically refines the DeepThink system prompt.
- Integration:
src/lib/wandb/weaveWrapper.ts - Traces: Task decomposition quality, completion rates, friction events
- Self-Improve Script:
scripts/selfImprove.tsβ runs nightly, updates prompts via W&B Artifacts - Dashboard: Real-time metrics at your W&B project URL
4. User1st (U1AI) β Real-time WCAG 2.2 AAA Accessibility
Every component rendered passes through the U1AI accessibility audit hook. Non-compliant renders are blocked with a developer warning β accessibility is not optional, it's a build gate.
- Integration:
src/hooks/useAccessibilityAudit.ts - Standard: WCAG 2.2 AAA (strictest available)
- Audit Timing: Post-render, pre-paint via
useLayoutEffect - CI Gate:
scripts/a11yAudit.tsfails the build if any component scores below AAA
π― Core Workflows
"Unstick Me" β Central Action
User clicks "Unstick Me"
β Modal prompts: "What's the one thing you're avoiding?"
β Gemini 3.1 DeepThink decomposes goal
β 3 Vibe Units appear (max 25 min each)
β W&B Weave logs the decomposition
β User picks ONE to start
β Timer starts (optional, non-alarming)
"Triage Mode" β Noise Elimination Dashboard
Simulated Jira + Slack feeds ingested
β Arctic-2 classifies each item: Signal | Noise | Deferred
β 80% noise filtered to "Later" pile
β 20% signal surfaced in calm, priority order
β Zero red colors, zero urgency theater
"Self-Improving Loop" β Nightly Refinement
W&B Weave collects: completion rates, re-press events, session duration
β Friction score calculated per decomposition pattern
β Gemini 3.1 re-ranks decomposition strategies
β New system prompt committed to W&B Artifacts
β Next day: improved DeepThink quality
π Directory Structure
unmute1ai/
βββ src/
β βββ components/
β β βββ Dashboard.tsx # Triage Mode central view
β β βββ UnstickButton.tsx # "Unstick Me" central action
β β βββ VibeUnitCard.tsx # Individual micro-task display
β β βββ TriageItem.tsx # Signal/Noise classified item
β β βββ AccessibilityWrapper.tsx # U1AI audit wrapper
β βββ hooks/
β β βββ useDeepThink.ts # Gemini 3.1 DeepThink hook
β β βββ useSilentSpeech.ts # Arctic-2 speech hook
β β βββ useWeaveTrace.ts # W&B Weave tracing hook
β β βββ useAccessibilityAudit.ts # U1AI real-time audit hook
β βββ lib/
β β βββ crypto/
β β βββ vault.ts # AES-256-GCM encryption vault
β β βββ keyDerivation.ts # PBKDF2 key derivation
β β βββ types.ts # Encrypted data types
β βββ agents/
β β βββ deepThink.ts # Gemini 3.1 agent logic
β β βββ triageAgent.ts # Jira/Slack triage agent
β βββ styles/
β βββ globals.css # Deep Space theme variables
βββ scripts/
β βββ selfImprove.ts # Nightly W&B prompt refinement
β βββ a11yAudit.ts # CI accessibility gate
βββ .clauderules # No-Shame UI enforcement rules
βββ .env.example # Required environment variables
βββ vite.config.ts
βββ tailwind.config.ts
βββ README.md
π Quick Start
# Clone and install
git clone https://github.com/unmute1ai/core
cd unmute1ai
npm install
# Configure environment
cp .env.example .env
# Fill in: GEMINI_API_KEY, SNOWFLAKE_ARCTIC_ENDPOINT, WANDB_API_KEY, U1AI_KEY
# Run development server
npm run dev
# Run accessibility audit (CI gate)
npm run a11y
# Run self-improve loop manually
npm run self-improve
π¨ Design Philosophy β No-Shame UI
The .clauderules file enforces these principles at the component level:
| β Never | β Always |
|---|---|
| Red badges or colors | Soft lilac (#B794F4) accents |
| Streak counters | Session presence (no judgment) |
| "You missed X days" | "Welcome back, ready when you are" |
| Alarming timers | Gentle pulsing progress |
| Dense information | Generous whitespace |
| Notifications | Opt-in gentle nudges only |
Color System:
- Primary Background:
#0B0E14(Deep Space) - Accent:
#B794F4(Soft Lilac) - Surface:
#141820 - Text Primary:
#E8EAF0 - Text Muted:
#6B7280 - Success:
#68D391(soft green β never red)
π Security Model
All user-generated content is encrypted before it leaves the browser:
- Key Derivation: PBKDF2 with 310,000 iterations (NIST recommended)
- Encryption: AES-256-GCM with random 96-bit IVs per write
- Storage: Encrypted ciphertext in IndexedDB β never plaintext on disk
- Key Storage: Derived key in memory only β cleared on session end
- Zero Server-Side: No user content ever transmitted to any server
π W&B Self-Improvement Metrics
| Metric | Description |
|---|---|
decomp_quality |
% of Vibe Units completed without re-decompose |
friction_score |
Re-press rate on UnstickMe button |
triage_accuracy |
User override rate on noise classification |
session_depth |
Tasks completed per session |
cognitive_load_calibration |
Actual vs. estimated completion time |
π§ͺ Accessibility Compliance
Every component is tested against WCAG 2.2 AAA at render time via User1st U1AI:
- Color Contrast: 7:1 minimum (AAA) β enforced by build gate
- Focus Indicators: 3px solid visible focus rings
- Motion:
prefers-reduced-motionrespected globally - Screen Readers: Full ARIA label coverage
- Keyboard Navigation: 100% keyboard operable, no mouse traps
π Hackathon Context
Event: NYC Self-Improving Agents Hackathon
Track: Calm Tech / Neurodivergent Accessibility
Team: Unmute1ai
Sponsors Used: Google DeepMind Β· Snowflake Β· Weights & Biases Β· User1st
Built with care for every brain that's ever felt stuck.
Log in or sign up for Devpost to join the conversation.