🌌 Unmute1ai β€” Calm Tech Productivity Engine

"Not a productivity app. A nervous system recalibration."

Built for the NYC Self-Improving Agents Hackathon β€” a neurodivergent-first productivity engine that eliminates executive dysfunction through agentic AI, zero-shame design, and radical local privacy.


🧠 The Problem

Neurodivergent high-performers (ADHD, autism, dyslexia spectrum) experience executive dysfunction as a wall β€” not laziness. Existing tools punish non-completion with red badges, streaks, and guilt spirals. Unmute1ai is different: it meets users in the frozen moment and gently moves them forward.


πŸ—οΈ Architecture Overview

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                      UNMUTE1AI SYSTEM                        β”‚
β”‚                                                             β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”‚
β”‚  β”‚   FRONTEND   β”‚    β”‚  AGENT LAYER β”‚    β”‚  DATA LAYER  β”‚  β”‚
β”‚  β”‚              β”‚    β”‚              β”‚    β”‚              β”‚  β”‚
β”‚  β”‚ React + Vite │◄──►│ DeepThink    │◄──►│ AES-256-GCM  β”‚  β”‚
β”‚  β”‚ Tailwind CSS β”‚    β”‚ (Gemini 3.1) β”‚    β”‚ Local Vault  β”‚  β”‚
β”‚  β”‚ WCAG 2.2 AAA β”‚    β”‚              β”‚    β”‚              β”‚  β”‚
β”‚  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β”‚ Arctic-2     β”‚    β”‚ IndexedDB    β”‚  β”‚
β”‚                      β”‚ (Snowflake)  β”‚    β”‚ (encrypted)  β”‚  β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”‚              β”‚    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β”‚
β”‚  β”‚ OBSERVABILITYβ”‚    β”‚ Weave Traces β”‚                       β”‚
β”‚  β”‚              β”‚    β”‚ (W&B)        β”‚    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”‚
β”‚  β”‚ W&B Dashboard│◄──►│              β”‚    β”‚ ACCESSIBILITYβ”‚  β”‚
β”‚  β”‚ Self-Improve β”‚    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β”‚              β”‚  β”‚
β”‚  β”‚ Feedback Loopβ”‚                        β”‚ User1st U1AI β”‚  β”‚
β”‚  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜                        β”‚ Real-time    β”‚  β”‚
β”‚                                          β”‚ WCAG 2.2 AAA β”‚  β”‚
β”‚                                          β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

πŸ€– Sponsor Integrations

1. Google DeepMind β€” Gemini 3.1 Pro (DeepThink Engine)

The heart of the "Unstick Me" feature. When a user is frozen, they press one button. Gemini 3.1 Pro's long-context reasoning decomposes their stated goal into exactly 3 Vibe Units β€” small, neurologically safe micro-tasks with estimated cognitive load scores.

  • Model: gemini-3.1-pro via Google AI Studio API
  • Location: src/agents/deepThink.ts
  • Prompt Strategy: Chain-of-thought decomposition with explicit cognitive load calibration
  • Output Schema: { vibeUnits: [{ id, title, estimatedMinutes, cognitiveLoad: 'low'|'medium' }] }

2. Snowflake β€” Arctic-2 (Silent Speech Synthesis)

Arctic-2 handles the "Whisper Input" mode β€” users can sub-vocalize or speak softly and the model transcribes with <50ms perceived latency via streaming chunks.

  • Integration: src/hooks/useSilentSpeech.ts
  • Architecture: WebSocket streaming to Snowflake Arctic-2 endpoint
  • Latency Target: <50ms first-token via chunked streaming
  • Fallback: Standard Web Speech API when offline

3. Weights & Biases β€” Weave Traces (Self-Improving Loop)

Every agentic reasoning step is wrapped in a W&B Weave trace. A nightly job analyzes friction points (tasks abandoned, "Unstick Me" re-presses) and automatically refines the DeepThink system prompt.

  • Integration: src/lib/wandb/weaveWrapper.ts
  • Traces: Task decomposition quality, completion rates, friction events
  • Self-Improve Script: scripts/selfImprove.ts β€” runs nightly, updates prompts via W&B Artifacts
  • Dashboard: Real-time metrics at your W&B project URL

4. User1st (U1AI) β€” Real-time WCAG 2.2 AAA Accessibility

Every component rendered passes through the U1AI accessibility audit hook. Non-compliant renders are blocked with a developer warning β€” accessibility is not optional, it's a build gate.

  • Integration: src/hooks/useAccessibilityAudit.ts
  • Standard: WCAG 2.2 AAA (strictest available)
  • Audit Timing: Post-render, pre-paint via useLayoutEffect
  • CI Gate: scripts/a11yAudit.ts fails the build if any component scores below AAA

🎯 Core Workflows

"Unstick Me" β€” Central Action

User clicks "Unstick Me"
  β†’ Modal prompts: "What's the one thing you're avoiding?"
  β†’ Gemini 3.1 DeepThink decomposes goal
  β†’ 3 Vibe Units appear (max 25 min each)
  β†’ W&B Weave logs the decomposition
  β†’ User picks ONE to start
  β†’ Timer starts (optional, non-alarming)

"Triage Mode" β€” Noise Elimination Dashboard

Simulated Jira + Slack feeds ingested
  β†’ Arctic-2 classifies each item: Signal | Noise | Deferred
  β†’ 80% noise filtered to "Later" pile
  β†’ 20% signal surfaced in calm, priority order
  β†’ Zero red colors, zero urgency theater

"Self-Improving Loop" β€” Nightly Refinement

W&B Weave collects: completion rates, re-press events, session duration
  β†’ Friction score calculated per decomposition pattern
  β†’ Gemini 3.1 re-ranks decomposition strategies
  β†’ New system prompt committed to W&B Artifacts
  β†’ Next day: improved DeepThink quality

πŸ“ Directory Structure

unmute1ai/
β”œβ”€β”€ src/
β”‚   β”œβ”€β”€ components/
β”‚   β”‚   β”œβ”€β”€ Dashboard.tsx          # Triage Mode central view
β”‚   β”‚   β”œβ”€β”€ UnstickButton.tsx      # "Unstick Me" central action
β”‚   β”‚   β”œβ”€β”€ VibeUnitCard.tsx       # Individual micro-task display
β”‚   β”‚   β”œβ”€β”€ TriageItem.tsx         # Signal/Noise classified item
β”‚   β”‚   └── AccessibilityWrapper.tsx  # U1AI audit wrapper
β”‚   β”œβ”€β”€ hooks/
β”‚   β”‚   β”œβ”€β”€ useDeepThink.ts        # Gemini 3.1 DeepThink hook
β”‚   β”‚   β”œβ”€β”€ useSilentSpeech.ts     # Arctic-2 speech hook
β”‚   β”‚   β”œβ”€β”€ useWeaveTrace.ts       # W&B Weave tracing hook
β”‚   β”‚   └── useAccessibilityAudit.ts  # U1AI real-time audit hook
β”‚   β”œβ”€β”€ lib/
β”‚   β”‚   └── crypto/
β”‚   β”‚       β”œβ”€β”€ vault.ts           # AES-256-GCM encryption vault
β”‚   β”‚       β”œβ”€β”€ keyDerivation.ts   # PBKDF2 key derivation
β”‚   β”‚       └── types.ts           # Encrypted data types
β”‚   β”œβ”€β”€ agents/
β”‚   β”‚   β”œβ”€β”€ deepThink.ts           # Gemini 3.1 agent logic
β”‚   β”‚   └── triageAgent.ts         # Jira/Slack triage agent
β”‚   └── styles/
β”‚       └── globals.css            # Deep Space theme variables
β”œβ”€β”€ scripts/
β”‚   β”œβ”€β”€ selfImprove.ts             # Nightly W&B prompt refinement
β”‚   └── a11yAudit.ts               # CI accessibility gate
β”œβ”€β”€ .clauderules                   # No-Shame UI enforcement rules
β”œβ”€β”€ .env.example                   # Required environment variables
β”œβ”€β”€ vite.config.ts
β”œβ”€β”€ tailwind.config.ts
└── README.md

πŸš€ Quick Start

# Clone and install
git clone https://github.com/unmute1ai/core
cd unmute1ai
npm install

# Configure environment
cp .env.example .env
# Fill in: GEMINI_API_KEY, SNOWFLAKE_ARCTIC_ENDPOINT, WANDB_API_KEY, U1AI_KEY

# Run development server
npm run dev

# Run accessibility audit (CI gate)
npm run a11y

# Run self-improve loop manually
npm run self-improve

🎨 Design Philosophy β€” No-Shame UI

The .clauderules file enforces these principles at the component level:

❌ Never βœ… Always
Red badges or colors Soft lilac (#B794F4) accents
Streak counters Session presence (no judgment)
"You missed X days" "Welcome back, ready when you are"
Alarming timers Gentle pulsing progress
Dense information Generous whitespace
Notifications Opt-in gentle nudges only

Color System:

  • Primary Background: #0B0E14 (Deep Space)
  • Accent: #B794F4 (Soft Lilac)
  • Surface: #141820
  • Text Primary: #E8EAF0
  • Text Muted: #6B7280
  • Success: #68D391 (soft green β€” never red)

πŸ” Security Model

All user-generated content is encrypted before it leaves the browser:

  1. Key Derivation: PBKDF2 with 310,000 iterations (NIST recommended)
  2. Encryption: AES-256-GCM with random 96-bit IVs per write
  3. Storage: Encrypted ciphertext in IndexedDB β€” never plaintext on disk
  4. Key Storage: Derived key in memory only β€” cleared on session end
  5. Zero Server-Side: No user content ever transmitted to any server

πŸ“Š W&B Self-Improvement Metrics

Metric Description
decomp_quality % of Vibe Units completed without re-decompose
friction_score Re-press rate on UnstickMe button
triage_accuracy User override rate on noise classification
session_depth Tasks completed per session
cognitive_load_calibration Actual vs. estimated completion time

πŸ§ͺ Accessibility Compliance

Every component is tested against WCAG 2.2 AAA at render time via User1st U1AI:

  • Color Contrast: 7:1 minimum (AAA) β€” enforced by build gate
  • Focus Indicators: 3px solid visible focus rings
  • Motion: prefers-reduced-motion respected globally
  • Screen Readers: Full ARIA label coverage
  • Keyboard Navigation: 100% keyboard operable, no mouse traps

πŸ† Hackathon Context

Event: NYC Self-Improving Agents Hackathon
Track: Calm Tech / Neurodivergent Accessibility
Team: Unmute1ai
Sponsors Used: Google DeepMind Β· Snowflake Β· Weights & Biases Β· User1st


Built with care for every brain that's ever felt stuck.

Built With

Share this project:

Updates