About the Project: VisiAI – The AI Eyes for the Web

💡 Inspiration

Modern websites are often visually appealing but not always accessible or user-friendly. Many designers rely on intuition rather than data to evaluate how effectively their designs communicate.

During the Webmind Innovation Hackathon, our team was inspired by the idea of giving websites a way to be “seen” through AI’s eyes — to quantify visual clarity and accessibility the same way SEO measures performance.

That’s how VisiAI was born — an intelligent visual auditor that evaluates the look, feel, and usability of a website using AI.

⚙️ How We Built It

Tech Stack: MERN (Express.js, React.js, Node.js) + TypeScript

Node.js powers the backend logic and manages the scanning process.

Express.js handles API routes for scanning requests and communication between frontend and backend.

React.js drives the interactive dashboard that displays Visual Health Scores, AI suggestions, and visual heatmaps.

TypeScript ensures backend reliability and maintainability.

For the AI and analytics side:

We used the Gemini API to interpret visual content and provide intelligent feedback on design clarity, readability, and accessibility.

The Lighthouse API helped us evaluate performance, SEO, and best practices, generating detailed quality metrics.

We used reimagineweb.dev (as per hackathon requirements) to analyze and validate our website’s design performance and visual accessibility. While we did not directly integrate its API, its analysis results guided and benchmarked our AI’s evaluation pipeline.

Finally, all these insights were synthesized into a Visual Health Score, visualized through AI-generated heatmaps and design improvement suggestions.

🧠 What We Learned

How AI and design analytics can work together to quantify visual clarity.

The power of vision-language models (VLMs) in interpreting visual and spatial cues.

Effective integration of third-party analysis tools like reimagineweb.dev into a MERN-based workflow.

Building a data-driven UX tool that transforms aesthetics into measurable design intelligence.

🚧 Challenges We Faced

Design quantification: Converting qualitative metrics (like “balance” or “readability”) into measurable scores required experimentation.

Model alignment: Ensuring that AI-generated recommendations aligned with real-world UX principles.

Heatmap generation: Accurately simulating user attention zones without real user data using saliency mapping techniques.

🎯 The Takeaway

VisiAI taught us that design intelligence isn’t just about beauty — it’s about clarity, accessibility, and communication.

Our system helps designers and teams see their work through the lens of AI and human perception, bridging the gap between creativity and measurable performance.

Built With

+ 8 more
Share this project:

Updates