Insightfully Study

Landing Page
Captures screen, analyzes and gives feedback/guidance.
Google extension for LeetCode version
Example of basic guidance.

Inspiration

Nowadays, we're so used to turning to AI to solve our problems when we get stuck studying. Due to this, we stunt our academic growth and end up not learning the material. Insightfully Study deploys artificial intelligence in a unique way where it guides the user to the correct answer without blatantly giving it to them. This results in users actually learning the material.

What it does

LeetCode Google Extension The first part of this project is the google extension built for LeetCode. When on a LeetCode problem, the extension extracts relevant information like problem title, description, difficulty, examples, etc. along with the code the user's written. Using this data to contextualize an LLM, the extension offers guidance when the user asks for hints, chats with it, or when it notices the users stuck, upon which the extension prompts the user if they need help.

Webpage The second part of the project capitalizes on LLM's ability to capture and extract information from images. By screen recording the user's window, the LLM parses relevant information and guides the user through solving the problem at hand. This version excels at math and the sciences especially.

How we built it

Frontend:

Built a responsive chrome extension using vanilla JavaScript and custom web components with DOM parsing
NextJS & Tailwind webpage Backend: NextJS server handling LLM interactions and problem analysis

Challenges we ran into

Developing a google extension was tough and unique. Unable to use traditional js frameworks, constantly working with JS injections, etc.
Screen Recording posed many bugs