Vibe Grading

Sample AI Grading Suggestion
Architecture

Inspiration

Grading is a very slow and tedious process. It takes way too long for students to receive their grades and for graders go through hundreds of submissions.

What it does

Vibe Grading is a tool that hooks into Gradescope and makes it much faster and simpler for graders to grade individual students assignments. Built on web technologies and Groq, we were able to hook into Gradescope's rubrics, questions, and the student submissions in order to successfully have the Groq AI understand each rubric item and suggest the correct rubric item for each question.

How we built it

We built it on top of Google Chrome's extension API, where we were able to access properties of Gradescope directly in their website. And then we ran our code inside of Gradescope's environment in order to grab our rubric, the question and the student pages and send those off to Grok and correctly figure out which pages, questions and rubrics should be sent to Groq so that the context window is not too large and the AI has a less likelihood of hallucinating by grounding it in the assignments real data.

Challenges we ran into

Some of the challenges we ran into were integrating correctly with Gradescope's interface, correctly accessing API keys and environments for Groq. We also had some difficulties correctly grounding the AI based on the questions.

Accomplishments that we're proud of

We're really proud of how we were able to add a slider that controls how harsh the AI grades as well as how we were able to correctly ground and select items for the context window for the actual AI grading process.

What we learned

We learned about interfacing with the Groq API and having it output in a JSON format in order to display each item consistently in the overlay.

What's next for Vibe Grading

Adding a student side where students can get feedback on their ungraded work and resubmit for more points if that is a possibility. We also would like to be able to add something we call full self grading, where the AI is able to do more of the grading process on its own, including actually editing the interface for Gradescope on the grader's behalf.