Skip to content
View jain18ayush's full-sized avatar

Block or report jain18ayush

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
jain18ayush/README.md

πŸ‘‹ Hi, I’m Ayush Jain

πŸŽ“ Senior @ UIUC β€” CS + Philosophy
πŸ”¬ AI Safety Researcher | Systems Builder | Open-Source Contributor
🌐 LinkedIn · Email


🧭 About Me

I combine AI safety research with systems engineering. My focus is on mechanistic interpretability, probing truth in embeddings, and making LLM reasoning faithful.

I’ve worked on scaling PyTorch pipelines for probing embeddings, steering generative models, and GPU/distributed systems optimizations β€” with industry experience at Thomson Reuters, CCC Intelligent Solutions, and AMD collaborations, plus startup work at Onespace.

My goal: design safer, interpretable, and more controllable AI systems.


πŸ”¬ Research & AI Safety

  • 🧩 Mechanistic Interpretability (UIUC) – Identified truth/ambiguity subspaces in LLaMA, Mistral, Gemma embeddings (80% probe accuracy).
  • πŸŽ™ Steering Whisper – Built PyTorch steering pipeline; aligned GPT-2 ↔ Whisper concepts across modalities.
  • πŸ“Š Cognitive Battery for LLMs – Designed 1,000-item psychometric evaluation estimating causal covariance and effect sizes.

πŸ› οΈ Projects

Project Description Tech
πŸŽ™ Steering Whisper Built a PyTorch steering pipeline for OpenAI Whisper to align cross-model concepts (Whisper ↔ GPT-2), exploring transfer of reasoning, tone, and emotion directions. PyTorch Β· Transformers Β· PCA/Projections
πŸ”— Causal CoT Ablation Analyzed chain-of-thought reasoning by ablating specific steps and measuring logprob shifts, highlighting stepwise faithfulness and causal influence in reasoning chains. PyTorch Β· Mechanistic Interpretability
πŸ” Distributed-Log-Queryer Go-based grep service across 10 VMs; fault-tolerant log streaming with a SWIM failure detection system. Go Β· RPC Β· Goroutines
πŸ“– ViT-Prisma Contribution Docs & fixes for open-source vision interpretability library. PyTorch Β· Vision Transformers
πŸ§ͺ Phase-Transition Interpretability Induced a training phase change (orientation β†’ orientation+color) to study how weights change as neurons become polysemantic. Tracked weight-angle, magnitude, and entropy as order parameters PyTorch Β· NumPy Β· Matplotlib
⚑ GPU-Convolution-Optimization CUDA + Tensor Cores optimization, 70% speedup. CUDA · WMMA · Nsight
πŸ“ Onespace JSON annotation + LangChain RAG chatbot for legal docs. React Β· Electron Β· LangChain
🧩 xv6 Operating System RISC-V OS kernel: preemptive scheduling, paging (SV39), VirtIO drivers, UART logging. C · OS · RISC-V

πŸ’Ό Experience

  • Thomson Reuters (SWE Intern) – Built legal chatbots and optimized UX for the 100 top law firms worldwide
  • CCC Intelligent Solutions (Data Science Intern) – Fine-tuned vision fraud detection on 40M claims, ↑ accuracy 20%.
  • Onespace (Founding Engineer) – Secured $50k funding, shipped RAG + annotation platform.
  • Gies Disruption Lab (Tech Lead) – Built deepfake detection (↑30%), deployed RAG over 500k docs.

⚑ Tech Stack

Python
C++
Go
JavaScript
PyTorch
CUDA
React
Docker


πŸ“Š GitHub Activity

Ayush’s GitHub stats
Top Langs


🌱 Current Focus

  • Faithfulness of chain-of-thought reasoning in LLMs
  • Subspace and causal probing for embeddings
  • Practical tools for robust deployment of generative AI

⭐️ Let’s collaborate on AI safety & interpretability research β†’ reach me via email or X!

Pinned Loading

  1. whisper_interpretability whisper_interpretability Public

    Forked from er537/whisper_interpretability

    A repo to do interpretability of pre-trained acoustic models

    Python 1

  2. CoT-Monitoring CoT-Monitoring Public

    MATS Winter'25 Application

    Jupyter Notebook

  3. xv6-os xv6-os Public

    C

  4. mnist-sae mnist-sae Public

    Jupyter Notebook