SalmanMKC
Hi, my name is Salman Muin Kayser Chishti. I'm a Software Engineer at GitHub. Previously Microsoft. Currently working on agentic workflows and actions. Previous research with Oxford and Microsoft. I build XR experiences, research interactive systems, and ship developer tools.
As seen in
Audio-Driven Avatar Lipsync
End-to-end audio-driven facial animation that runs locally in the browser. Mic → MFCCs → small MLP → 52 ARKit blendshapes → stylised avatar. The browser trains the model itself with TF.js on data captured live from your face via MediaPipe FaceLandmarker. The same architecture is mirrored in a JAX/Flax trainer that exports to LiteRT for Android XR or Quest.
On-Device Language Detection + Gemini Voice — Google XR Blocks
Spartial-transcript pipeline that detects language per utterance. Uses Gemini Live for the audio stream and MediaPipe's language detector on device to tag each utterance. Lays out as a chat-style list with the latest at the bottom — slots scale together so it doesn't jump when a new line comes in.
Mixed Reality EEG + PPG Panic Attack Intervention — MIT Reality Hack
Brain–computer interface combining EEG (brain), PPG (heart) and pose detection in mixed reality to support panic attack intervention. Built at MIT Reality Hack.
Metaverse AR Therapy (CHI 2025, Japan)
Research project exploring AR-based therapeutic experiences in the metaverse — published at CHI 2025.
Microsoft Patent — Emphasis Image Generation
Inventor on a Microsoft patent application: "Generation of Emphasis Image with Emphasis Boundary".
Multiplayer Support - Google XR Blocks
Designed and implemented multiplayer networking for XR Blocks, enabling shared mixed-reality experiences across devices, this includes proximity voice, a shared chat, shared objects that can move, RPC actions, presence and 3 transport protocols. This works across networks, and custom servers as well as locally between devices, Meta Quest, Android XR, mobile and PC
Portals Demo — Google XR Blocks
A showcase XR experience built on XR Blocks demonstrating immersive scene composition and interaction primitives.
Gamepad Controller Support — Google XR Blocks
Added gamepad input support to XR Blocks so developers can build XR apps that work with standard controllers.
AR National Gallery — London National Gallery
AR experience trained on paintings from the National Gallery in London — overlays AR storytelling, narration, and contextual information onto recognised artworks.
Augmented Reality Supermarket Experience
Prototype AR demo of an in-store supermarket experience — overlaying product info, navigation, and contextual UI onto a physical shopping environment.
Youth WellTech (arXiv, with Microsoft Research)
A global remote co-design sprint for youth mental health technology, with Microsoft Research. I was a mentor and the second-highest contributor on the paper.
Biospatial OpenWorm — NASA Hackathon Award Winner
AR simulation of the C. elegans connectome built for the NASA International Space Apps Challenge.
UCL Agentverse Hackathon #1 — Multi-Agent System
Winning multi-agent system built with CAIPE / LangGraph at the UCL Agentverse Hackathon.
Mixed Reality Smart Office — HoloLens
HoloLens experience visualising IoT data in 3D with dynamic image tracking on physical devices around the office.
Speaking & Events
A few flagship events I've spoken at or hosted:
| Microsoft Build (Seattle 🇺🇸) | Multiple session host (in-person) |
| Microsoft Ignite | Speaker |
| Microsoft Learn TV | Presenter |
| Microsoft Business Applications Summit | Speaker |
| Microsoft Experience Center | Speaker |
| Microsoft Intern Day | Host |
| Microsoft Imagine Cup Junior | Judge |
Awards
- 🏆 UCL Agentverse Hackathon #1
- 🚀 NASA International Space Apps Award
- 📜 Microsoft Patent Filer
- ☁️ Microsoft Azure MVP
- 🪟 Windows Insider MVP
- 🏅 Microsoft Customer Success Unit Award
- 🥇 Gold Microsoft Learn Student Ambassador
- 🎓 University of Nottingham Community Contributions
- 🧩 Microsoft Intern Puzzle Day 3rd
- ⌨️ Microsoft Typing Competition #1