Karan Singhal (@thekaransinghal) / X

Karan Singhal

294 posts

Karan Singhal

@thekaransinghal

Health AI, AGI benefits, safety @OpenAI

San Francisco, CA

Joined April 2008

Pinned
Karan Singhal
@thekaransinghal
Apr 22
Today we’re introducing two big steps for health at OpenAI: - ChatGPT for Clinicians, a free version of ChatGPT designed for clinical work - HealthBench Professional, a new benchmark to evaluate real clinician chat tasks We’re excited about what this can unlock for care. ❤️
1.6M
Karan Singhal
@thekaransinghal
Nov 3, 2025
Not true. Despite speculation, this is not a new change to our terms. Model behavior remains unchanged. ChatGPT has never been a substitute for professional advice, but it will continue to be a great resource to help people understand legal and health information.
453K
Karan Singhal
@thekaransinghal
Jul 22, 2024
📣 Life update: I’ve joined OpenAI and am hiring researchers! 💥 I’m immensely grateful to all of my teammates at Google/DeepMind over the last ~5 years–you all have taught me so much. I’m excited to continue marching towards our shared mission to enable universal access to
157K
Karan Singhal
@thekaransinghal
Jul 22, 2025
📣 Excited to share our real-world study of an LLM clinical copilot, a collab between @OpenAI and @PendaHealth. Across 39,849 live patient visits, clinicians with AI had a 16% relative reduction in diagnostic errors and a 13% reduction in treatment errors vs. those without. 🧵
00:00
493K
Karan Singhal
@thekaransinghal
Feb 14, 2025
OpenAI's Health AI team is now hiring backend/fullstack SWEs towards our mission of universalizing access to health information! Please apply if you: - Can write maintainable, high-quality backend / fullstack code at high velocity - Are willing to run through walls towards this
446K
Karan Singhal
@thekaransinghal
May 12, 2025
📣 Proud to share HealthBench, an open-source benchmark from our Health AI team at OpenAI, measuring LLM performance and safety across 5000 realistic health conversations. 🧵 Unlike previous narrow benchmarks, HealthBench enables meaningful open-ended evaluation through 48,562
118K
Karan Singhal
@thekaransinghal
Oct 14, 2024
📢 Our Health AI team is hiring Research Scientists / Engineers towards: (1) universalizing access to health information (2) using health as a testbed for safety / alignment (3) learning how to deploy in high-stakes domains. Please apply if you: - have experience in practical
Lilian Weng
@lilianweng
Oct 14, 2024
📢 We are hiring Research Scientists and Engineers for safety research at @OpenAI, ranging from safe model behavior training, adversarial robustness, AI in healthcare, frontier risk evaluation and more. Please fill in this form if you are interested: jobs.ashbyhq.com/openai/form/oa…
43K
Karan Singhal
@thekaransinghal
Aug 27, 2025
FYI HealthBench now conveniently available on HuggingFace. We hope it helps model developers and the healthcare community understand model performance and safety.
openai/healthbench · Datasets at Hugging Face
From huggingface.co
31K
Karan Singhal
@thekaransinghal
Aug 5, 2025
OpenAI’s new gpt-oss models are our “healthiest” models pound-for-pound. 💥 The 120b model outperforms all our other frontier models on HealthBench–GPT-4o, o1, o4-mini–except o3, which it nearly matches despite being much smaller. Even healthier models to come soon! 👇
23K
Karan Singhal
@thekaransinghal
Jul 12, 2023
Honored to see our work on Med-PaLM, our medical large language model, published in @Nature today! nature.com/articles/s4158… Huge thanks to our all-star team @AziziShekoofeh @taotu831 @alan_karthi @vivnat and many more teammates at @GoogleAI @googlehealth!
36K
Karan Singhal
@thekaransinghal
Dec 2, 2024
I will be in Vancouver for NeurIPS 🇨🇦 next week! Please DM if you’d like to: - Catch up in-person - Chat about health AI, AI safety, or ensuring AGI is beneficial - Learn about our team–we’re hiring researchers: openai.com/careers/resear… Please reach out if you have hands-on
14K
Karan Singhal
@thekaransinghal
Jan 20, 2025
(Pardon the interruption in your regularly scheduled AGI programming!) 📄 The Med-PaLM 2 paper is now published in Nature Medicine! The work demonstrated that with some tuning, LLMs could not only perform well on medical exams, but could also answer consumer medical questions
8.7K
Karan Singhal
@thekaransinghal
Mar 19, 2024
Excited to share our newest work! 📝 Evaluation of LLMs is hard, especially for health equity. We provide a multifaceted human assessment framework, 7 newly-released adversarial datasets, and perform the largest human eval study on this topic to date. 🧵: arxiv.org/abs/2403.12025
43K
Karan Singhal
@thekaransinghal
Aug 7, 2025
GPT-5 substantially pushes the frontier of health performance and safety and is widely available to all users today. Details below 🧵
OpenAI
@OpenAI
Aug 7, 2025
Replying to @OpenAI
GPT-5 is our best model yet for health-related questions, empowering users to be informed about and advocate for their health. The model now provides more precise and reliable responses, adapting to the user’s context, knowledge level, and geography.
30K