Jaemin Cho (@jmin_

Jaemin Cho

1,431 posts

Jaemin Cho

@jmin__cho

Incoming Assistant Prof @JHUCompSci & Young Investigator @Allen_AI | PhD @UNCCS | multimodal and embodied AI

Baltimore, MD

Joined January 2011

Jaemin Cho
@jmin__cho
May 20, 2025
Sharing some personal updates 🥳: - I've completed my PhD at @unccs! 🎓 - Starting Fall 2026, I'll be joining the Computer Science dept. at Johns Hopkins University (@JHUCompSci) as an Assistant Professor 💙 - Currently exploring options + finalizing the plan for my gap year (Aug
91K
Jaemin Cho
@jmin__cho
Nov 8, 2024
Check out M3DocRAG -- multimodal RAG for question answering on Multi-Modal & Multi-Page & Multi-Documents (+ a new open-domain benchmark + strong results on 3 benchmarks)! ⚡️Key Highlights: ➡️ M3DocRAG flexibly accommodates various settings: - closed & open-domain document
65K
Jaemin Cho
@jmin__cho
Feb 5, 2021
Presenting our new V+L pretraining work: “Unifying Vision-and-Language Tasks via Text Generation”, a single unified generative framework (VL-T5 / VL-BART) for diverse multimodal tasks! Arxiv: arxiv.org/abs/2102.02779 Work done w/ @jayleicn @HaoTan5 @mohitban47 (@uncnlp) 🧵1/n
Jaemin Cho
@jmin__cho
Jul 23, 2025
🥳 Gap year update: I'll be joining @allen_ai/@UW for 1 year (Sep2025-Jul2026 -> @JHUCompSci) & looking forward to working with amazing folks there, incl. @RanjayKrishna, @HannaHajishirzi, Ali Farhadi. 🚨 I’ll also be recruiting PhD students for my group at @JHUCompSci for Fall
Jaemin Cho
@jmin__cho
May 20, 2025
Sharing some personal updates 🥳: - I've completed my PhD at @unccs! 🎓 - Starting Fall 2026, I'll be joining the Computer Science dept. at Johns Hopkins University (@JHUCompSci) as an Assistant Professor 💙 - Currently exploring options + finalizing the plan for my gap year (Aug
30K
Jaemin Cho
@jmin__cho
Dec 7, 2024
🚨 I’m on the 2024-2025 academic job market! j-min.io I work on ✨ Multimodal AI ✨, with a special focus on enhancing reasoning in both understanding and generation tasks by: 1⃣Making it more scalable 2⃣Making it more faithful 3⃣Evaluating and refining multimodal
64K
Jaemin Cho
@jmin__cho
Mar 19, 2024
Can we adaptively generate training environments with LLMs to help small embodied RL game agents learn useful skills that they are weak at? 🤔 👉 Check out EnvGen, an effective+efficient framework in which an LLM progressively generates and adapts training environments based on
69K
Jaemin Cho
@jmin__cho
Mar 5, 2020
VQ-VAE can be interpreted as Bayesian Networks with Mixture-Gaussian Prior, if we treat l2 distance between z_q and z_e as logit. Interesting. arxiv.org/abs/2002.08111 This also reminds me of @kchonyc's recent post about Soft K-NN.
Jaemin Cho
@jmin__cho
Oct 30, 2023
🚨New T2I Evaluation!🚨 We introduce Davidsonian Scene Graph (DSG) for reliable T2I evaluation with questions that: - are atomic and unique - cover full text prompt semantics (w/o hallucination) - and have valid consistencies google.github.io/dsg @GoogleAI @uncnlp @uwnlp 🧵
67K
Jaemin Cho
@jmin__cho
Oct 19, 2023
🎨DiagrammerGPT: a novel 2-stage text-to-diagram generation framework leveraging LLMs (e.g., GPT-4) to create fine-grained layouts for open-domain, open-platform diagrams (w/ dense objects+complex relations)! diagrammerGPT.github.io @AbhayZala7 @hanlin_hl @mohitban47 @uncnlp 🧵
GIF
00:32
Aran Komatsuzaki
@arankomatsuzaki
Oct 19, 2023
DiagrammerGPT: Generating Open-Domain, Open-Platform Diagrams via LLM Planning proj: diagrammergpt.github.io repo: github.com/aszala/Diagram… abs: arxiv.org/abs/2310.12128
47K
Jaemin Cho
@jmin__cho
May 25, 2023
Can modular, neuro-symbolic programs improve+explain text-to-image (T2I) generation & evaluation? 🚨Announcing 𝗩𝗣𝗚𝗲𝗻 & 𝗩𝗣𝗘𝘃𝗮𝗹, two interpretable+explainable visual programming frameworks for T2I gen & eval🚨 vp-t2i.github.io @AbhayZala7 @mohitban47 @uncnlp 🧵
00:00
42K
Jaemin Cho
@jmin__cho
May 1, 2024
🥳 I am honored and grateful to receive the @Bloomberg Data Science PhD Fellowship! A huge shoutout to my advisor @mohitban47, and many thanks to everyone at @uncnlp, along with all my collaborators and mentors, for their great support 😊🙏 @TechAtBloomberg @unccs
UNC Computer Science
@unccs
May 1, 2024
🎉 Congratulations to our PhD student Jaemin Cho (@jmin__cho) on receiving the prestigious @Bloomberg Data Science PhD Fellowship!🎓 A very well-deserved honor for his impactful multimodal AI work with Prof. @mohitban47 (@uncnlp)! bloomberg.com/company/values… @TechAtBloomberg @unc
19K
Jaemin Cho
@jmin__cho
Sep 29, 2022
Excited to share our #NeurIPS2022 paper! TVLT: Textless Vision-Language Transformer TVLT learns compact VL transformer representation from only visual👁 & audio👂signals w/o text arxiv.org/abs/2209.14156 github.com/zinengtang/TVLT @ZinengTang* @jmin__cho* @EasonNie* @mohitban47 🧵
arxiv.org
TVLT: Textless Vision-Language Transformer
In this work, we present the Textless Vision-Language Transformer (TVLT), where homogeneous transformer blocks take raw visual and audio inputs for vision-and-language representation learning with...
Jaemin Cho
@jmin__cho
Mar 9, 2022
DALL-E and friends can draw good images from text. But how can we evaluate them? Check out "DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generative Transformers"! arxiv.org/abs/2202.04053 github.com/j-min/DallEval @AbhayZala7 @MohitBan47 @uncnlp 🧵👇
Jaemin Cho
@jmin__cho
Jul 7, 2021
Can video-based grounding improve NLU tasks (incl. world/temporal/physical knowledge)? Check out our new work *VidLanKD*: Improving Language Understanding via Video-Distilled Knowledge Transfer! arxiv.org/abs/2107.02681 Led by @ZinengTang, w/ @HaoTan5 @MohitBan47 (@uncnlp) 🧵