Liangyan Gui
I am a Research Assistant Professor of Computer Science at UIUC , where I work on computer vision and machine learning, with a specific focus on predictive learning and self-supervised learning.
Before joining UIUC, I worked at Argo with Deva Ramanan . I was a Postdoc at CMU, working with José M.F. Moura . I finished my PhD at CMU , advised by José M.F. Moura , and my master and undergraduate degrees at Tsinghua University.
Email: lgui@illinois.edu /
Google Scholar
InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions
Sirui Xu ,
Samuel Schulter ,
Morteza Ziyadi,
Xialin He ,
Xiaohan Fei ,
Yu-Xiong Wang ,
Liang-Yan Gui ,
CVPR , 2026
Project page
/
PDF
Unleashing Guidance Without Classifiers for Human-Object Interaction Animation
Ziyin Wang ,
Sirui Xu ,
Chuan Guo,
Bing Zhou ,
Jiangshan Gong ,
Jian Wang ,
Yu-Xiong Wang ,
Liang-Yan Gui ,
ICLR , 2026
BEAT: Visual Backdoor Attacks on VLM-based Embodied Agents via Contrastive Trigger Learning
Qiusi Zhan ,
Hyeonjeong Ha ,
Rui Yang ,
Sirui Xu ,
Hanyang Chen ,
Liang-Yan Gui ,
Yu-Xiong Wang ,
Huan Zhang ,
Heng Ji ,
Daniel Kang
ICLR , 2026
Project page
/
PDF
/
Code
3D-Fixup: Advancing Photo Editing with 3D Priors
Yen-Chi Cheng ,
Krishna Kumar Singh ,
Jae Shin Yoon ,
Alex Schwing ,
Liang-Yan Gui ,
Matheus Gadelha ,
Paul Guerrero ,
Nanxuan Zhao
SIGGRAPH , 2025
Project page
/
PDF
Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration
Sirui Xu ,
Yu-Wei Chao ,
Liuyu Bian ,
Arsalan Mousavian ,
Yu-Xiong Wang ,
Liang-Yan Gui ,
Wei Yang
CoRL , 2025
Project page
/
PDF
/
Code
InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions
Sirui Xu ,
Hung Yu Ling ,
Yu-Xiong Wang ,
Liang-Yan Gui
CVPR Highlight , 2025
Project page
/
PDF
/
Code
InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation
Sirui Xu ,
Dongting Li ,
Yucheng Zhang ,
Xiyan Xu ,
Qi Long ,
Ziyin Wang ,
Yunzhi Lu ,
Shuchang Dong ,
Hezi Jiang ,
Akshat Gupta ,
Yu-Xiong Wang ,
Liang-Yan Gui
CVPR , 2025
Project page /
PDF /
Code
MotionDiT: Text-Based Human Motion Editing with Motion Similarity Prediction via Diffusion Transformers
Zhengyuan Li ,
Kai Cheng ,
Anindita Ghosh ,
Uttaran Bhattacharya ,
Liang-Yan Gui ,
Aniket Bera
CVPR , 2025
Project page
/
PDF
/
Code
Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought
Yunze Man ,
De-An Huang ,
Guilin Liu ,
Shiwei Sheng ,
Shilong Liu ,
Liang-Yan Gui ,
Jan Kautz ,
Yu-Xiong Wang ,
Zhiding Yu
CVPR , 2025
Project page
/
PDF
Floating No More: Object-Ground Reconstruction from a Single Image
Yunze Man ,
Yichen Sheng ,
Jianming Zhang ,
Liang-Yan Gui ,
Yu-Xiong Wang
CVPR , 2025
Project page
/
PDF
LocateAnything3D: Vision-Language 3D Detection with Chain-of-Sight
Yunze Man ,
Shihao Wang ,
Guowen Zhang ,
Johan Bjorck ,
Zhiqi Li ,
Liang-Yan Gui ,
Jim Fan ,
Jan Kautz ,
Yu-Xiong Wang ,
Zhiding Yu
Tech Report , 2025
Project page
/
PDF
Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
Shengcao Cao ,
Liang-Yan Gui ,
Yu-Xiong Wang ,
ICCV Findings , 2024
Project page
/
PDF
/
Code
InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction
Sirui Xu ,
Ziyin Wang ,
Yu-Xiong Wang ,
Liang-Yan Gui
NeurIPS , 2024
Project page
/
PDF
Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene Reasoning
Yunze Man ,
Shuhong Zheng ,
Zhipeng Bao ,
Martial Hebert ,
Liang-Yan Gui ,
Yu-Xiong Wang
NeurIPS , 2024
Project page
/
PDF
/
Code
Aligning Large Multimodal Models with Factually Augmented RLHF
Zhiqing Sun ,
Sheng Shen ,
Shengcao Cao ,
Haotian Liu ,
Chunyuan Li ,
Yikang Shen ,
Chuang Gan ,
Liang-Yan Gui ,
Yu-Xiong Wang ,
Yiming Yang ,
Kurt Keutzer ,
Trevor Darrell
ACL Findings , 2024
Project page
/
PDF
/
Code
Situational Awareness Matters in 3D Vision Language Reasoning
Yunze Man ,
Liang-Yan Gui ,
Yu-Xiong Wang ,
CVPR , 2024
Project page
/
PDF
/
Code
SOHES: Self-supervised Open-world Hierarchical Entity Segmentation
Shengcao Cao ,
Jiuxiang Gu ,
Jason Kuen ,
Hao Tan ,
Ruiyi Zhang ,
Handong Zhao ,
Ani Nenkova ,
Liang-Yan Gui ,
Tong Sun ,
Yu-Xiong Wang ,
ICLR , 2024
Project page
/
PDF
/
Code
Virtual Pets: Animatable Animal Generation in 3D Scenes
Yen-Chi Cheng ,
Chieh Hubert Lin ,
Chaoyang Wang ,
Yash Kant ,
Sergey Tulyakov ,
Alex Schwing ,
Liang-Yan Gui ,
Hsin-Ying Lee
arXiv , 2023
Project page
/
PDF
/
Code
HASSOD: Hierarchical Adaptive Self-Supervised Object Detection
Shengcao Cao ,
Dhiraj Joshi ,
Liang-Yan Gui ,
Yu-Xiong Wang
NeurIPS , 2023
Project page
/
PDF
/
Code
InterDiff: Forecasting 3D Human-Object Interaction with Physics-Informed Diffusion
Sirui Xu ,
Zhengyuan Li ,
Yu-Xiong Wang ,
Liang-Yan Gui
ICCV , 2023
Project page
/
PDF
/
Code
DualCross: Cross-Modality Cross-Domain Adaptation for Monocular BEV Perception
Yunze Man ,
Liang-Yan Gui ,
Yu-Xiong Wang
IROS , 2023
Project page
/
PDF
/
Code
Learning Lightweight Object Detectors via Progressive Knowledge Distillation
Shengcao Cao ,
Mengtian Li ,
James Hays ,
Deva Ramanan ,
Yu-Xiong Wang ,
Liang-Yan Gui
ICML , 2023
PDF
Stochastic Multi-Person 3D Motion Forecasting
Sirui Xu ,
Yu-Xiong Wang ,
Liang-Yan Gui
ICLR , 2023 (Notable Top 25%) Project page
/
PDF
/
Code
SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generation
Yen-Chi Cheng , Hsin-Ying Lee , Sergey Tulyakov , Alex Schwing* ,
Liang-Yan Gui*
CVPR , 2023
Project page
/
PDF
/
Code
BEV-Guided Multi-Modality Fusion for Driving Perception
Yunze Man ,
Liang-Yan Gui ,
Yu-Xiong Wang
CVPR , 2023
Project page
/
PDF
/
Code
Contrastive Mean Teacher for Domain Adaptive Object Detectors
Shengcao Cao ,
Dhiraj Joshi ,
Liang-Yan Gui ,
Yu-Xiong Wang
CVPR , 2023
PDF
Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors
Sirui Xu ,
Yu-Xiong Wang* ,
Liang-Yan Gui*
ECCV , 2022 (Oral) Project page
/
PDF
/
Code
Joint Forecasting of Panoptic Segmentations with Difference Attention
Colin Graber ,
Cyril Jazra ,
Wenjie Luo ,
Liang-Yan Gui* ,
Alexander Schwing
CVPR , 2022 (Oral) PDF
/
Code
Adversarial Geometry-Aware Human Motion Prediction
Liang-Yan Gui* ,
Yu-Xiong Wang* ,
Xiaodan Liang ,
José M. F. Moura
ECCV , 2018 (Oral) PDF
Few-Shot Human Motion Prediction via Meta-Learning
Liang-Yan Gui* ,
Yu-Xiong Wang ,
Deva Ramanan ,
José M. F. Moura
ECCV , 2018
PDF
Teaching Robots to Predict Human Motion
Liang-Yan Gui ,
Kevin Zhang ,
Yu-Xiong Wang ,
Xiaodan Liang ,
José M. F. Moura
Manuela Veloso
IROS , 2018 (Oral) PDF
Geodesic distance on a Grassmannian for monitoring the progression of Alzheimer's Disease
Liang-Yan Gui ,
Xiaoying Tang ,
José M. F. Moura
NeuroImage , 2017
PDF
High-Assurance SPIRAL: End-to-End Guarantees for Robot and Car Control
Franz Franchetti ,
Tze Meng Low ,
Stefan Mitsch ,
Juan Paolo Mendoza ,
Liang-Yan Gui ,
Amarin Phaosawasdi ,
David Padua ,
Soummya Kar ,
José M. F. Moura ,
Mike Franusich ,
André Platzer ,
Jeremy Johnson ,
Manuela Veloso
IEEE Control Systems Magazine , 2016
PDF
Fall 2022, Fall 2023, Fall 2024, Spring 2025, Fall 2025, Spring 2026 Machine Learning (CS 446/ECE 449);
