Lingming Zhang (@LingmingZhang) / X

Lingming Zhang

480 posts

Lingming Zhang

@LingmingZhang

Associate Professor @plfmse @IllinoisCS. Enjoy breaking, fixing, and synthesizing software. SE | PL | FM | LLM4Code

Champaign, IL

lingming.cs.illinois.edu

Joined May 2012

Pinned
Lingming Zhang
@LingmingZhang
Nov 21, 2025
🤯🤯🤯 Gemini 3 Pro + Live-SWE-agent hits 77.4% on SWE-bench Verified, beating ALL existing models, including Claude 4.5!! 🤖 Live-SWE-agent is the first live software agent that autonomously self-evolves on the fly — and it even outperforms the manually engineered scaffold
114K
Lingming Zhang
@LingmingZhang
Jul 3, 2024
Introducing OpenAutoCoder-Agentless😺: A simple agentless solution solves 27.3% GitHub issues on SWE-bench Lite with ~$0.34 each, outperforming all open-source AI SW agents! It's fully open-source, try it out: 🧑‍💻github.com/OpenAutoCoder/… 📝huggingface.co/papers/2407.01…
97K
Lingming Zhang
@LingmingZhang
Mar 8, 2023
🚨LLMs are Zero-Shot Fuzzers! Excited to share our TitanFuzz🤖 work @issta23: #LLMs can be directly applied for both generative and mutative fuzzing, while being fully automated, generalizable, and applicable to domains challenging for traditional fuzzers (such as DL systems)🧵
30K
Lingming Zhang
@LingmingZhang
Sep 9, 2024
🚨 Excited to share our recent survey on LLM-based Agents for Software Engineering! We will keep updating the relevant paper list at:
Yiling Lou
@yiling__LOU
Sep 9, 2024
Introducing our latest survey on LLM-based Agents for Software Engineering (SE) LLM-based agents have shown remarkable effectiveness in SE. This survey covers 106 papers and summarizes them from both SE and agent perspective. 📝arxiv.org/pdf/2409.02977 🧑‍💻github.com/FudanSELab/Age…
GitHub - FudanSELab/Agent4SE-Paper-List: Repository for the paper "Large Language Model-Based...
From github.com
26K
Lingming Zhang
@LingmingZhang
Dec 1, 2022
Super grateful to receive this award, and looking forward to working on this exciting project with @Meta ! Special thanks to my students and colleagues at @plfmse and @IllinoisCS
Siebel School of Computing and Data Science
@siebelschool
Dec 1, 2022
Congratulations to Lingming Zhang for winning a Meta 2022 AI4AI Research award! His innovative Intelligent Software Engineering (iSE) Lab will collaborate with Meta Research on learning to fuzz tensor compilers. 🔸♾️🔹 bit.ly/3Up8mAg
Lingming Zhang
@LingmingZhang
Aug 14, 2024
“On SWE-bench Verified, GPT-4o resolves 33.2% of samples, with the best performing open-source scaffold, Agentless.” Wow, our Agentless😺 is used by @OpenAI as the default technique to evaluate the performance of GPT-4o on SWE-bench! 🧑‍💻
OpenAI
@OpenAI
Aug 13, 2024
We're releasing a new iteration of SWE-bench, in collaboration with the original authors, to more reliably evaluate AI models on their ability to solve real-world software issues. openai.com/index/introduc…
GitHub - OpenAutoCoder/Agentless: Agentless🐱: an agentless approach to automatically solve...
From github.com
9.8K
Lingming Zhang
@LingmingZhang
Mar 29, 2023
🏆 NNSmith just won the Distinguished Artifact Award at #ASPLOS23! NNSmith has found various bugs for popular deep learning systems (ONNXRuntime, PyTorch, TensorFlow, TensorRT, TVM, and more!). Try our tool if you're interested in MLSys reliability:
Jiawei Liu
@JiaweiLiu_
Mar 27, 2023
Today we will present our new work "NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers" @ASPLOSConf at Session 2A (1pm PT). Welcome to join our talk to learn how we build an automated tool for finding 70+ bugs (and more now!) for emerging DL compilers!
GitHub - ise-uiuc/nnsmith: Automated DNN generation for fuzz testing and more
From github.com
9K
Lingming Zhang
@LingmingZhang
Sep 21, 2023
🥳 Great news, EvalPlus has been accepted at #NeurIPS 2023!! Joint work with my amazing students: @JiaweiLiu_ @steven_xia_ @YuyaoStarling Interested in building/assessing LLMs for code? please consider HumanEval+ for more rigorous evaluation:
AK
@_akhaliq
May 3, 2023
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation extensive evaluation across 14 popular LLMs (including GPT-4 and ChatGPT) demonstrates that HUMANEVAL+ is able to catch significant amounts of previously undetected
GitHub - evalplus/evalplus: Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024
From github.com
15K
Lingming Zhang
@LingmingZhang
Jul 3, 2024
Replying to @LingmingZhang
Agentless leverages a simplistic two-phase approach: localization and repair. It first leverages hierarchical localization to decide the exact locations for editing via LLM. Then, it directly prompts LLM for patch generation using a patch format following Aider.
15K
Lingming Zhang
@LingmingZhang
Dec 4, 2023
Very happy to share that our work "NeuRI: Diversifying DNN Generation via Inductive Rule Inference" received the ACM @sigsoft Distinguished Paper Award 🏆 at @fseconf 2023! If you are around, please come to @JiaweiLiu_ 's talk this Wednesday morning: tinyurl.com/2t9zmprw
Jiawei Liu
@JiaweiLiu_
Dec 4, 2023
Interested in program synthesis for creating random DNNs? and its application on automated testing? Check our new work: “NeuRI: Diversifying DNN Generation via Inductive Rule Inference” with a Distinguished Paper Award @FSEconf! w/ Jinjun, @YuyaoStarling, @LingmingZhang
7.2K
Lingming Zhang
@LingmingZhang
Oct 17, 2022
Super grateful to receive an @ASE_conf Distinguished Paper Award🏆 for our work on neural bug seeding! Joint effort w/ Zhao, @JeremyChen92, Qihao, and Junjie. Check out our paper for more details: tinyurl.com/5bv8bt3r
PL/FM/SE at Illinois
@plfmse
Oct 17, 2022
We're very glad to hear that a paper from @plfmse was awarded ACM SIGSOFT Distinguished Paper Award at @ASE_conf . Congratulations to @LingmingZhang for his paper "Learning to Construct Better Mutation Faults" !
Lingming Zhang
@LingmingZhang
Sep 29, 2022
Didn’t realize I got an account 10 years ago until multiple friends told me they found me on twitter. So, here I am:)
Lingming Zhang
@LingmingZhang
Apr 16, 2024
Just landed in the beautiful Lisbon. First conference trip outside of US since 2019. Really looking forward to meeting everyone tomorrow! #icse24
1.8K
Lingming Zhang
@LingmingZhang
Jun 13, 2024
Proud advisor moment: Very excited to share that my PhD student @yinlin_deng is one of only two recipients worldwide of the prestigious Two Sigma PhD Fellowship this year!
Siebel School of Computing and Data Science
@siebelschool
Jun 12, 2024
Congratulations to #ILLINOIS CS student Yinlin Deng for winning a Two Sigma PhD Fellowship that will go toward her research in software engineering and machine learning! 🔸🎉🔹 ▶️bit.ly/3xf0OL4
2.6K