|
Zhiheng Xi I am a final-year PhD candidate at Fudan NLP Group of Computer School, Fudan University, where I work on Large Language Model (LLM) and Agentic AI. I am advised by Prof. Tao Gui, Prof. Qi Zhang, and Prof. Xuanjing Huang. Previously, I got my bachelor's degree from Nanjing University, advised by Prof. Jia Liu. I have been honored to work at Microsoft Azure, ByteDance Seed, Meituan LongCat, Nex-AGI, and Tencent HY. Email / Google Scholar / Github / Twitter |
|
ResearchI have general interest in deep learning and natural language processing. Recently, I focus my work on Agents, RL, and Scalable Oversight. |
|
AI for Productivity in the Age of Agentic AI
Zhiheng Xi, Enyu Zhou, Xinyu Fang, Zhe Sun, Baodai Huang, Jiajun Sun, Bicheng Deng, Zhihao Zhang, Wenxiang Chen, Jiazheng Zhang, Shichun Liu, Xin Guo, Zhikai Lei, Junke Wang, Senjie Jin, Yang Nan, Yajie Yang, Rui Zheng, Hang Yan, Yuchen Tian, Mengyue Yang, Yinghui He, Fang Wu, Cheng Qian, Xuandong Zhao, Yingcheng Wu, Mingchen Zhuge, Zhenfei Yin, Ling Yang, Jun Wang, Kejun Ying, Philip Torr, Tao Gui, Zuxuan Wu, Xipeng Qiu, Yu-Gang Jiang, Qi Zhang, Xuanjing Huang Preprint, 2026. project page / codes / paper |
|
The Rise and Potential of Large Language Model Based
Agents: A Survey
Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, Rui Zheng, Xiaoran Fan, Xiao Wang, Limao Xiong, Qin Liu, Yuhao Zhou, Weiran Wang, Changhao Jiang, Yicheng Zou, Xiangyang Liu, Zhangyue Yin, Shihan Dou, Rongxiang Weng, Wensen Cheng, Qi Zhang, Wenjuan Qin, Yongyan Zheng, Xipeng Qiu, Xuanjing Huang, Tao Gui SCIENCE CHINA Information Sciences (SCIS), Cover Paper of SCIS Volume 68, Number 2, February 2025. project page / paper 
|
|
AgentGym: Evolving Large Language Model-based Agents
across Diverse Environments
Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Dingwen Yang, Chenyang Liao, Xin Guo, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang ACL 2025. project page / codes and platform / paper / dataset / benchmark / model 
|
|
AgentGym-RL: Training LLM Agents for Long-Horizon
Decision Making through Multi-Turn Reinforcement Learning
Zhiheng Xi, Jixuan Huang, Chenyang Liao, Baodai Huang, Honglin Guo, Jiaqi Liu, Rui Zheng, Junjie Ye, Jiazheng Zhang, Wenxiang Chen, Wei He, Yiwen Ding, Guanyu Li, Zehui Chen, Zhengyin Du, Xuesong Yao, Yufei Xu, Jiecao Chen, Tao Gui, Zuxuan Wu, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang ICLR 2026 Oral (Top 1.1%). project page / codes / paper 
|
|
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
Zhiheng Xi, Dingwen Yang, Jiaqi Liu, Jixuan Huang, Honglin Guo, Baodai Huang, Tinggang Chen, Qi Zhang, Zhonghang Lu, Chenyu Liu, Jiajun Sun, Jiazheng Zhang, Dingwei Zhu, Xin Guo, Junzhe Wang, Zhihao Zhang, Yuming Yang, Junjie Ye, Minghe Gao, Dongrui Liu, Jiaming Ji, Guohao Li, Tao Gui, Qi Zhang, Xuanjing Huang ACL 2026. codes / dataset / paper |
|
SciAgentGym: Benchmarking Multi-Step Scientific Tool-use in LLM Agents
Yujiong Shen*, Yajie Yang*, Zhiheng Xi*, Binze Hu, Huayu Sha, Jiazheng Zhang, Qiyuan Peng, Junlin Shang, Jixuan Huang, Yutao Fan, Jingqi Tong, Shihan Dou, Ming Zhang, Lei Bai, Zhenfei Yin, Tao Gui, Xingjun Ma, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang ICML 2026. codes / paper 
|
|
AgentPRM: Process Reward Models for LLM Agents via
Step-Wise Promise and Progress
Zhiheng Xi, Chenyang Liao, Guanyu Li, Zhihao Zhang, Wenxiang Chen, Binghai Wang, Senjie Jin, Yuhao Zhou, Jian Guan, Wei Wu, Tao Ji, Tao Gui, Qi Zhang, Xuanjing Huang WWW 2026. paper / codes |
|
Steering LLMs via Scalable Interactive Oversight
Enyu Zhou, Zhiheng Xi, Long Ma, Zhihao Zhang, Shihan Dou, Zhikai Lei, Guoteng Wang, Rui Zheng, Hang Yan, Tao Gui, Qi Zhang, Xuanjing Huang Preprint, 2026. ICML workshop / Hugging Face / paper |
|
BAPO: Stabilizing Off-Policy Reinforcement Learning for
LLMs via Balanced Policy Optimization with Adaptive Clipping
Zhiheng Xi, Xin Guo, Yang Nan, Enyu Zhou, Junrui Shen, Wenxiang Chen, Jiaqi Liu, Jixuan Huang, Zhihao Zhang, Honglin Guo, Xun Deng, Zhikai Lei, Miao Zheng, Guoteng Wang, Shuo Zhang, Peng Sun, Rui Zheng, Hang Yan, Tao Gui, Qi Zhang, Xuanjing Huang ICLR 2026. codes / paper 
|
|
BMMR: A Large-Scale Bilingual Multimodal
Multi-Discipline Reasoning Dataset
Zhiheng Xi, Guanyu Li, Yutao Fan, Honglin Guo, Yufang Liu, Xiaoran Fan, Jiaqi Liu, Jingchao Ding, Wangmeng Zuo, Zhenfei Yin, Lei Bai, Tao Ji, Tao Gui, Qi Zhang, Philip Torr, Xuanjing Huang NeurIPS 2025. project page / codes / paper / dataset |
|
Critique-RL: Training Language Models for Critiquing
through Two-Stage Reinforcement Learning
Zhiheng Xi, Jixuan Huang, Xin Guo, Boyang Hong, Dingwen Yang, Xiaoran Fan, Shuo Li, Zehui Chen, Junjie Ye, Siyu Yuan, Zhengyin Du, Xuesong Yao, Yufei Xu, Jiecao Chen, Rui Zheng, Tao Gui, Qi Zhang, Xuanjing Huang ICLR 2026. codes / paper |
|
Memory in the Age of AI Agents
Project Team (including Zhiheng Xi) Preprint, 2025. project page / paper 
|
|
MathCritique: Enhancing LLM Reasoning via Critique
Models with Test-Time and Training-Time Supervision
Zhiheng Xi, Dingwen Yang, Jixuan Huang, Jiafu Tang, Guanyu Li, Yiwen Ding, Wei He, Boyang Hong, Shihan Do, Wenyu Zhan, Xiao Wang, Rui Zheng, Tao Ji, Xiaowei Shi, Yitao Zhai, Rongxiang Weng, Jingang Wang, Xunliang Cai, Tao Gui, Zuxuan Wu, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Yu-Gang Jiang Preprint. Nov, 2024 project page / codes / paper / dataset 
|
|
Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Construction
Nex-AGI Team (including Zhiheng Xi) Preprint, 2025. project page / codes / models / paper |
|
Training Large Language Models for Reasoning through
Reverse Curriculum Reinforcement Learning
Zhiheng Xi, Wenxiang Chen, Boyang Hong, Senjie Jin, Rui Zheng, Wei He, Yiwen Ding, Shichun Liu, Xin Guo, Junzhe Wang, Honglin Guo, Wei Shen, Xiaoran Fan, Yuhao Zhou, Shihan Dou, Xiao Wang, Xinbo Zhang, Peng Sun, Tao Gui, Qi Zhang, Xuanjing Huang ICML 2024; CIPS-LMG 2024 Outstanding Poster codes / paper 
|
|
AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoning
Honglin Guo, Qi Zhang, Yu Zhang, Weijie Li, Rui Zheng, Zhikai Lei, Qiyuan Peng, Zhiheng Xi, Tao Gui, Qi Zhang Preprint, 2026. Hugging Face / paper |
|
NexForge: Scaling Executable Agent Tasks via Requirement-First Synthesis
Jiarong Zhao, Zhikai Lei, Zhiheng Xi, Rui Zheng, Hang Yan, Jie Zhou, Qin Chen, Liang He Preprint, 2026. project page / models / paper |
|
Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
Jiahang Lin, Shichun Liu, Chengjun Pan, Lizhi Lin, Shihan Dou, Zhiheng Xi, Xuanjing Huang, Hang Yan, Zhenhua Han, Tao Gui, Yu-Gang Jiang Preprint, 2026. codes / paper 
|
|
Mitigating Tail Narrowing in LLM Self-Improvement via
Socratic-Guided Sampling
Yiwen Ding*, Zhiheng Xi* (Co-first Author), Wei He, Zhuoyuan Li, Yitao Zhai, Xiaowei Shi, Xunliang Cai, Tao Gui, Qi Zhang, Xuanjing Huang NAACL 2024 codes / paper |
|
Distill Visual Chart Reasoning Ability from LLMs to
MLLMs
Wei He*, Zhiheng Xi* (Co-first Author), Wanxu Zhao*, Xiaoran Fan, Yiwen Ding, Zifei Shan, Tao Gui, Qi Zhang, Xuanjing Huang EMNLP 2025. codes / paper / dataset |
|
RMB: Comprehensively Benchmarking Reward Models in LLM
Alignment
Enyu Zhou*, Guodong Zheng*, Binghai Wang*, Zhiheng Xi, Shihan Dou, Rong Bao, Wei Shen, Limao Xiong, Jessica Fan, Yurong Mou, Rui Zheng, Tao Gui, Qi Zhang, Xuanjing Huang ICLR 2025 codes / paper |
|
Self-Polish: Enhance Reasoning in Large Language Models
via Problem Refinement
Zhiheng Xi, Senjie Jin, Yuhao Zhou, Rui Zheng, Songyang Gao, Jia Liu, Tao Gui, Qi Zhang, Xuanjing Huang EMNLP 2023 Findings. codes / paper |
|
Connectivity Patterns are Task Embeddings
Zhiheng Xi, Rui Zheng, Yuansen Zhang, XuanJing Huang, Zhongyu Wei, Minlong Peng, Mingming Sun, Qi Zhang, Tao Gui ACL 2023 Findings. codes / paper |
|
Efficient Adversarial Training with Robust Early-Bird
Tickets
Zhiheng Xi, Rui Zheng, Tao Gui, Qi Zhang, Xuanjing Huang EMNLP 2022. codes / paper |
|
Characterizing the Impacts of Instances on
Robustness
Rui Zheng*, Zhiheng Xi* (Co-first Author), Qin Liu, Wenbin Lai, Tao Gui, Qi Zhang, Xuanjing Huang, Jin Ma, Ying Shan, Weifeng Ge ACL 2023 Findings. codes / paper |
|
Improving Generalization of Alignment with Human
Preferences through Group Invariant Learning
Rui Zheng, Wei Shen, Yuan Hua, Wenbin Lai, Shihan Dou, Yuhao Zhou, Zhiheng Xi, Xiao Wang, Haoran Huang, Tao Gui, Qi Zhang, Xuanjing Huang ICLR 2024 (Spotlight). codes / paper |
|
EasyJailbreak: A Unified Framework for Jailbreaking
Large Language Models
Project Team (Including Zhiheng Xi) Preprint. Mar, 2024. project page / paper |
|
Secrets of RLHF in Large Language Models Part II:
Reward Modeling
Project Team (Including Zhiheng Xi) Preprint. Jan, 2024. codes / paper |
|
Secrets of RLHF in Large Language Models Part I:
PPO
Project Team (Including Zhiheng Xi) Preprint. July, 2023. codes / paper |
|
RoCoIns: Enhancing Robustness of Large Language Models
through Code-Style Instructions
Yuansen Zhang, Xiao Wang, Zhiheng Xi, Han Xia, Tao Gui, Qi Zhang, Xuanjing Huang COLING 2024. paper |
Miscellanea
|
|
Updated at Sep 2025
Thanks Jon Barron for this fantastic
template!
|