My research interests lie in ML and NLP, with a specific focus on the training and evaluation of LMs. I am also paying attention to the evaluation and methods of computer agents. My goal is to make language models truly capable of solving problems in both the physical and digital worlds.

Currently, I am a research intern at Language Technologies Institute, Carnegie Mellon University, advised by Prof. Chenyan Xiong. During my exchange at the University of Hong Kong, I am fortunate to work with Prof. Tao Yu. Previously, I collaborated with Prof. Philip S. Yu and Prof. Xuming Hu at School of Software, Tsinghua University.

> I am looking for a Ph.D. position starting in 2025 Fall. Please feel free to reach out if you are interested.

Publications

(* stands for equal contribution)

Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning

Xiaochuan Li, Zichun Yu, Chenyan Xiong

ICLR 2025

[paper] [code]

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, Tao Yu

NIPS 2024 D&B Track

[paper] [code]

Evaluating Robustness of Generative Search Engine on Adversarial Factoid Questions

Xuming Hu*, Xiaochuan Li*, Junzhe Chen, Yinghui Li, Yangning Li, Xiaoguang Li, Yasheng Wang, Qun Liu, Lijie Wen, Philip S. Yu, Zhijiang Guo

ACL 2024 Findings

[paper] [code]

Towards Understanding Factual Knowledge of Large Language Models

Xuming Hu*, Junzhe Chen*, Xiaochuan Li*, Yufei Guo, Lijie Wen, Philip S. Yu, Zhijiang Guo

ICLR 2024 Spotlight

[paper] [code]

SongC: A Compiler for Hybrid Near-Memory and In-Memory Many-Core Architecture

Junfeng Lin*, Huanyu Qu*, Songchen Ma*, Xinglong Ji, Hongyi Li, Xiaochuan Li, Chenhang Song, Weihao Zhang

IEEE Transactions on Computers

[paper] [code]

Projects

OSWorld

The first-of-its-kind scalable, real computer environment for multimodal agents, supporting task setup, execution-based evaluation across various operating systems.

Repository Loading...

Montessori-Instruct

Montessori is a novel data synthesis framework that: tailors the data generation capabilities of the teacher model to align with the student's learning preferences.

Repository Loading...

Selected Honors & Awards

Special-Class Scholarship (清华大学特等奖学金)
(the highest honor, 10 out of 3,000) from Tsinghua University, 2024
The Fung Scholarship
from The Fung Foundation, 2024
Comprehensive Excellence Scholarship
(Top 1% in both Academics and Research) from Tsinghua University, 2022-2024

Misc

I am a professionally trained host and speaker.

At the speech venue for the Special-Class Scholarship, Tsinghua University.

Host the First International Basic Science Conference (ICBS) at the Great Hall of the People.

Chairman of the 21st Student Union of School of Software, Tsinghua University.

P.S: I come from the Northeast of China, which is the coldest province and also the only place in China where you can see the aurora. It has a cool name, called Black Loong.