Chengsong Huang

Welcome :-)

Hello! My name is Chengsong Huang. I am a second year CSE Ph.D. candidate at Washington University in St. Louis,advised by Prof. Jiaxin Huang. Prior to WUSTL, I was an undergraduate student at Fudan University, majoring in Software Engineering.

I study natural language processing and multimodal-pretraining. I'm particularly interested in approaches that help tuning and using large models at lower cost.

News

[Aug 2025] New paper R-Zero is released! Very happy that R-Zero is the second paper of HuggingFace's Daily Papers!

[Jul 2025] CrossWordBench is accepted by COLM 2025!

[Apr 2025] I passed my qualifying exam! And my citation has reached 500!

Education

Aug 2023 - Present,
Ph.D. Student in Computer Science, Washington University in St. Louis.

Aug 2019 - Jul 2023,
B.Eng. in Software Engineering, School of Computer Science, Fudan University.

Selected Preprints

R-Zero: Self-Evolving Reasoning LLM from Zero Data
Chengsong Huang, Wenhao Yu, Xiaoyang Wang, Hongming Zhang, Zongxia Li, Ruosen Li, Jiaxin Huang, Haitao Mi, Dong Yu
[Preprint][code]

Efficient Test-Time Scaling via Self-Calibration
Chengsong Huang, Langlin Huang, Jixuan Leng, Jiacheng Liu, Jiaxin Huang
[Preprint]

Divide, Reweigh, and Conquer: a Logit Arithmetic Approach for In-Context Learning
Chengsong Huang, Langlin Huang, Jiaxin Huang
[Preprint]

Publications

GOFA: A Generative One-For-All Model for Joint Graph Language Modeling
Lecheng Kong, Jiarui Feng, Hao Liu, Chengsong Huang, Jiaxin Huang, Yixin Chen, Muhan Zhang
In Proceedings of ICLR 2025
[paper]

Taming Overconfidence in LLMS: Reward Calibration in RLHF
Jixuan Leng, Chengsong Huang, Banghua Zhu, Jiaxin Huang
In Proceedings of ICLR 2025
[paper]

LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
Chengsong Huang*, Qian Liu*, Bill Yuchen Lin*, Tianyu Pang, Chao Du, Min Lin
In Proceedings of COLM 2024
[paper]

Watermarking PLMs on Classification Tasks by Combining Contrastive Learning with Weight Perturbation
Chenxi Gu, Xiaoqing Zheng, Jianhan Xu, Muling Wu, Cenyuan Zhang, Chengsong Huang, Hua Cai, Xuanjing Huang
In Findings of EMNLP 2023
[Paper]

TableVLM: Multi-modal Pre-training for Table Structure Recognition
LeiYuan Chen, Chengsong Huang, Xiaoqing Zheng, Jinshu Lin, Xuanjing Huang
In Proceedings of ACL 2023
[Paper]

On Grounded Planning for Embodied Tasks with Language Models
Bill Yuchen Lin*, Chengsong Huang*, Qian Liu, Wenda Gu, Sam Sommerer, Xiang Ren
In Proceedings of AAAI 2023.
[Paper]

WebKE: Knowledge Extraction from Semi-structured Web with Pre-trained Markup Language Model
Chenhao Xie, Wenhao Huang, Jiaqing Liang, Chengsong Huang, Yanghua Xiao
In Proceedings of CIKM 2021
[Paper]

Revisiting the Negative Data of Distantly Supervised Relation Extraction
Chenhao Xie, Jiaqing Liang, Jingping Liu, Chengsong Huang, Wenhao Huang, Yanghua Xiao
In Proceedings of ACL 2021
[Paper]

Academic Service

Teaching

I am fortunate to serve as a TA for these amazing classes in Fudan University:

Fall 2022, Probability and Mathematical Statistics
Instructor: Prof. Lingfei Jin

Fall 2021, Data Structures and Algorithms
Instructor: Prof. Xiaoqing Zheng

Internships

Jun 2025 - Aug 2025, Research Intern,
@ Tencent Seattle AI Lab, advised by Wenhao Yu.

Jan 2023 - Jun 2023, Research Intern,
@ SAIL, Sea AI Lab, advised by Qian Liu.

Miscellaneous