Chengsong Huang

Welcome :-)

Hello! My name is Chengsong Huang. I am a fresh CSE Ph.D. student at Washington University in St. Louis,advised by Prof. Jiaxin Huang. Prior to WUSTL, I was an undergraduate student at Fudan University, majoring in Software Engineering.

I study natural language processing and multimodal-pretraining. I'm particularly interested in approaches that help tuning and using large models at lower cost.

News

[Mar 2025] New paper about efficient test-time scaling is released.

[Jan 2025] Two papers are accepted by ICLR.

[Jul 2024] The project Lorahub done in SAIL has been accepted by COLM!

Education

Aug 2023 - Present,
Ph.D. Student in Computer Science, Washington University in St. Louis.

Aug 2019 - Jul 2023,
B.Eng. in Software Engineering, School of Computer Science, Fudan University.

Selected Preprints

Efficient Test-Time Scaling via Self-Calibration
Chengsong Huang, Langlin Huang, Jixuan Leng, Jiacheng Liu, Jiaxin Huang
[Preprint]

Divide, Reweigh, and Conquer: a Logit Arithmetic Approach for In-Context Learning
Chengsong Huang, Langlin Huang, Jiaxin Huang
[Preprint]

Optimizing Language Model's Reasoning Abilities with Weak Supervision
Yongqi Tong, Sizhe Wang, Dawei Li, Yifan Wang, Simeng Han, Zi Lin, Chengsong Huang, Jiaxin Huang, Jingbo Shang
[Preprint]

Publications

GOFA: A Generative One-For-All Model for Joint Graph Language Modeling
Lecheng Kong, Jiarui Feng, Hao Liu, Chengsong Huang, Jiaxin Huang, Yixin Chen, Muhan Zhang
In Proceedings of ICLR 2025
[paper]

Taming Overconfidence in LLMS: Reward Calibration in RLHF
Jixuan Leng, Chengsong Huang, Banghua Zhu, Jiaxin Huang
In Proceedings of ICLR 2025
[paper]

LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
Chengsong Huang*, Qian Liu*, Bill Yuchen Lin*, Tianyu Pang, Chao Du, Min Lin
In Proceedings of COLM 2024
[paper]

Watermarking PLMs on Classification Tasks by Combining Contrastive Learning with Weight Perturbation
Chenxi Gu, Xiaoqing Zheng, Jianhan Xu, Muling Wu, Cenyuan Zhang, Chengsong Huang, Hua Cai, Xuanjing Huang
In Findings of EMNLP 2023
[Paper]

TableVLM: Multi-modal Pre-training for Table Structure Recognition
LeiYuan Chen, Chengsong Huang, Xiaoqing Zheng, Jinshu Lin, Xuanjing Huang
In Proceedings of ACL 2023
[Paper]

On Grounded Planning for Embodied Tasks with Language Models
Bill Yuchen Lin*, Chengsong Huang*, Qian Liu, Wenda Gu, Sam Sommerer, Xiang Ren
In Proceedings of AAAI 2023.
[Paper]

WebKE: Knowledge Extraction from Semi-structured Web with Pre-trained Markup Language Model
Chenhao Xie, Wenhao Huang, Jiaqing Liang, Chengsong Huang, Yanghua Xiao
In Proceedings of CIKM 2021
[Paper]

Revisiting the Negative Data of Distantly Supervised Relation Extraction
Chenhao Xie, Jiaqing Liang, Jingping Liu, Chengsong Huang, Wenhao Huang, Yanghua Xiao
In Proceedings of ACL 2021
[Paper]

Academic Service

Teaching

I am fortunate to serve as a TA for these amazing classes in Fudan University:

Fall 2022, Probability and Mathematical Statistics
Instructor: Prof. Lingfei Jin

Fall 2021, Data Structures and Algorithms
Instructor: Prof. Xiaoqing Zheng

Internships

Jan 2023 - Jun 2023, Research Intern,
@ SAIL, Sea AI Lab, advised by Qian Liu.

Miscellaneous