Chengsong Huang

Welcome :-)

Hello! My name is Chengsong Huang. I am a fresh CSE Ph.D. student at Washington University in St. Louis,advised by Prof. Jiaxin Huang. Prior to WUSTL, I was an undergraduate student at Fudan University, majoring in Software Engineering.

I study natural language processing and multimodal-pretraining. I'm particularly interested in approaches that help tuning and using large models at lower cost.

News

[Jul 2024] The project Lorahub done in SAIL has been accepted by COLM!

[Oct 2023] A paper about Watermarking in LM has been accepted by EMNLP findings. (working for camera ready now)

[May 2023] Our paper TableVLM is accepted by ACL 2023 !

Education

Aug 2023 - Present,
Ph.D. Student in Computer Science, Washington University in St. Louis.

Aug 2019 - Jul 2023,
B.Eng. in Software Engineering, School of Computer Science, Fudan University.

Preprints

Divide, Reweigh, and Conquer: a Logit Arithmetic Approach for In-Context Learning
Chengsong Huang, Langlin Huang, Jiaxin Huang
[Preprint]

Taming Overconfidence in LLMS: Reward Calibration in RLHF
Jixuan Leng, Chengsong Huang, Banghua Zhu, Jiaxin Huang
[Preprint]

Watermarking Pre-trained Language Models with Backdooring
Chenxi Gu*, Chengsong Huang*, Xiaoqing Zheng, Kai-Wei Chang, Cho-Jui Hsieh
[Preprint]

Publications

LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
Chengsong Huang*, Qian Liu*, Bill Yuchen Lin*, Tianyu Pang, Chao Du, Min Lin
In Proceedings of COLM 2024
[paper]

Watermarking PLMs on Classification Tasks by Combining Contrastive Learning with Weight Perturbation
Chenxi Gu, Xiaoqing Zheng, Jianhan Xu, Muling Wu, Cenyuan Zhang, Chengsong Huang, Hua Cai, Xuanjing Huang
In Findings of EMNLP 2023
[Paper]

TableVLM: Multi-modal Pre-training for Table Structure Recognition
LeiYuan Chen, Chengsong Huang, Xiaoqing Zheng, Jinshu Lin, Xuanjing Huang
In Proceedings of ACL 2023
[Paper]

On Grounded Planning for Embodied Tasks with Language Models
Bill Yuchen Lin*, Chengsong Huang*, Qian Liu, Wenda Gu, Sam Sommerer, Xiang Ren
In Proceedings of AAAI 2023.
[Paper]

WebKE: Knowledge Extraction from Semi-structured Web with Pre-trained Markup Language Model
Chenhao Xie, Wenhao Huang, Jiaqing Liang, Chengsong Huang, Yanghua Xiao
In Proceedings of CIKM 2021
[Paper]

Revisiting the Negative Data of Distantly Supervised Relation Extraction
Chenhao Xie, Jiaqing Liang, Jingping Liu, Chengsong Huang, Wenhao Huang, Yanghua Xiao
In Proceedings of ACL 2021
[Paper]

Academic Service

Teaching

I am fortunate to serve as a TA for these amazing classes in Fudan University:

Fall 2022, Probability and Mathematical Statistics
Instructor: Prof. Lingfei Jin

Fall 2021, Data Structures and Algorithms
Instructor: Prof. Xiaoqing Zheng

Internships

Jan 2023 - Jun 2023, Research Intern,
@ SAIL, Sea AI Lab, advised by Qian Liu.

Miscellaneous