I am currently a Ph.D candidate at TsinghuaNLP supervised by Prof. Maosong Sun. I obtained my bachelor degree at CST@THU.

My research interest lies in Efficient Method for NLP. I have published some papers at the top international AI conferences with total

🔥 News

📝 Publications

arXiv 2024.02

Yufei Huang, Shengding Hu, Xu Han, Zhiyuan Liu, Maosong Sun

We propose a comprehensive framework to provide a unified view of grokking, double descent and emergent abilities, focusing on the competition between memorization and generalization circuis in neural network.

Findings of EMNLP 2022

Yufei Huang*, Yujia Qin*, Huadong Wang, Yichun Yin, Maosong Sun, Zhiyuan Liu, Qun Liu

Project | |

In this work, we proppose Fast Prompt Tuning (FPT), which can save over 30% training computations while achieving comparable performance with vanilla Prompt Tuning.

arXiv 2023.04Tool Learning with Foundation Models Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Xuanhe Zhou, Yufei Huang, Chaojun Xiao and Other 33 authors. |
NAACL 2021TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun |
CIKM 2019Improving Web Image Search with Contextual Information Xiaohui Xie, Jiaxin Mao, Yiqun Liu, Maarten de Rijke, Qingyao Ai, Yufei Huang, Min Zhang, Shaoming Ma |

2020.06 Excellent Graduate (Bachelor), Department of Computer Science and Technology, Tsinghua University.
2018.10 China National Scholarship (Top 5% each year).
2017.12 Academic Progress Award in Tsinghua University.
2016.10 Second-class Scholarship for Freshmen of Tsinghua University (Top 10 in every province).

2023.04 - now, Ph.D Candidate, Department of Computer Science and Technology, Tsinghua University, Beijing.
2020.08 - 2023.04, Ph.D Student, Department of Computer Science and Technology, Tsinghua University, Beijing.
2016.08 - 2020.06, Undergraduate, Department of Computer Science and Technology, Tsinghua University, Beijing.