I am currently a Ph.D candidate at TsinghuaNLP supervised by Prof. Maosong Sun. I obtained my bachelor degree at CST@THU.
My research interest lies in Efficient Method for NLP. I have published some papers at the top international AI conferences with total
🔥 News
- 2024.02: 🎉 We release an elegant work on training dynamics.
- 2022.12: 🎉 One paper (FastPromptTuning) is accepted by Findings of EMNLP 2022
📝 Publications
arXiv 2024.02
Yufei Huang, Shengding Hu, Xu Han, Zhiyuan Liu, Maosong Sun
-
-
We propose a comprehensive framework to provide a unified view of grokking, double descent and emergent abilities, focusing on the competition between memorization and generalization circuis in neural network.
Findings of EMNLP 2022
FPT: Improving Prompt Tuning Efficiency via Progressive Training
Yufei Huang*, Yujia Qin*, Huadong Wang, Yichun Yin, Maosong Sun, Zhiyuan Liu, Qun Liu
Project | |
- In this work, we proppose Fast Prompt Tuning (FPT), which can save over 30% training computations while achieving comparable performance with vanilla Prompt Tuning.
arXiv 2023.04
Tool Learning with Foundation Models Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Xuanhe Zhou, Yufei Huang, Chaojun Xiao and Other 33 authors. |NAACL 2021
TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun |CIKM 2019
Improving Web Image Search with Contextual Information Xiaohui Xie, Jiaxin Mao, Yiqun Liu, Maarten de Rijke, Qingyao Ai, Yufei Huang, Min Zhang, Shaoming Ma |
🎖 Honors and Awards
- 2020.06 Excellent Graduate (Bachelor), Department of Computer Science and Technology, Tsinghua University.
- 2018.10 China National Scholarship (Top 5% each year).
- 2017.12 Academic Progress Award in Tsinghua University.
- 2016.10 Second-class Scholarship for Freshmen of Tsinghua University (Top 10 in every province).
📖 Educations
- 2023.04 - now, Ph.D Candidate, Department of Computer Science and Technology, Tsinghua University, Beijing.
- 2020.08 - 2023.04, Ph.D Student, Department of Computer Science and Technology, Tsinghua University, Beijing.
- 2016.08 - 2020.06, Undergraduate, Department of Computer Science and Technology, Tsinghua University, Beijing.