Yafu Li

I am a researcher in Shanghai / Pujiang AI Lab, under the supervision of Prof. Yu Cheng. I earned my PhD through joint training at Zhejiang University and Westlake University under the guidance of Prof. Yue Zhang. During my internship at Tencent AI Lab, I collaborated closely with Dr. Leyang Cui and Dr. Wei Bi.

I earned my Bachelor’s degree at Wuhan University and subsequently pursued a Master’s degree at the University of Edinburgh, where I was supervised by Prof. Alex Lascarides. Prior to my PhD, I worked as an NLP researcher in Noah Ark's lab at Huawei, under the mentorship of Dr. Liangyou Li and Prof. Qun Liu.

I aim to make language models more reliable and aligned with human values while maintaining their powerful capabilities. My current focus is on developing lightweight methods to improve LLM outputs during inference time, rather than expensive retraining. I'm also interested in detecting and mitigating potential risks from AI systems like machine-generated text.

Publications

Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedback

Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedback

Yafu Li, Xuyang Hu, Xiaoye Qu, Linjie Li, Yu Cheng

ABSHTMLPDF
From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning

From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning

Yafu Li, Zhilin Wang, Ting Fu, Ganqu Cui, Sen Yang, Yu Cheng

ABSHTMLPDF
Keys to Robust Edits: from Theoretical Insights to Practical Advances

Keys to Robust Edits: from Theoretical Insights to Practical Advances

Jianhao Yan, Futing Wang, Yun Luo, Yafu Li, Yue Zhang

arXiv.org 2024

ABSHTMLPDF
LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation

LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation

Yongjing Yin, Jiali Zeng, Yafu Li, Fandong Meng, Yue Zhang

Conference on Empirical Methods in Natural Language Processing 2024

ABSHTMLPDF
Spotting AI's Touch: Identifying LLM-Paraphrased Spans in Text

Spotting AI's Touch: Identifying LLM-Paraphrased Spans in Text

Yafu Li, Zhilin Wang, Leyang Cui, Wei Bi, Shuming Shi, Yue Zhang

Annual Meeting of the Association for Computational Linguistics 2024

ABSHTMLPDF
What Have We Achieved on Non-autoregressive Translation?

What Have We Achieved on Non-autoregressive Translation?

Yafu Li, Huajian Zhang, Jianhao Yan, Yongjing Yin, Yue Zhang

Annual Meeting of the Association for Computational Linguistics 2024

ABSHTMLPDF

On compositional generalization of transformer-based neural machine translation

Yongjing Yin, Lian Fu, Yafu Li, Yue Zhang

Information Fusion 2024

ABS
Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers

Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers

Fang Guo, Wenyu Li, Honglei Zhuang, Yun Luo, Yafu Li, Le Yan, Yue Zhang

arXiv.org 2024

ABSPDF
Potential and Challenges of Model Editing for Social Debiasing

Potential and Challenges of Model Editing for Social Debiasing

Jianhao Yan, Futing Wang, Yafu Li, Yue Zhang

arXiv.org 2024

ABSHTMLPDF

An experimental investigation of high-temperature thermochemical conversion of oil shale residues into valuable materials

Jia Song, L. Fu, Xu Zou, Yafu Li, Qingjin Zhang, Guangwen Xu, D. Bai

Chemical Engineering and Science 2023

ABS
Understanding In-Context Learning from Repetitions

Understanding In-Context Learning from Repetitions

Jianhao Yan, Jin Xu, Chiyu Song, Chenming Wu, Yafu Li, Yue Zhang

International Conference on Learning Representations 2023

ABSHTMLPDF
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models

Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models

Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, Longyue Wang, A. Luu, Wei Bi, Freda Shi, Shuming Shi

arXiv.org 2023

ABSPDF
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning

An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning

Yun Luo, Zhen Yang, Fandong Meng, Yafu Li, Jie Zhou, Yue Zhang

arXiv.org 2023

ABSHTMLPDF
Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotation

Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotation

Yulong Chen, Huajian Zhang, Yijie Zhou, Xuefeng Bai, Yueguan Wang, Ming Zhong, Jianhao Yan, Yafu Li, Judy Li, Xianchao Zhu, Yue Zhang

Annual Meeting of the Association for Computational Linguistics 2023

ABSHTMLPDF
Explicit Syntactic Guidance for Neural Text Generation

Explicit Syntactic Guidance for Neural Text Generation

Yafu Li, Leyang Cui, Jianhao Yan, Yongjng Yin, Wei Bi, Shuming Shi, Yue Zhang

Annual Meeting of the Association for Computational Linguistics 2023

ABSHTMLPDF
MAGE: Machine-generated Text Detection in the Wild

MAGE: Machine-generated Text Detection in the Wild

Yafu Li, Qintong Li, Leyang Cui, Wei Bi, Zhilin Wang, Longyue Wang, Linyi Yang, Shuming Shi, Yue Zhang

Annual Meeting of the Association for Computational Linguistics 2023

ABSHTMLPDF

GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspective

Linyi Yang, Shuibai Zhang, Libo Qin, Yafu Li, Yidong Wang, Hanmeng Liu, Jindong Wang, Xingxu Xie, Yue Zhang

Annual Meeting of the Association for Computational Linguistics 2022

ABSPDF

Multi-Granularity Optimization for Non-Autoregressive Translation

Yafu Li, Leyang Cui, Yongjing Yin, Yue Zhang

Conference on Empirical Methods in Natural Language Processing 2022

ABSPDF
Categorizing Semantic Representations for Neural Machine Translation

Categorizing Semantic Representations for Neural Machine Translation

Yongjing Yin, Yafu Li, Fandong Meng, Jie Zhou, Yue Zhang

International Conference on Computational Linguistics 2022

ABSPDF
On Compositional Generalization of Neural Machine Translation

On Compositional Generalization of Neural Machine Translation

Yafu Li, Yongjing Yin, Yulong Chen, Yue Zhang

Annual Meeting of the Association for Computational Linguistics 2021

ABSPDF

Multi-level Contrastive Learning for Keyphrase Generation

Yafu Li, Shinian Li, Heng Yu, Zhuang Wu

International Conference on Intelligent Computing 2024

ABS
Deepfake Text Detection in the Wild

Deepfake Text Detection in the Wild

Yafu Li, Qintong Li, Leyang Cui, Wei Bi, Longyue Wang, Linyi Yang, Shuming Shi, Yue Zhang

arXiv.org 2023

ABSPDF
Consistency Regularization Training for Compositional Generalization

Consistency Regularization Training for Compositional Generalization

Yongjing Yin, Jiali Zeng, Yafu Li, Fandong Meng, Jie Zhou, Yue Zhang

Annual Meeting of the Association for Computational Linguistics 2023

ABSPDF
Prompt-Driven Neural Machine Translation

Prompt-Driven Neural Machine Translation

Yafu Li, Yongjing Yin, Jing Li, Yue Zhang

Findings 2022

ABSPDF

Label Attention Network for Structured Prediction

Leyang Cui, Yafu Li, Yue Zhang

IEEE/ACM Transactions on Audio Speech and Language Processing 2022

ABS

Sentence-State LSTMs For Sequence-to-Sequence Learning

Xuefeng Bai, Yafu Li, Zhirui Zhang, Mingzhou Xu, Boxing Chen, Weihua Luo, Derek F. Wong, Yue Zhang

Natural Language Processing and Chinese Computing 2021

ABS