Guanting Dong (董冠霆)Ph.D. Student
Dept. of Artificial Intelligence |
 |
About
I am a first-year Ph.D. student at the Gaoling School of Artificial Intelligence, Renmin University of China, fortunate to be co-advised by Prof. Zhicheng Dou and Prof. Jirong Wen. Previously, I received M.Eng (2024) and B.Eng (2021) degrees in Information and Communication Engineering from Beijing University of Posts and Telecommunications(BUPT), advised by Prof. Weiran Xu.
Currently, My research interests focus on
- Retrieval Augmented Generation
- Alignment for Large Language Models
- Large Language Models Reasoning
My long-term goal is to explore an automated, scalable, and safe way that fosters exceptional intelligence to achieve AGI.
News
- [2024-02] Our modular tookit ⚡FlashRAG currently supports a range of multimodal retrievers and generators, please check it out!
- [2024-01] DPA-RAG has been accepted by WWW 2025, which is designed to align diverse preferences within RAG systems.
- [2025-01] We release Search-o1, leveraging agentic search mechanism to enhance o1-like large reasoning models!
- [2025-01] Two papers have been accepted by ICLR 2025! AUTOIF is the secret behind
Qwen's instruction-following alignment. - [2024-12] Honored to be a contributor to the Qwen2.5 , a series of LLMs designed to meet diverse needs!
- [2024-12] FollowRAG has been accepted by AAAI 2025, which is dedicated to developing a reliable instruction-following RAG system.
- [2024-09] Glad to be a Ph.D. student at GSAI, Renmin University of China.
- [2024-09] Two papers have been accepted by EMNLP 2024!
- [2024-07] We release our technical report of Qwen2 . a large-scale language model developed by Alibaba Group.
- [2024-05] Four papers have been accepted by ACL 2024! Looking forward to seeing you in Bangkok!
- [2024-02] One paper have been accepted by NAACL 2024!
Experiences
Academia- [2024.9 - Now]
Ph.D. at Renmin University of China - [2021.9 - 2024.6]
M.S. at Beijing University of Posts and Telecommunications - [2018.7 - 2018.8]
Summer Exchange Internship at University of Oxford, UK - [2017.9 - 2021.6] B.S. at Beijing University of Posts and Telecommunications
- [2023.6 - 2024.8]
Alibaba, Qwen Team, Research Intern on Alignment & Reasoning of Large Language Models - [2022.9 - 2023.5]
Meituan, NLP Center, Research Intern on Knowledge Augmented Generation
Selected Publications
(* denotes equal contributions)As the Core Author.
-2025-Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation
Guanting Dong, Yutao Zhu, Chenghao Zhang, Zechen Wang, Zhicheng Dou, Ji-Rong Wen
WWW 2025 (CCF-A). [paper] [code] [blog]
Toward General Instruction-Following Alignment for Retrieval-Augmented Generation
Guanting Dong, Xiaoshuai Song, Yutao Zhu, Runqi Qiao, Zhicheng Dou, Ji-Rong Wen
AAAI 2025 (CCF-A). [paper] [homepage] [code] [dataset] [blog]
Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models
Guanting Dong, Keming Lu, Chengpeng Li, Tingyu Xia, Bowen Yu, Chang Zhou, Jingren Zhou
ICLR 2025 (Spotlight, Top 5% of all papers). [paper] [code] [blog]
CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Mastery
Xiaoshuai Song, Muxi Diao, Guanting Dong, Zhengyang Wang, Yujia Fu, Runqi Qiao, Zhexu Wang, Dayuan Fu, Huangxuan Wu, Bin Liang, Weihao Zeng, Yejie Wang, Zhuoma GongQue, Jianing Yu, Qiuna Tan, Weiran Xu
ICLR 2025 [paper] [homepage] [code] [dataset] [blog]
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition
Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, Jingren Zhou
ACL 2024 (CCF-A). [paper] [blog]
Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Task
Jinxu Zhao, Guanting Dong∗, Yueyan Qiu, Tingfeng Hui, Xiaoshuai Song, Daichi Guo, Weiran Xu
ICASSP 2024 (CCF-B). [paper]
DemoNSF: A Multi-task Demonstration-based Generative Framework for Noisy Slot Filling Task
Guanting Dong, Tingfeng Hui, Zhuoma GongQue, Jinxu Zhao, Daichi Guo, Gang Zhao, Keqing He, Weiran Xu
Findings of EMNLP 2023 (Shot Paper). [paper] [code] [blog]
Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Tracking
Yuxiang Wu, Guanting Dong*, Weiran Xu
Findings of EMNLP 2023 (Short Paper). [paper] [code]
A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER
Guanting Dong, Zechen Wang, Jinxu Zhao, Gang Zhao, Daichi Guo, Dayuan Fu, Tingfeng Hui, Chen Zeng, Keqing He, Xuefeng Li, Liwen Wang, Xinyue Cui, Weiran Xu
CIKM 2023 (Oral) (CCF-B). [paper] [code]
Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQA
Guanting Dong, Rumei Li, Sirui Wang, Yupeng Zhang, Yunsen Xian, Weiran Xu
CIKM 2023 (Short Paper). [paper] [code]
Revisit Input Perturbation Problems for LLMs: A Unified Robustness Evaluation Framework for Noisy Slot Filling Task
Guanting Dong, Jinxu Zhao, Tingfeng Hui, Daichi Guo, Wenlong Wang, Boqi Feng, Yueyan Qiu, Zhuoma Gongque, Keqing He, Zechen Wang, Weiran Xu
NLPCC 2023 (Oral) (CCF-C). [paper] [code]
Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting
Xuefeng Li, Liwen Wang, Guanting Dong*, Keqing He, Jinzheng Zhao, Hao Lei, Jiachi Liu, Weiran Xu
Findings of ACL 2023 (Short Paper). [paper] [code]
A Prototypical Semantic Decoupling Method via Joint Contrastive Learning for Few-Shot Named Entity Recognition
Guanting Dong, Zechen Wang, Liwen Wang, Daichi Guo, Dayuan Fu, Yuxiang Wu, Chen Zeng, Xuefeng Li, Tingfeng Hui, Keqing He, Xinyue Cui, Qixiang Gao, Weiran Xu
ICASSP 2023 (CCF-B). [paper]
Revisit Out-Of-Vocabulary Problem For Slot Filling: A Unified Contrastive Framework With Multi-Level Data Augmentations
Daichi Guo, Guanting Dong*, Dayuan Fu, Yuxiang Wu, Chen Zeng, Tingfeng Hui, Liwen Wang, Xuefeng Li, Zechen Wang, Keqing He, Xinyue Cui, Weiran Xu
ICASSP 2023 (CCF-B). [paper]
Exploiting domain-slot related keywords description for Few-Shot Cross-Domain Dialogue State Tracking
Gao Qixiang, Guanting Dong*, Yutao Mou, Liwen Wang, Chen Zeng, Daichi Guo, Mingyang Sun, Weiran Xu
EMNLP 2022 (Oral) (Short Paper). [paper]
Entity-level Interaction via Heterogeneous Graph for Multimodal Named Entity Recognition
Gang Zhao, Guanting Dong, Yidong Shi, Haolong Yan, Weiran Xu, Si Li
Findings of EMNLP 2022 (Short Paper). [paper] [code]
PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling
Guanting Dong, Daichi Guo, Liwen Wang, Xuefeng Li, Zechen Wang, Chen Zeng, Keqing He, Jinzheng Zhao, Hao Lei, Xinyue Cui, Yi Huang, Junlan Feng, Weiran Xu
COLING 2022 (Short Paper). [paper]
As a Co-author.
-2025-CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation
Yiruo Cheng, Kelong Mao, Ziliang Zhao, Guanting Dong, Hongjin Qian, Yongkang Wu, Tetsuya Sakai, Ji-Rong Wen, Zhicheng Dou
Findings of NAACL 2025. [paper] [code]
⚡FlashRAG: A Python Toolkit for Efficient RAG Research
Jiajie Jin, Yutao Zhu, Guanting Dong, Yuyao Zhang, Xinyu Yang, Chenghao Zhang, Tong Zhao, Zhao Yang, Zhicheng Dou, Ji-Rong Wen
WWW 2025 (Resource Track). [paper] [homepage] [code] [Dataset]
Knowledge Editing on Black-box Large Language Models
Xiaoshuai Song, Zhengyang Wang, Keqing He, Guanting Dong, Jinxu Zhao, Weiran Xu
WWW 2025 (CCF-A). [paper] [code] [blog]
INSNER: A generative instruction-based prompting method for boosting performance in few-shot NER
Peiwen Zhao, Chong Feng, Peiguang Li, Guanting Dong, Sirui Wang
Information Processing & Management (SCI-Q1). [paper]
MSI-Agent: Incorporating Multi-Scale Insight into Embodied Agents for Superior Planning and Decision-Making
Dayuan Fu, Biqing Qi, Yihuai Gao, Che Jiang, Guanting Dong, Bowen Zhou
EMNLP 2024 (CCF-B). [paper]
MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning
Chengpeng Li, Zheng Yuan, Hongyi Yuan, Guanting Dong, Keming Lu, Jiancan Wu, Chuanqi Tan, Xiang Wang, Chang Zhou
ACL 2024 (CCF-A). [paper] [code] [blog]
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models
Haoran Luo, Haihong E, Zichen Tang, Shiyao Peng, Yikai Guo, Wentai Zhang, Chenghao Ma, Guanting Dong, Meina Song, Wei Lin
Findings of ACL 2024. [paper] [code] [blog]
DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning
Yejie Wang, Keqing He, Guanting Dong, Pei Wang, Weihao Zeng, Muxi Diao, Yutao Mou, Mengdi Zhang, Jingang Wang, Xunliang Cai, Weiran Xu
ACL 2024 (CCF-A). [paper]
Large Language Models Meet Open-World Intent Discovery and Recognition: An Evaluation of ChatGPT
Xiaoshuai Song, Keqing He, Pei Wang, Guanting Dong, Yutao Mou, Jingang Wang, Yunsen Xian, Xunliang Cai, Weiran Xu
EMNLP 2024 (CCF-B). [paper] [code]
Pay Attention to Implicit Attribute Values: A Multi-modal Generative Framework for AVE Task
Yupeng Zhang, Shensi Wang, Peiguang Li, Guanting Dong, Sirui Wang, Yunsen Xian, Zhoujun Li, Hongzhi Zhang
Findings of ACL 2023 (Short Paper). [paper] [code] [blog]
A Robust Contrastive Alignment Method for Multi-domain Text Classification
Xuefeng Li, Hao Lei, Liwen Wang, Guanting Dong, Jinzheng Zhao, Jiachi Liu, Weiran Xu, Chunyun Zhang
ICASSP 2022 (CCF-B). [paper]
Selected Preprints
(* denotes equal contributions)-2025-
Search-o1: Agentic Search-Enhanced Large Reasoning Models
Xiaoxi Li, Guanting Dong, Jiajie Jin, Yuyao Zhang, Yujia Zhou, Yutao Zhu, Peitian Zhang, Zhicheng Dou
Arxiv. [paper] [homepage] [code] [blog]
Progressive Multimodal Reasoning via Active Retrieval
Guanting Dong, Chenghao Zhang, Mengjie Deng, Yutao Zhu, Zhicheng Dou, Ji-Rong Wen
Arxiv. [paper] [blog]
- Qwen2.5 Technical Report
Qwen Team (129 authors including Guanting Dong)
Arxiv. [paper] [code] [model] [modelscope] [blog]
- Qwen2 Technical Report
Qwen Team (64 authors including Guanting Dong)
Arxiv. [paper] [code] [model] [blog]
DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning
Chengpeng Li, Guanting Dong, Mingfeng Xue, Ru Peng, Xiang Wang, Dayiheng Liu
Arxiv. [paper] [code] [dataset] [blog]
Smaller Language Models Are Better Instruction Evolvers
Tingfeng Hui, Lulu Zhao, Guanting Dong, Yaqi Zhang, Hua Zhou, Sen Su
Arxiv. [paper] [code] [blog]
Scaling relationship on learning mathematical reasoning with large language models
Zheng Yuan, Hongyi Yuan, Chengpeng Li, Guanting Dong, Chuanqi Tan, Chang Zhou
Arxiv. [paper] [code] [blog]
InstructERC: Reforming Emotion Recognition in Conversation with a Retrieval Multi-task LLMs Framework
Shanglin Lei,Guanting Dong*, Xiaoping Wang, Keheng Wang, Sirui Wang
Arxiv. [paper] [code] [blog]
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?
Runqi Qiao, Qiuna Tan, Guanting Dong, Minhui Wu, Chong Sun, Xiaoshuai Song, Zhuoma GongQue, Shanglin Lei, Zhe Wei, Miaoxuan Zhang, Runfeng Qiao, Yifan Zhang, Xiao Zong, Yida Xu, Muxi Diao, Zhimin Bao, Chen Li, Honggang Zhang
Arxiv. [paper] [homepage] [code] [dataset] [blog]
Honors & Awards
- 1st Place in the PhD Entrance Exam (Preliminary) at the GSAI, Renmin University of China , 2024
- Outstanding Graduates of Beijing(Top 1%) , 2024
- National Scholarship for Master Students(Top 1%) , 2023
- Outstanding Graduate of Master Students(Top 5%), BUPT, 2023
- Excellent First-class Scholarship for Master Students, BUPT(Two times), 2021, 2022
- 1st Award on track 2 of SereTOD Challenge, EMNLP 2022 , 2022
- Gold Award for College Music Festival Instrumental Performance, Beijing, 2021
- The Mathematical Contest in Modeling, Honorable Mention, 2021
Services
总访问量次
总访客数人次
