Guanting Dong (董冠霆)  Ph.D. Student Dept. of Artificial Intelligence Renmin University of China (RUC) Beijing, China, 100084. WeChat: dongguanting990611 Email: dongguanting@ruc.edu.cn [Github] [Google Scholar] [Semantic Scholar] [DBLP] [Twitter] [知乎]

About

I am a first-year Ph.D. student at the Gaoling School of Artificial Intelligence, Renmin University of China, fortunate to be co-advised by Prof. Zhicheng Dou and Prof. Jirong Wen. Previously, I received M.Eng (2024) and B.Eng (2021) degrees in Information and Communication Engineering from Beijing University of Posts and Telecommunications(BUPT), advised by Prof. Weiran Xu.

Currently, My research interests focus on

• Multi-Modal Retrieval Augmented Generation
• Alignment for Large Language Models
• Large Language Models Reasoning

My long-term goal is to explore an automated, scalable, and safe way that fosters exceptional intelligence to achieve AGI.

News

• [2024-09] Glad to be a Ph.D. student at GSAI, Renmin University of China.
• [2024-09] Two papers have been accepted by EMNLP 2024!
• [2024-07] We release our technical report of Qwen2 . a large-scale language model developed by Alibaba Group.
• [2024-05] Four papers have been accepted by ACL 2024! Looking forward to seeing you in Bangkok!
• [2024-02] One paper have been accepted by NAACL 2024!
• [2024-12] Two papers have been accepted by ICASSP 2024!
• [2023-10] Three paper has been accepted at the EMNLP 2023!
• [2023-08] Two papers have been accepted by CIKM 2023, Looking forward to seeing you in Birmingham, UK!

Experiences

Academia

• [2024.9 - Now] Ph.D. at Renmin University of China
• [2021.9 - 2024.6] M.S. at Beijing University of Posts and Telecommunications
• [2017.9 - 2021.6] B.S. at Beijing University of Posts and Telecommunications
• [2018.7 - 2018.8] Summer Exchange Internship at University of Oxford, UK

Industry

• [2023.6 - 2024.8] Alibaba, Qwen Team, Research Intern on Alignment & Reasoning of Large Language Models
• [2022.9 - 2023.5] Meituan, NLP Center, Research Intern on Knowledge Augmented Generation

Featured Preprints

-2024-

• Toward General Instruction-Following Alignment for Retrieval-Augmented Generation
  Guanting Dong, Xiaoshuai Song, Yutao Zhu, Runqi Qiao, Zhicheng Dou, Ji-Rong Wen
  Arxiv. [paper] [code] [dataset]
  

• Qwen2 Technical Report
  An Yang, Baosong Yang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Zhou, Chengpeng Li, Chengyuan Li, Dayiheng Liu, Fei Huang, Guanting Dong, Haoran Wei, Huan Lin, Jialong Tang, Jialin Wang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Ma, Jin Xu, Jingren Zhou, Jinze Bai, Jinzheng He, Junyang Lin, Kai Dang, Keming Lu, Keqin Chen, Kexin Yang, Mei Li, Mingfeng Xue, Na Ni, Pei Zhang, Peng Wang, Ru Peng, Rui Men, Ruize Gao, Runji Lin, Shijie Wang, Shuai Bai, Sinan Tan, Tianhang Zhu, Tianhao Li, Tianyu Liu, Wenbin Ge, Xiaodong Deng, Xiaohuan Zhou, Xingzhang Ren, Xinyu Zhang, Xipin Wei, Xuancheng Ren, Yang Fan, Yang Yao, Yichang Zhang, Yu Wan, Yunfei Chu, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, Zhihao Fan
  Arxiv. [paper] [code] [model] [blog]
  

• Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation
  Guanting Dong, Yutao Zhu, Chenghao Zhang, Zechen Wang, Zhicheng Dou, Ji-Rong Wen
  Arxiv. [paper] [code] [blog]
  

• We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?
  Runqi Qiao, Qiuna Tan, Guanting Dong, Minhui Wu, Chong Sun, Xiaoshuai Song, Zhuoma GongQue, Shanglin Lei, Zhe Wei, Miaoxuan Zhang, Runfeng Qiao, Yifan Zhang, Xiao Zong, Yida Xu, Muxi Diao, Zhimin Bao, Chen Li, Honggang Zhang
  Arxiv. [paper] [website] [code] [dataset] [blog]
  

• CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Mastery
  Xiaoshuai Song, Muxi Diao, Guanting Dong, Zhengyang Wang, Yujia Fu, Runqi Qiao, Zhexu Wang, Dayuan Fu, Huangxuan Wu, Bin Liang, Weihao Zeng, Yejie Wang, Zhuoma GongQue, Jianing Yu, Qiuna Tan, Weiran Xu
  Arxiv. [paper] [website] [code] [dataset] [blog]
  

• DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning
  Chengpeng Li, Guanting Dong, Mingfeng Xue, Ru Peng, Xiang Wang, Dayiheng Liu
  Arxiv. [paper] [code] [blog]
  

• Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models
  Guanting Dong, Keming Lu, Chengpeng Li, Tingyu Xia, Bowen Yu, Chang Zhou, Jingren Zhou
  Arxiv. [paper] [code] [blog]
  

• PreAct: Predicting Future in ReAct Enhances Agent's Planning Ability
  Dayuan Fu, Jianzhao Huang, Siyuan Lu, Guanting Dong, Yejie Wang, Keqing He, Weiran Xu
  Arxiv. [paper] [code] [blog]
  

• Knowledge Editing on Black-box Large Language Models
  Xiaoshuai Song, Zhengyang Wang, Keqing He, Guanting Dong, Jinxu Zhao, Weiran Xu
  Arxiv. [paper] [code] [blog]
  

-2023-

• Scaling relationship on learning mathematical reasoning with large language models
  Zheng Yuan, Hongyi Yuan, Chengpeng Li, Guanting Dong, Chuanqi Tan, Chang Zhou
  Arxiv. [paper] [code] [blog]
  

• InstructERC: Reforming Emotion Recognition in Conversation with a Retrieval Multi-task LLMs Framework
  Shanglin Lei,Guanting Dong*, Xiaoping Wang, Keheng Wang, Sirui Wang
  Arxiv. [paper] [code] [blog]
  

Selected Publications

(* denotes equal contributions)
-2024-

• How Do Your Code LLMs Perform? Empowering Code Instruction Tuning with High-Quality Data
  Yejie Wang, Keqing He, Dayuan Fu, Zhuoma Gongque, Heyang Xu, Yanxu Chen, Zhexu Wang, Yujia Fu, Guanting Dong, Muxi Diao, Jingang Wang, Mengdi Zhang, Xunliang Cai, Weiran Xu
  EMNLP 2024. [paper] [code] [blog]
  

• MSI-Agent: Incorporating Multi-Scale Insight into Embodied Agents for Superior Planning and Decision-Making
  Dayuan Fu, Biqing Qi, Yihuai Gao, Che Jiang, Guanting Dong, Bowen Zhou
  EMNLP 2024. [paper]

• How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition
  Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, Jingren Zhou
  ACL 2024. [paper] [blog]
  

• MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning
  Chengpeng Li, Zheng Yuan, Hongyi Yuan, Guanting Dong, Keming Lu, Jiancan Wu, Chuanqi Tan, Xiang Wang, Chang Zhou
  ACL 2024. [paper] [code] [blog]
  

• ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models
  Haoran Luo, Haihong E, Zichen Tang, Shiyao Peng, Yikai Guo, Wentai Zhang, Chenghao Ma, Guanting Dong, Meina Song, Wei Lin
  Findings of ACL 2024. [paper] [code] [blog]
  

• DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning
  Yejie Wang, Keqing He, Guanting Dong, Pei Wang, Weihao Zeng, Muxi Diao, Yutao Mou, Mengdi Zhang, Jingang Wang, Xunliang Cai, Weiran Xu
  ACL 2024. [paper]

• Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Task
  Jinxu Zhao, Guanting Dong∗, Yueyan Qiu, Tingfeng Hui, Xiaoshuai Song, Daichi Guo, Weiran Xu
  ICASSP 2024. [paper]

-2023-

• DemoNSF: A Multi-task Demonstration-based Generative Framework for Noisy Slot Filling Task
  Guanting Dong, Tingfeng Hui, Zhuoma GongQue, Jinxu Zhao, Daichi Guo, Gang Zhao, Keqing He, Weiran Xu
  Findings of EMNLP 2023. [paper] [code] [blog]
  

• Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Tracking
  Yuxiang Wu, Guanting Dong*, Weiran Xu
  Findings of EMNLP 2023. [paper] [code]
  

• A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER
  Guanting Dong, Zechen Wang, Jinxu Zhao, Gang Zhao, Daichi Guo, Dayuan Fu, Tingfeng Hui, Chen Zeng, Keqing He, Xuefeng Li, Liwen Wang, Xinyue Cui, Weiran Xu
  CIKM 2023 (Oral). [paper] [code]
  

• Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQA
  Guanting Dong, Rumei Li, Sirui Wang, Yupeng Zhang, Yunsen Xian, Weiran Xu
  CIKM 2023. [paper] [code]
  

• Revisit Input Perturbation Problems for LLMs: A Unified Robustness Evaluation Framework for Noisy Slot Filling Task
  Guanting Dong, Jinxu Zhao, Tingfeng Hui, Daichi Guo, Wenlong Wang, Boqi Feng, Yueyan Qiu, Zhuoma Gongque, Keqing He, Zechen Wang, Weiran Xu
  NLPCC 2023 (Oral). [paper] [code]
  

• Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting
  Xuefeng Li, Liwen Wang, Guanting Dong*, Keqing He, Jinzheng Zhao, Hao Lei, Jiachi Liu, Weiran Xu
  Findings of ACL 2023. [paper] [code]
  

• A Prototypical Semantic Decoupling Method via Joint Contrastive Learning for Few-Shot Named Entity Recognition
  Guanting Dong, Zechen Wang, Liwen Wang, Daichi Guo, Dayuan Fu, Yuxiang Wu, Chen Zeng, Xuefeng Li, Tingfeng Hui, Keqing He, Xinyue Cui, Qixiang Gao, Weiran Xu
  ICASSP 2023. [paper]

• Revisit Out-Of-Vocabulary Problem For Slot Filling: A Unified Contrastive Framework With Multi-Level Data Augmentations
  Daichi Guo, Guanting Dong*, Dayuan Fu, Yuxiang Wu, Chen Zeng, Tingfeng Hui, Liwen Wang, Xuefeng Li, Zechen Wang, Keqing He, Xinyue Cui, Weiran Xu
  ICASSP 2023. [paper]

-2022-

• Exploiting domain-slot related keywords description for Few-Shot Cross-Domain Dialogue State Tracking
  Gao Qixiang, Guanting Dong*, Yutao Mou, Liwen Wang, Chen Zeng, Daichi Guo, Mingyang Sun, Weiran Xu
  EMNLP 2022 (Oral). [paper]

• Entity-level Interaction via Heterogeneous Graph for Multimodal Named Entity Recognition
  Gang Zhao, Guanting Dong, Yidong Shi, Haolong Yan, Weiran Xu, Si Li
  Findings of EMNLP 2022. [paper] [code]
  

• PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling
  Guanting Dong, Daichi Guo, Liwen Wang, Xuefeng Li, Zechen Wang, Chen Zeng, Keqing He, Jinzheng Zhao, Hao Lei, Xinyue Cui, Yi Huang, Junlan Feng, Weiran Xu
  COLING 2022. [paper]

Honors & Awards

• National Scholarship for Master Students(Top 1%) , 2023
• Outstanding Graduates of Beijing(Top 1%), 2024
• Outstanding Graduate of Master Students(Top 5%), BUPT., 2023
• Excellent First-class Scholarship for Master Students, BUPT. (Two times), 2021, 2022
• 1st Award on track 2 of SereTOD Challenge, EMNLP 2022 , 2022
• Gold Award for College Music Festival Instrumental Performance, Beijing, 2021
• The Mathematical Contest in Modeling, Honorable Mention, 2021

Services

Reviewer for:

• ACL 2023
• EMNLP 2023
• NAACL 2023
• COLING 2023

© 2023 Guanting Dong
总访问量次
总访客数人次