Guanting Dong (董冠霆)  Master Student Room 731, 3rd Teaching Building Dept. of Artificial Intelligence Beijing University of Posts and Telecommunications (BUPT) Beijing, China, 100084. WeChat: dongguanting990611 Email: dongguanting@bupt.edu.cn [Github] [Google Scholar] [Semantic Scholar] [DBLP] [Twitter] [知乎]

About

I am a final-year Master student of PRIS Lab in the Department of Artificial Intelligence, Beijing University of Posts and Telecommunications(BUPT), advised by Prof. Weiran Xu. Previously, I also received my B.S. degree from the Department of Information and Communication Engineering, Beijing University of Posts and Telecommunications in July, 2021.

Currently, My research interests focus on

• Information Extration and Retrieval
• Reasoning and Alignment for Mathematics, Code and Knowledge Graph
• Interpretability and Robustness for Large Language Models

News

• [2023-12] Three papers have been accepted by ACL 2024! Looking forward to seeing you in Bangkok!
• [2023-12] One paper have been accepted by NAACL 2024!
• [2023-12] Two papers have been accepted by ICASSP 2024!
• [2023-10] Three paper has been accepted at the EMNLP 2023!
• [2023-08] Two papers have been accepted by CIKM 2023, Looking forward to seeing you in Birmingham, UK!

Experiences

Academia

• [2021.9 - 2024.6] M.S. at Beijing University of Posts and Telecommunications
• [2018.7 - 2018.8] Summer Exchange Internship at University of Oxford, UK
• [2017.9 - 2021.6] B.S. at Beijing University of Posts and Telecommunications

Industry

• [2023.6 - 2023.10] Alibaba, Qwen Team (ori. DAMO Acedemy), Research Intern on Training Large Language Models
• [2022.9 - 2023.5] Meituan, NLP Center, Research Intern on Knowledge Augmented Generation

Featured Preprints

-2024-

• PreAct: Predicting Future in ReAct Enhances Agent's Planning Ability
  Dayuan Fu, Jianzhao Huang, Siyuan Lu, Guanting Dong, Yejie Wang, Keqing He, Weiran Xu
  Arxiv. [paper] [code] [blog]
  

• Knowledge Editing on Black-box Large Language Models
  Xiaoshuai Song, Zhengyang Wang, Keqing He, Guanting Dong, Jinxu Zhao, Weiran Xu
  Arxiv. [paper] [code] [blog]
  

-2023-

• Scaling relationship on learning mathematical reasoning with large language models
  Zheng Yuan, Hongyi Yuan, Chengpeng Li, Guanting Dong, Chuanqi Tan, Chang Zhou
  Arxiv. [paper] [code] [blog]
  

• InstructERC: Reforming Emotion Recognition in Conversation with a Retrieval Multi-task LLMs Framework
  Shanglin Lei,Guanting Dong*, Xiaoping Wang, Keheng Wang, Sirui Wang
  Arxiv. [paper] [code] [blog]
  

Selected Publications

(* denotes equal contributions)
-2024-

• How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition
  Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, Jingren Zhou
  ACL 2024. [paper] [blog]
  

• Query and Response Augmentation Cannot Help Out-of-domain Math Reasoning Generalization
  Chengpeng Li, Zheng Yuan, Hongyi Yuan, Guanting Dong, Keming Lu, Jiancan Wu, Chuanqi Tan, Xiang Wang, Chang Zhou
  ACL 2024. [paper] [code] [blog]
  

• DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning
  Yejie Wang, Keqing He, Guanting Dong, Pei Wang, Weihao Zeng, Muxi Diao, Yutao Mou, Mengdi Zhang, Jingang Wang, Xunliang Cai, Weiran Xu
  ACL 2024. [paper]

• Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Task
  Jinxu Zhao, Guanting Dong∗, Yueyan Qiu, Tingfeng Hui, Xiaoshuai Song, Daichi Guo, Weiran Xu
  ICASSP 2024. [paper]

-2023-

• DemoNSF: A Multi-task Demonstration-based Generative Framework for Noisy Slot Filling Task
  Guanting Dong, Tingfeng Hui, Zhuoma GongQue, Jinxu Zhao, Daichi Guo, Gang Zhao, Keqing He, Weiran Xu
  Findings of EMNLP 2023. [paper] [code] [blog]
  

• Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Tracking
  Yuxiang Wu, Guanting Dong*, Weiran Xu
  Findings of EMNLP 2023. [paper] [code]
  

• A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER
  Guanting Dong, Zechen Wang, Jinxu Zhao, Gang Zhao, Daichi Guo, Dayuan Fu, Tingfeng Hui, Chen Zeng, Keqing He, Xuefeng Li, Liwen Wang, Xinyue Cui, Weiran Xu
  CIKM 2023 (Oral). [paper] [code]
  

• Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQA
  Guanting Dong, Rumei Li, Sirui Wang, Yupeng Zhang, Yunsen Xian, Weiran Xu
  CIKM 2023. [paper] [code]
  

• Revisit Input Perturbation Problems for LLMs: A Unified Robustness Evaluation Framework for Noisy Slot Filling Task
  Guanting Dong, Jinxu Zhao, Tingfeng Hui, Daichi Guo, Wenlong Wang, Boqi Feng, Yueyan Qiu, Zhuoma Gongque, Keqing He, Zechen Wang, Weiran Xu
  NLPCC 2023 (Oral). [paper] [code]
  

• Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting
  Xuefeng Li, Liwen Wang, Guanting Dong*, Keqing He, Jinzheng Zhao, Hao Lei, Jiachi Liu, Weiran Xu
  Findings of ACL 2023. [paper] [code]
  

• A Prototypical Semantic Decoupling Method via Joint Contrastive Learning for Few-Shot Named Entity Recognition
  Guanting Dong, Zechen Wang, Liwen Wang, Daichi Guo, Dayuan Fu, Yuxiang Wu, Chen Zeng, Xuefeng Li, Tingfeng Hui, Keqing He, Xinyue Cui, Qixiang Gao, Weiran Xu
  ICASSP 2023. [paper]

• Revisit Out-Of-Vocabulary Problem For Slot Filling: A Unified Contrastive Framework With Multi-Level Data Augmentations
  Daichi Guo, Guanting Dong*, Dayuan Fu, Yuxiang Wu, Chen Zeng, Tingfeng Hui, Liwen Wang, Xuefeng Li, Zechen Wang, Keqing He, Xinyue Cui, Weiran Xu
  ICASSP 2023. [paper]

-2022-

• Exploiting domain-slot related keywords description for Few-Shot Cross-Domain Dialogue State Tracking
  Gao Qixiang, Guanting Dong*, Yutao Mou, Liwen Wang, Chen Zeng, Daichi Guo, Mingyang Sun, Weiran Xu
  EMNLP 2022 (Oral). [paper]

• Entity-level Interaction via Heterogeneous Graph for Multimodal Named Entity Recognition
  Gang Zhao, Guanting Dong, Yidong Shi, Haolong Yan, Weiran Xu, Si Li
  Findings of EMNLP 2022. [paper] [code]
  

• PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling
  Guanting Dong, Daichi Guo, Liwen Wang, Xuefeng Li, Zechen Wang, Chen Zeng, Keqing He, Jinzheng Zhao, Hao Lei, Xinyue Cui, Yi Huang, Junlan Feng, Weiran Xu
  COLING 2022. [paper]

Honors & Awards

• National Scholarship for Master Students(Top 1%) , 2023
• Outstanding Graduates of Beijing(Top 1%), 2024
• Outstanding Graduate of Master Students(Top 5%), BUPT., 2023
• Excellent First-class Scholarship for Master Students, BUPT. (Two times), 2021, 2022
• 1st Award on track 2 of SereTOD Challenge, EMNLP 2022 , 2022
• Gold Award for College Music Festival Instrumental Performance, Beijing, 2021
• The Mathematical Contest in Modeling, Honorable Mention, 2021

Services

Reviewer for:

• ACL 2023
• EMNLP 2023
• NAACL 2023
• COLING 2023

© 2023 Guanting Dong
总访问量次
总访客数人次