About me

I am a 4th-year PhD student in the Department of Computer Science and Technology at Tsinghua University. I am supervised by Prof. Maosong Sun. My research interests lie in Pre-trained Models for Natural Language Processing.

Publications

* indicates equal contribution.

  • Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun. TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference. NAACL 2021. Long Paper. [pdf] [code]

  • Zhengyan Zhang, Xu Han, Hao Zhou, Pei Ke, Yuxian Gu, Deming Ye, Yujia Qin, Yusheng Su, Haozhe Ji, Jian Guan, Fanchao Qi, Xiaozhi Wang, Yanan Zheng, Guoyang Zeng, Huanqi Cao, Shengqi Chen, Daixuan Li, Zhenbo Sun, Zhiyuan Liu, Minlie Huang, Wentao Han, Jie Tang, Juanzi Li, Xiaoyan Zhu, Maosong Sun. CPM: A Large-scale Generative Chinese Pre-trained Language Model. AI Open, 2021. [pdf] [code] [homepage]

  • Deming Ye, Yankai Lin, Jiaju Du, Zhenghao Liu, Peng Li, Maosong Sun, Zhiyuan Liu. Coreferential Reasoning Learning for Language Representation. EMNLP 2020. Long Paper. [pdf] [code]

  • Yuan Yao*, Deming Ye*, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, Maosong Sun. DocRED: A Large-Scale Document-Level Relation Extraction Dataset. ACL 2019. Long Paper. [pdf] [code]

  • Xu Han, Tianyu Gao, Yuan Yao, Deming Ye, Zhiyuan Liu, Maosong Sun. OpenNRE: An open and extensible toolkit for neural relation extraction. EMNLP 2019. Demo Paper. [pdf] [code]

  • Bo Dai*, Deming Ye*, Dahua Lin. Rethinking the form of latent states in image captioning. ECCV 2018. Long Paper. [pdf] [code]

  • Xiaoying Bai, Mingjie Li, Dan Pei, Shanshan Li, Deming Ye. Continuous delivery of personalized assessment and feedback in agile software engineering projects. ICSE 2018. Long Paper. [pdf] [code]

Preprint

  • Deming Ye, Yankai Lin, Maosong Sun. Pack Together: Entity and Relation Extraction with Levitated Marker. [pdf] [code]

  • Deming Ye, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Maosong Sun. Multi-paragraph reasoning with knowledge-enhanced graph neural network. [pdf]

Project

THUTag: A Package of Kephrase Extraction and Social Tag Suggetion. [code]

Experiemnt

  • Sep. 2018 - Present: PhD Student in Computer Science and Technology, Tsinghua University, Beijing, China.
  • Sep. 2014 - 2018: Bachelor in Computer Science and Technology, Tsinghua University, Beijing, China.
  • Sep. 2011 - 2014: Student in Sun Yat-sen Memorial Secondary School, Zhongshan, Guangdong, China.