About Me

I am a Research Engineer at Alibaba DAMO Academy. I obtained my PhD degree from The Chinese University of Hong Kong (CUHK) in 2021, under supervision of Prof. Wai Lam. Before starting my PhD career, I was an undergraduate at Sun Yat-sen Universy (SYSU). I have ever interned at Microsoft Research Asia, Tencent AI Lab and Huawei Noah’s Ark Lab.

Contact E-mail: lixin4ever@gmail.com.

Research Interests

• Efficient LLM Fine-tuning & Inference
• Multimodal & Multilingual LLMs

Education

• 2016-2021, Ph.D., The Chinese University of Hong Kong, Department of Systems Engineering and Engineering Management. Advisor: Prof. Wai Lam
• 2012-2016, B.Eng., Sun Yat-Sen University, School of Computer Science and Engineering

Experiences

• Jul 2020-Feb 2021, Research Intern, Speech and Semantics Group@Huawei Noah’s Ark Lab. Mentor: Dr. Yi Liao.
• Jan 2018-Apr 2018, Research Intern, NLP Center@Tencent AI Lab. Mentor: Dr. Lidong Bing and Dr. Piji Li.
• Jul 2015-Jun 2016, Research intern, Knowledge Computing Group@Microsoft Research Asia. Mentor: Dr. Chin-Yew Lin and Dr. Jing Liu
• Sep 2014-July 2015, Research assistant, SentiNet Group, Sun Yat-Sen University. Supervisor: Prof. Rao Yanghui

Preprints

• Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
  Hang Zhang, Xin Li, Lidong Bing.
  arXiv:2306.02858
  [code][demo (hugging face)][demo (modelscope)][checkpoints]
• Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond
  Xin Li, Lidong Bing, Wenxuan Zhang, Zheng Li, Wai Lam.
  arXiv:2010.12405.
• Enhancing Dialogue Generation via Multi-Level Contrastive Learning
  Xin Li, Piji Li, Yan Wang, Xiaojiang Liu and Wai Lam.
  arXiv:2009.09147.
• Pyramid Mask Text Detector
  Jingchao Liu, Xuebo Liu, Jie Sheng, Ding Liang, Xin Li, Qingjie Liu.
  arXiv:1903.11800.
  [code by Jingchao]

Publications [Google Scholar]

• From Clozing to Comprehending: Retrofitting Pre-trained Language Model to Pre-trained Machine Reader
  Weiwen Xu, Xin Li, Wenxuan Zhang, Meng Zhou, Lidong Bing, Wai Lam and Luo Si.
  To appear in NeurIPS 2023 (Full paper, poster)
  [code by Weiwen]
• mPMR: Multilingual Machine Reader Pre-training at Scale
  Weiwen Xu, Xin Li, Wai Lam and Lidong Bing.
  In ACL 2023 (Short paper, poster)
  [code by Weiwen]
• PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks
  Weiwen Xu, Xin Li, Yang Deng, Lidong Bing and Wai Lam.
  In ACL 2023 (Full paper, poster)
  [code by Weiwen]
• Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learning
  Ran Zhou, Xin Li, Lidong Bing, Erik Cambria and Chunyan Miao. In ACL 2023 (Full paper, poster)
  [code by Ran]
• Enhancing Cross-lingual Prompting with Dual Prompt Augmentation
  Meng Zhou, Xin Li, Yue Jiang and Lidong Bing.
  In Findings of ACL 2023 (Short paper)
  [code by Meng]
• Towards Robust Low-Resource Fine-Tuning with Multi-View Compressed Representations
  Linlin Liu, Xingxuan Li, Megh Thakkar, Xin Li, Shafiq Joty, Luo Si and Lidong Bing.
  In ACL 2023 (Full paper, poster)
  [code by Xingxuan]
• A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges
  Wenxuan Zhang, Xin Li, Yang Deng, Lidong Bing and Wai Lam.
  IEEE Transactions on Knowledge and Data Engineering (TKDE), 2022
  [website][blog]
• Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples
  Linlin Liu, Xin Li, Ruidan He, Lidong Bing, Shafiq Joty and Luo Si.
  In EMNLP 2022 (Full paper, poster)
  [code by Linlin]
• Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representation
  Deng Cai, Xin Li, Jackie Chun-Sing Ho, Lidong Bing and Wai Lam.
  [code by Deng]
  In EMNLP 2022 (Full paper, poster)
• ConNER: Consistency Training for Cross-lingual Named Entity Recognition
  Ran Zhou, Xin Li, Lidong Bing, Erik Cambria, Luo Si and Chunyan Miao.
  In EMNLP 2022 (Full paper, poster)
  [code by Ran]
• MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER
  Ran Zhou, Xin Li, Ruidan He, Lidong Bing, Erik Cambria, Luo Si and Chunyan Miao.
  In ACL 2022 (Full paper, poster).
  [code by Ran][bibtex]
• Multilingual AMR Parsing with Noisy Knowledge Distillation
  Deng Cai, Xin Li, Jackie Chun-Sing Ho, Lidong Bing and Wai Lam.
  In Findings of EMNLP 2021 (Full paper)
  [code by Deng][bibtex]
• Aspect Sentiment Quad Prediction as Paraphrase Generation
  Wenxuan Zhang, Yang Deng, Xin Li, Yifei Yuan, Lidong Bing and Wai Lam.
  In EMNLP 2021 (Full paper)
  [code by Wenxuan][bibtex]
• Towards Generative Aspect-Based Sentiment Analysis
  Wenxuan Zhang, Xin Li, Yang Deng, Lidong Bing, Wai Lam.
  In ACL 2021 (Short paper, oral)
  [code by Wenxuan][bibtex]
• Relevance-Promoting Language Model for Short-Text Conversation
  Xin Li, Piji Li, Wei Bi, Xiaojiang Liu and Wai Lam.
  In AAAI 2020 (Full paper, poster).
  [code][poster]
• Exploiting BERT for End-to-End Aspect-Based Sentiment Analysis.
  Xin Li, Lidong Bing, Wenxuan Zhang and Wai Lam.
  In EMNLP 2019 Workshop W-NUT.
  [code][bibtex]
• Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning.
  Zheng Li, Xin Li, Ying Wei, Lidong Bing, Yu Zhang, and Qiang Yang.
  In EMNLP 2019 (Full Paper, oral).
  [code][bibtex]
• A Unified Model for Opinion Target Extraction and Target Sentiment Prediction.
  Xin Li, Lidong Bing, Piji Li and Wai Lam.
  In AAAI 2019 (Full paper, poster).
  [code][slides][bibtex]
• Exploiting Coarse-to-Fine Task Transfer for Aspect-level Sentiment Classification.
  Zheng Li, Ying Wei, Yu Zhang, Xiang Zhang, Xin Li and Qiang Yang.
  In AAAI 2019 (Full paper, oral).
  [data][bibtex]
• Transformation Networks for Target-Oriented Sentiment Classification.
  Xin Li, Lidong Bing, Wai Lam, Bei Shi.
  In ACL 2018 (Full paper, oral).
  [code][dataset][slides][bibtex][code from ABSA_pytorch (recommended)]
• Aspect Term Extraction with History Attention and Selective Transformation.
  Xin Li, Lidong Bing, Piji Li, Wai Lam, Zhimou Yang.
  In IJCAI 2018 (Full paper, oral).
  [code][dataset][slides][bibtex]
• Deep Multi-task Learning for Aspect Term Extraction with Memory Interaction.
  Xin Li, Wai Lam.
  In EMNLP 2017 (Short paper, oral).
  [slides][bibtex]
• Social Emotion Classification Based on Noise Aware Training.
  Xin Li, Haoran Xie, Yanghui Rao, Xuebo Liu, Tak-Lam Wong, Fu Lee Wang.
  Data and Knowledge Engineering Journal (DKE Journal).
• ZhihuRank: A Topic-Sensitive Expert Finding Algorithm in Community Question Answering Websites.
  Xuebo Liu, Shuang Ye, Xin Li, Yonghao Luo and Yanghui Rao.
  In ICWL 2015 (The 14th International Conference on Web-based Learning).
  [slides]

Honors & Awards

• AAAI Student Scholarship, 2020
• Outstanding Graduates Awards, Sun Yat-Sen University.
• Excellent Undergraduate Thesis award, Sun Yat-Sen University.

Professional Activities

• Reviewer (or PC Member):
  • ACL 2020-2023, EMNLP 2018-2023, NAACL 2021
  • AAAI 2019-2020
  • WSDM 2023, CIKM 2021
  • ACM Transactions on Knowledge Discovery from Data (TKDD)
  • ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)
  • IEEE Transaction on Multimedia (TMM)
  • Neurocomputing
  • Computational Intelligence

Some Useful Notes & Links

• Introduction to Neural Word Embeddings. [pdf]
• Tutorial for Statistical Machine Translation.
• Tutorial for Neural Machine Translation.
• How to write a great research paper.

Social

• CSDN (One of the largest Chinese technical community)
• Zhihu (A Chinese CQA website)

Hobbies

• Playing basketball
• Swimming
• Hiking