About Me

I am a Research Engineer at Alibaba DAMO Academy. I obtained my PhD degree from The Chinese University of Hong Kong (CUHK) in 2021, under the supervision of Prof. Wai Lam. Before starting my PhD career, I was an undergraduate at Sun Yat-sen University (SYSU). I have interned at Microsoft Research Asia, Tencent AI Lab and Huawei Noah’s Ark Lab.

Contact E-mail: lixin4ever@gmail.com.

Research Interests

• Efficient LLM Fine-tuning & Inference
• Multimodal & Multilingual LLMs

Education

• 2016-2021, Ph.D., The Chinese University of Hong Kong, Department of Systems Engineering and Engineering Management. Advisor: Prof. Wai Lam
• 2012-2016, B.Eng., Sun Yat-Sen University, School of Computer Science and Engineering

Experiences

• Jul 2020-Feb 2021, Research Intern, Speech and Semantics Group@Huawei Noah’s Ark Lab. Mentor: Dr. Yi Liao.
• Jan 2018-Apr 2018, Research Intern, NLP Center@Tencent AI Lab. Mentor: Dr. Lidong Bing and Dr. Piji Li.
• Jul 2015-Jun 2016, Research intern, Knowledge Computing Group@Microsoft Research Asia. Mentor: Dr. Chin-Yew Lin and Dr. Jing Liu
• Sep 2014-July 2015, Research assistant, SentiNet Group, Sun Yat-Sen University. Supervisor: Prof. Rao Yanghui

Recent Preprints & Publications [Full List]

• The Curse of Multi-Modalities: Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  Sicong Leng, Yun Xing, Zesen Cheng, Yang Zhou, Hang Zhang, Xin Li, Deli Zhao, Shijian Lu, Chunyan Miao, Lidong Bing.
  arXiv:2410.12787
  [code][leaderboard]
• Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss
  Zesen Cheng^* , Hang Zhang^* , Kehan Li^* , Sicong Leng, Zhiqiang Hu, Fei Wu, Deli Zhao, Xin Li^{^} , Lidong Bing.
  arXiv:2410.17243
  [code][pypi]
• VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
  Zesen Cheng^* , Sicong Leng^* , Hang Zhang^* , Yifei Xin^* , Xin Li^* , Guanzheng Chen, Yongxin Zhu, Wenqi Zhang, Ziyang Luo, Deli Zhao, Lidong Bing.
  arXiv:2406.07476
  [code][demo]
• SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian Languages
  Wenxuan Zhang^* , Hou Pong Chan^* , Yiran Zhao^* , Mahani Aljunied^* , Jianyu Wang^* , Chaoqun Liu, Yue Deng, Zhiqiang Hu, Weiwen Xu, Yew Ken Chia, Xin Li, Lidong Bing.
  arXiv:2407.19672
  [model][demo]
• Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
  Yongxin Zhu, Bocheng Li, Hang Zhang, Xin Li, Linli Xu, Lidong Bing.
  To appear in NeurIPS 2024 (Full paper, Poster).
• AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation
  Ziyang Luo, Xin Li, Hongzhan Lin, Jing Ma and Lidong Bing.
  To appear in EMNLP 2024 (Full paper).
• SeaLLMs – Large Language Models for Southeast Asia
  Xuan-Phi Nguyen^* , Wenxuan Zhang^* , Xin Li^* , Mahani Aljunied^* , Zhiqiang Hu, Chenhui Shen, Yew Ken Chia, Xingxuan Li, Jianyu Wang, Qingyu Tan, Liying Cheng, Guanzheng Chen, Yue Deng, Sen Yang, Chaoqun Liu, Hang Zhang, Lidong Bing.
  In ACL 2024 (System Demonstrations).
  [demo][SeaLLM-7B-v2][SeaLLM-7B-v2.5][SeaBench][SeaExam]
• Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
  Sicong Leng^* , Hang Zhang^* , Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, Lidong Bing.
  In CVPR 2024 (Full paper, Highlight).
  [code by Sicong & Hang]
• CLEX: Continuous Length Extrapolation for Large Language Models
  Guanzheng Chen, Xin Li, Zaiqiao Meng, Shangsong Liang, Lidong Bing.
  In ICLR 2024 (Full paper, Poster).
  [code by Guanzheng][CLEX-Phi-2][CLEX-LLaMA-2][CLEX-Mixtral][LongCorpus-2.5B]
• Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
  Hang Zhang, Xin Li, Lidong Bing.
  In EMNLP 2023 (System Demonstrations).
  [code by Hang][demo (hugging face)][demo (modelscope)][checkpoints]

Honors & Awards

• AAAI Student Scholarship, 2020
• Outstanding Graduates Awards, Sun Yat-Sen University.
• Excellent Undergraduate Thesis award, Sun Yat-Sen University.

Professional Activities

• Reviewer (or PC Member):
  • ACL 2020-2023, EMNLP 2018-2023, NAACL 2021
  • AAAI 2019-2020
  • WSDM 2023, CIKM 2021
  • ACM Transactions on Knowledge Discovery from Data (TKDD)
  • ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)
  • IEEE Transaction on Multimedia (TMM)
  • Neurocomputing
  • Computational Intelligence

Some Useful Notes & Links

• Introduction to Neural Word Embeddings. [pdf]
• Tutorial for Statistical Machine Translation.
• Tutorial for Neural Machine Translation.
• How to write a great research paper.

Hobbies

• Playing basketball
• Swimming
• Hiking