About Me
I am a Research Engineer at Alibaba DAMO Academy. I obtained my PhD degree from The Chinese University of Hong Kong (CUHK) in 2021, under the supervision of Prof. Wai Lam. Before starting my PhD career, I was an undergraduate at Sun Yat-sen University (SYSU). I have interned at Microsoft Research Asia, Tencent AI Lab and Huawei Noah’s Ark Lab.
Contact E-mail: lixin4ever@gmail.com.
Research Interests
- Efficient LLM Fine-tuning & Inference
- Multimodal & Multilingual LLMs
Education
Experiences
- Jul 2020-Feb 2021, Research Intern, Speech and Semantics Group@Huawei Noah’s Ark Lab. Mentor: Dr. Yi Liao.
- Jan 2018-Apr 2018, Research Intern, NLP Center@Tencent AI Lab. Mentor: Dr. Lidong Bing and Dr. Piji Li.
- Jul 2015-Jun 2016, Research intern, Knowledge Computing Group@Microsoft Research Asia. Mentor: Dr. Chin-Yew Lin and Dr. Jing Liu
- Sep 2014-July 2015, Research assistant, SentiNet Group, Sun Yat-Sen University. Supervisor: Prof. Rao Yanghui
Recent Preprints & Publications [Full List]
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
Zesen Cheng* , Sicong Leng* , Hang Zhang* , Yifei Xin* , Xin Li* , Guanzheng Chen, Yongxin Zhu, Wenqi Zhang, Ziyang Luo, Deli Zhao, Lidong Bing.
arXiv:2406.07476
[code][demo]
- Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs
Sen Yang, Xin Li, Leyang Cui, Lidong Bing, Wai Lam.
arXiv:2311.09802
[code by Sen]
- SeaLLMs – Large Language Models for Southeast Asia
Xuan-Phi Nguyen* , Wenxuan Zhang* , Xin Li* , Mahani Aljunied* , Zhiqiang Hu, Chenhui Shen, Yew Ken Chia, Xingxuan Li, Jianyu Wang, Qingyu Tan, Liying Cheng, Guanzheng Chen, Yue Deng, Sen Yang, Chaoqun Liu, Hang Zhang, Lidong Bing.
To appear in ACL 2024 (System Demonstrations).
[demo][SeaLLM-7B-v2][SeaLLM-7B-v2.5][SeaBench][SeaExam]
- Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
Sicong Leng* , Hang Zhang* , Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, Lidong Bing.
To appear in CVPR 2024 (Full paper, Highlight).
[code by Sicong & Hang]
- CLEX: Continuous Length Extrapolation for Large Language Models
Guanzheng Chen, Xin Li, Zaiqiao Meng, Shangsong Liang, Lidong Bing.
In ICLR 2024 (Full paper, Poster).
[code by Guanzheng][CLEX-Phi-2][CLEX-LLaMA-2][CLEX-Mixtral][LongCorpus-2.5B]
- Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Hang Zhang, Xin Li, Lidong Bing.
In EMNLP 2023 (System Demonstrations).
[code by Hang][demo (hugging face)][demo (modelscope)][checkpoints]
- Once Upon a Time in Graph: Relative-Time Pretraining for Complex Temporal Reasoning
Sen Yang, Xin Li, Lidong Bing, Wai Lam.
In EMNLP 2023 (Full paper, Oral).
[code by Sen][RemeMo-Base][RemeMo-Large][Pretrained Time Identifier]
- From Clozing to Comprehending: Retrofitting Pre-trained Language Model to Pre-trained Machine Reader
Weiwen Xu, Xin Li, Wenxuan Zhang, Meng Zhou, Lidong Bing, Wai Lam and Luo Si.
In NeurIPS 2023 (Full paper, Poster)
[code by Weiwen][PMR-xxlarge][Finetuned PMR for NER][Finetuned PMR for EQA]
- mPMR: Multilingual Machine Reader Pre-training at Scale
Weiwen Xu, Xin Li, Wai Lam and Lidong Bing.
In ACL 2023 (Short paper, Poster)
[code by Weiwen]
- PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks
Weiwen Xu, Xin Li, Yang Deng, Lidong Bing and Wai Lam.
In ACL 2023 (Full paper, Poster)
[code by Weiwen]
- Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learning
Ran Zhou, Xin Li, Lidong Bing, Erik Cambria and Chunyan Miao.
In ACL 2023 (Full paper, Poster)
[code by Ran]
- Enhancing Cross-lingual Prompting with Dual Prompt Augmentation
Meng Zhou, Xin Li, Yue Jiang and Lidong Bing.
In Findings of ACL 2023 (Short paper)
[code by Meng]
Honors & Awards
- AAAI Student Scholarship, 2020
- Outstanding Graduates Awards, Sun Yat-Sen University.
- Excellent Undergraduate Thesis award, Sun Yat-Sen University.
Professional Activities
- Reviewer (or PC Member):
- ACL 2020-2023, EMNLP 2018-2023, NAACL 2021
- AAAI 2019-2020
- WSDM 2023, CIKM 2021
- ACM Transactions on Knowledge Discovery from Data (TKDD)
- ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)
- IEEE Transaction on Multimedia (TMM)
- Neurocomputing
- Computational Intelligence
Some Useful Notes & Links
Hobbies
- Playing basketball
- Swimming
- Hiking