About Me
I am a Research Engineer at Alibaba DAMO Academy. I obtained my PhD degree from The Chinese University of Hong Kong (CUHK) in 2021, under the supervision of Prof. Wai Lam. Before starting my PhD career, I was an undergraduate at Sun Yat-sen University (SYSU). I have interned at Microsoft Research Asia, Tencent AI Lab and Huawei Noah’s Ark Lab.
Contact E-mail: lixin4ever@gmail.com.
Research Interests
- Efficient LLM Fine-tuning & Inference
- Multimodal & Multilingual LLMs
Education
Experiences
- Jul 2020-Feb 2021, Research Intern, Speech and Semantics Group@Huawei Noah’s Ark Lab. Mentor: Dr. Yi Liao.
- Jan 2018-Apr 2018, Research Intern, NLP Center@Tencent AI Lab. Mentor: Dr. Lidong Bing and Dr. Piji Li.
- Jul 2015-Jun 2016, Research intern, Knowledge Computing Group@Microsoft Research Asia. Mentor: Dr. Chin-Yew Lin and Dr. Jing Liu
- Sep 2014-July 2015, Research assistant, SentiNet Group, Sun Yat-Sen University. Supervisor: Prof. Rao Yanghui
Recent Preprints & Publications [Full List]
- SeaLLMs – Large Language Models for Southeast Asia
Xuan-Phi Nguyen* , Wenxuan Zhang* , Xin Li* , Mahani Aljunied* , Qingyu Tan, Liying Cheng, Guanzheng Chen, Yue Deng, Sen Yang, Chaoqun Liu, Hang Zhang, Lidong Bing.
arXiv:2312.00738.
[demo][SeaLLM-7B-Chat][SeaLLM-13B-Chat][Sea-Bench]
- Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs
Sen Yang, Xin Li, Leyang Cui, Lidong Bing, Wai Lam.
arXiv:2311.09802
[code by Sen]
- Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
Sicong Leng* , Hang Zhang* , Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, Lidong Bing.
To appear in CVPR 2024 (Full paper).
[code by Sicong & Hang]
- CLEX: Continuous Length Extrapolation for Large Language Models
Guanzheng Chen, Xin Li, Zaiqiao Meng, Shangsong Liang, Lidong Bing.
To appear in ICLR 2024 (Full paper, poster).
[code by Guanzheng][CLEX-Phi-2][CLEX-LLaMA-2][CLEX-Mixtral][LongCorpus-2.5B]
- Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Hang Zhang, Xin Li, Lidong Bing.
In EMNLP 2023 (System Demonstrations).
[code by Hang][demo (hugging face)][demo (modelscope)][checkpoints]
- Once Upon a Time in Graph: Relative-Time Pretraining for Complex Temporal Reasoning
Sen Yang, Xin Li, Lidong Bing, Wai Lam.
In EMNLP 2023 (Full paper, oral).
[code by Sen][RemeMo-Base][RemeMo-Large][Pretrained Time Identifier]
- From Clozing to Comprehending: Retrofitting Pre-trained Language Model to Pre-trained Machine Reader
Weiwen Xu, Xin Li, Wenxuan Zhang, Meng Zhou, Lidong Bing, Wai Lam and Luo Si.
In NeurIPS 2023 (Full paper, poster)
[code by Weiwen][PMR-xxlarge][Finetuned PMR for NER][Finetuned PMR for EQA]
- mPMR: Multilingual Machine Reader Pre-training at Scale
Weiwen Xu, Xin Li, Wai Lam and Lidong Bing.
In ACL 2023 (Short paper, poster)
[code by Weiwen]
- PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks
Weiwen Xu, Xin Li, Yang Deng, Lidong Bing and Wai Lam.
In ACL 2023 (Full paper, poster)
[code by Weiwen]
- Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learning
Ran Zhou, Xin Li, Lidong Bing, Erik Cambria and Chunyan Miao.
In ACL 2023 (Full paper, poster)
[code by Ran]
- Enhancing Cross-lingual Prompting with Dual Prompt Augmentation
Meng Zhou, Xin Li, Yue Jiang and Lidong Bing.
In Findings of ACL 2023 (Short paper)
[code by Meng]
Honors & Awards
- AAAI Student Scholarship, 2020
- Outstanding Graduates Awards, Sun Yat-Sen University.
- Excellent Undergraduate Thesis award, Sun Yat-Sen University.
Professional Activities
- Reviewer (or PC Member):
- ACL 2020-2023, EMNLP 2018-2023, NAACL 2021
- AAAI 2019-2020
- WSDM 2023, CIKM 2021
- ACM Transactions on Knowledge Discovery from Data (TKDD)
- ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)
- IEEE Transaction on Multimedia (TMM)
- Neurocomputing
- Computational Intelligence
Some Useful Notes & Links
Hobbies
- Playing basketball
- Swimming
- Hiking