Xi Weng

PhD student

School of Computing, National University of Singapore

Email: xi.w@u.nus.edu

Github: github.com/winci-ai

[Publication] |[Education] | [Awards and Honors] | [Source Code]

My name is Xi Weng, and you can call me easily by Winci. I am currently a first-year PhD student at computer science of NUS, under the supervision of Prof. Jin-Song Dong. Prior to this, I earned both the Bachelor's and Master's degree from the School of Artificial Intelligence at Beihang University, where I was supervised by Prof. Lei Huang. My primary research interests lie in self-supervised learning and multimodal pre-training.
  • NEWS June 2024: One paper is accepted by TPAMI.
  • NEWS Jan 2024: One paper is accepted by ICLR 2024.
  • NEWS Sep 2022: One paper is accepted by NeurIPS 2022 (spotlight).

    • Publications

    Selected papers | All paper list

    TinyLLaVA Factory: A Modularized Codebase for Small-scale Large Multimodal Models
    Junlong Jia, Ying Hu, Xi Weng, Yiming Shi, Miao Li, Xingjian Zhang, Baichuan Zhou, Ziyu Liu, Jie Luo, Lei Huang, Ji Wu
    arXiv:2405.11788
    (co-first author)
    [Paper]
    [Code, 600+stars]
    TinyLLaVA: A Framework of Small-scale Large Multimodal Models
    Baichuan Zhou, Ying Hu, Xi Weng, Junlong Jia, Jie Luo, Xien Liu, Ji Wu, Lei Huang
    arXiv:2402.14289
    [Paper]
    [Code]
    Modulate Your Spectrum in Self-Supervised Learning
    Xi Weng, Yunhao Ni, Tengwei Song, Jie Luo, Rao Muhammad Anwer, Salman Khan, Fahad Khan, Lei Huang
    International Conference on Learning Representations(ICLR), 2024
    [Paper]
    [Code]
    Understanding Whitening Loss in Self-supervised Learning
    Lei Huang, Yunhao Ni, Xi Weng, Rao Muhammad Anwer, Salman Khan, Ming-Hsuan Yang, Fahad Shahbaz Khan
    Transactions on Pattern Analysis and Machine Intelligence(TPAMI), 2023
    [Paper]
    [Code]
    An Investigation into Whitening Loss for Self-supervised Learning
    Xi Weng, Lei Huang, Lei Zhao, Rao Muhammad Anwer, Salman Khan, Fahad Shahbaz Khan
    Advances in Neural Information Processing Systems(NeurIPS), 2022 (Spotlight)
    [Paper]
    [Code]

    Education

    • Jan. 2025 - Currently
      • PhD student in School of Computing, National University of Singapore
      • Advisor: Prof. Jin-Song Dong
    • Sep. 2022 - Dec. 2024
      • Master student in School of Artificial Intelligence, Beihang University
      • Advisor: Prof. Lei Huang
    • Sep. 2018 - Jun. 2022
      • Undergraduate in School of Artificial Intelligence, Beihang University
      • Advisor: Prof. Lei Huang

    Awards and Honors

    • Outstanding Graduate of Beihang University, 2024.

    • China National Scholarship, 2023.

    • Excellent Academic Innovation Achievement Award, 2023.

    • Academic Excellence Scholarship in Beihang University, 2023.

    • Excellent Freshman Scholarship in Beihang University, 2022.

    • Academic Excellence Scholarship in Beihang University, 2018.

    Source Code

    Miscellaneous

    • I also have great interest in fitness, singing and guitar.
    Main Co-authors: [Jin-Song Dong] | [Lei Huang] | [Fahad Shahbaz Khan]