Hi there, I am Ziqi Yuan (袁子麒 in Chinese), a Ph.D. student at the the THUIAR group with State Key Laboratory of Intelligent Technology and Systems, Department of Computer Science and Technology (DCST), Tsinghua University, Beijing, China. My supervisor is Prof. Hua Xu. My research mainly focused on Robustness of Multimodal Models (including MLLMs), and its Interpretability. I have published several papers at the top international AI journals and conferences, such as T-MM, T-ASLP, ACM MM, AAAI, and ACL. .

Feel free to reach out if you’re interested in my work and want to explore potential collaborations: x@y, where x = yzq21 and y = mails.tsinghua.edu.cn.

📖 Experiences

  • 2021.09 - 2026.06 (Expected), Ph.D. student, Department of Computer Science and Technology, Tsinghua University, China.
  • 2020.06 - 2020.09, 快手-社区科学部-算法工程师, advised by Bin Han, China.
  • 2019.07 - 2019.08, Summer School at University of California, Berkeley, China.
  • 2017.09 - 2021.06, B.S., Department of Computer Science and Technology, Beijing University of Posts and Telecommunications (BUPT), China.

🔥 News

  • 2024.07:  🎉🎉 Got one first-author full paper accepted by IEEE/ACM TASLP.
  • 2024.06:  🎉🎉 Got one first-author full paper accepted by ACL 2024 (Demo Track).
  • 2024.05:  🎉🎉 Got one co-first author full paper accepted by IEEE Trans. on Multimedia.
  • 2024.02:  🎉🎉 Got one first-author full paper accepted by IEEE Trans. on Multimedia.
  • 2023.10:  🎉🎉 Successfully passed the thesis proposal report and obtained an A- (4.0/4.0)
  • 2023.04:  🎉🎉 Got one first-author full paper accepted by IEEE Trans. on Multimedia.

📝 Publications

Research Interests: Trustworthy Multimodal Machine Learning and Explainable AI (XAI) in Future.

  • Robustness under Modality Noise: Reconstruction based [1], Adversarial Training [2], Meta Learning [3] Approaches.
  • Modality Dominant Challenge: Generated Unimodal Labels [11] and Weights [6], SIMS v2 dataset and Mixup [8].
  • Visualization and Demos of Noise Impact: M-SENA Platform [9], Robust-MSA Toolkit [7] and its extension [4].
  • Others: Multimodal Conversations [10], Semi-supervised Methods [5].
ACMMM 2021
sym

[1] Transformer-based feature reconstruction network for robust multimodal sentiment analysis

Ziqi Yuan* , Wei Li*, Hua Xu, Wenmeng Yu

Project

  • This work introduces a transformer-based feature reconstruction network (TFR-Net) to improve the robustness of models for the random missing in non-aligned modality sequences.
T-MM 2023
sym

[2] Noise imitation based adversarial training for robust multimodal sentiment analysis

Ziqi Yuan* , YiHe Liu*, Hua Xu, Kai Gao

Project

  • In this work, we formulate the imperfection with the modality feature missing at the training period and propose the noise intimation based adversarial training framework to improve the robustness against various potential imperfections at the inference period.
T-MM 2024
sym

[3] Meta Noise Adaption Framework for Multimodal Sentiment Analysis with Feature Noise

Ziqi Yuan* , Baozheng Zhang*, Hua Xu, Kai Gao

Project

  • This work presents one of the earliest efforts utilizing the meta learning perspective which treats each specific noise pattern as an individual task within the broader noisy Multimodal Sentiment Analysis task family.
ACL 2024
sym

[4] OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios

Ziqi Yuan, Baozheng Zhang, Zhiyun Liang, Hua Xu, Kai Gao

Project

  • This work presents OpenVNA, an open-source framework designed for analyzing the behavior of multimodal language understanding systems under noisy conditions. Demo video can be found on Youtube.

🎖 Honors and Awards

  • 2023.10 Overall Excellent Scholarship (Second Prize), Tsinghua University. (Top 10%)
  • 2022.10 Overall Excellent Scholarship (First Prize), Tsinghua University. (Top 5%)
  • 2021.06 Beijing Outstanding graduates, from Beijing University of Posts and Telecommunications (BUPT), rank 2 / 404.
  • 2019.10 Huawei Scholarship. (Top 2%)
  • 2020.04 Meritorious Winner, MCM/ICM 2020.
  • 2018.11 First prize, the Chinese Mathematics Competitions for College Students. (Top 5%)
  • 2018.10 National Scholarship for Undergraduate Student (2018 No.01215). (Top 1%)