avatar

Zhi Gao (高志)

Associate Professor (tenure-track)
Beijing Institute of Technology
zhi.gao@bit.edu.cn


About Me

I am an associate professor (tenure-track) at the School of Computer Science and Technology, Beijing Institute of Technology (BIT). Before that, I was a postdoctoral research fellow at the School of Intelligence Science and Technology, Peking University.

E-mail: zhi.gao@bit.edu.cn, gaozhibit@bit.edu.cn, zhi.gao@pku.edu.cn, and gaozhi_2017@126.com

Recruitment

I am always looking for highly motivated Master and Ph.D. students who have excellent mathematic and programming skills to work on machine learning, vision and language modeling, and Riemannian manifold analytics. Please do not hesitate to send me your CV, if you are interested in our group. (欢迎对计算机视觉、多媒体分析、机器学习等领域研究有兴趣的同学加入课题组)[详细招生信息]

Education

I received my B.S. degree in computer science from the Beijing Institute of Technology (BIT), Beijing, China, in 2017.

I received my Ph.D. degree in computer science from the Beijing Institute of Technology (BIT), Beijing, China, in 2023, under the supervision of Prof. Yuwei Wu and Prof. Yunde Jia.

Research Interests

I am interested in computer vision and machine learning, including AI Agent, Multimodal Learning, Transfer Learning, and Riemannian Geometry. You can click them for more details.

AI Agents

  1. Memory-Centric Embodied Question Answer
    Mingliang Zhai, Zhi Gao, Yuwei Wu, Yunde Jia
    PDF Code Project Page

  2. Iterative Tool Usage Exploration for Multimodal Agents via Step-wise Preference Tuning
    Pengxiang Li*, Zhi Gao*, Bofei Zhang, Yapeng Mi, Xiaojian Ma, Chenrui Shi, Tao Yuan, Yuwei Wu, Yunde Jia, Song-Chun Zhu, Qing Li (*Co-first author)
    PDF Code Project Page

  3. TongUI: Building Generalized GUI Agents by Learning from Multimodal Web Tutorials
    Bofei Zhang*, Zirui Shang*, Zhi Gao*, Wang Zhang, Rui Xie, Xiaojian Ma, Tao Yuan, Xinxiao Wu, Song-Chun Zhu, Qing Li (*Co-first author)
    PDF Code Project Page

  4. Building LLM Agents by Incorporating Insights from Computer Systems
    Yapeng Mi, Zhi Gao, Xiaojian Ma, Qing Li
    PDF

  5. ICLR
    Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage
    Zhi Gao*, Bofei Zhang*, Pengxiang Li*, Xiaojian Ma, Yue Fan, Tao Yuan, Yuwei Wu,Yunde Jia, Song-Chun Zhu, Qing Li (*Co-first author)
    International Conference on Learning Representations (ICLR), 2025
    PDF Code Project Page

  6. ECCV
    VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding
    Yue Fan*, Xiaojian Ma*, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Gao, Qing Li
    European Conference on Computer Vision (ECCV), 2024
    PDF Code Project Page

  7. CVPR
    CLOVA: A Closed-LOop Visual Assistant with Tool Usage and Update
    Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
    PDF Code Project Page

Multimodal Learning

  1. When Large Multimodal Models Confront Evolving Knowledge: Challenges and Pathways
    Kailin Jiang, Yuntao Du, Yukai Ding, Yuchen Ren, Ning Jiang, Zhi Gao, Zilong Zheng, Lei Liu, Bin Li, Qing Li
    PDF

  2. Chain-of-Focus: Adaptive Visual Search and Zooming for Multimodal Reasoning via RL
    Xintong Zhang*, Zhi Gao*, Bofei Zhang, Pengxiang Li, Xiaowen Zhang, Yang Liu, Tao Yuan, Yuwei Wu1, Yunde Jia, Song-Chun Zhu, Qing Li (*Co-first author)
    PDF Code Project Page

  3. ICLR
    MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge
    Yuntao Du, Kailin Jiang, Zhi Gao, Chenrui Shi, Zilong Zheng, Siyuan Qi, Qing Li
    International Conference on Learning Representations (ICLR), 2025
    PDF

  4. NeurIPS
    FIRE: A Dataset for Feedback Integration and Refinement Evaluation of Multimodal Models
    Pengxiang Li*, Zhi Gao*, Bofei Zhang*, Tao Yuan, Yuwei Wu, Mehrtash Harandi, Yunde Jia, Song-Chun Zhu, Qing Li (*Co-first author)
    Advances in Neural Information Processing Systems (NeurIPS), D&B Track, 2024
    PDF Code Project Page

Transfer Learning

  1. VUDG: A Dataset for Video Understanding Domain Generalization
    Ziyi Wang, Zhi Gao+, Boxuan Yu, Zirui Dai, Yuxiang Son, Qingyuan Lu, Jin Chen, Xinxiao Wu
    PDF Project Page

  2. Simulate, Refocus and Ensemble: An Attention-Refocusing Scheme for Domain Generalization
    Ziyi Wang, Zhi Gao, Jin Chen, Qingjie Zhao, Xinxiao Wu, Jiebo Luo,
    IEEE Transactions on Multimedia (T-MM), 2025

  3. CVPR
    Meta-causal Learning for Single Domain Generalization
    Jin Chen*, Zhi Gao*, Xinxiao Wu, Jiebo Luo (*Co-first author)
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
    PDF Code

Riemannian Geometry

  1. A Set-to-Set Distance Measure in Hyperbolic Space
    Pengxiang Li, Wei Wu, Zhi Gao, Xiaomeng Fan, Peilin Yu, Yuwei Wu, Zhipeng Lu, Yunde Jia, Mehrtash Harandi
    PDF

  2. Geometry-aware Distance Measure for Diverse Hierarchical Structures in Hyperbolic Spaces
    Pengxiang Li, Yuwei Wu, Zhi Gao, Xiaomeng Fan, Wei Wu, Zhipeng Lu, Yunde Jia, Mehrtash Harandi
    PDF

  3. Hyperbolic Dual Feature Augmentation for Open-Environment
    Peilin Yu, Yuwei Wu, Zhi Gao, Xiaomeng Fan, Shuo Yang, Yunde Jia
    PDF

  4. CVIU
    Large-Scale Riemannian Meta-Optimization via Subspace Adaptation
    Peilin Yu, Yuwei Wu+, Zhi Gao+, Xiaomeng Fan, Yunde Jia (+Corresponding Author)
    Computer Vision and Image Understanding(CVIU), 2025
    PDF Code

  5. 计算机学报
    混合曲率空间中的几何自适应元学习方法
    高志, 武玉伟, 贾云得
    计算机学报, 2024.
    PDF

  6. CVPR
    Exploring Data Geometry for Continual Learning
    Zhi Gao, Chen Xu, Feng Li, Yunde Jia, Mehrtash Harandi, Yuwei Wu
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
    PDF

  7. T-PAMI
    Learning to Optimize on Riemannian Manifolds
    Zhi Gao, Yuwei Wu, Xiaomeng Fan, Mehrtash Harandi, Yunde Jia
    IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), 2023
    PDF Code

  8. T-PAMI
    Curvature-Adaptive Meta-Learning for Fast Adaptation to Manifold Data
    Zhi Gao, Yuwei Wu, Mehrtash Harandi, Yunde Jia
    IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), 2023
    PDF Code

  9. NeurIPS
    Hyperbolic Feature Augmentation via Distribution Estimation and Infinite Sampling on Manifolds
    Zhi Gao, Yuwei Wu, Mehrtash Harandi, Yunde Jia
    Advances in Neural Information Processing Systems (NeurIPS), 2022
    PDF Code

  10. AAAI
    Efficient Riemannian Meta-Optimization by Implicit Differentiation
    Xiaomeng Fan, Yuwei Wu, Zhi Gao, Yunde Jia, Mehrtash Harandi
    AAAI Conference on Artificial Intelligence (AAAI), 2022
    PDF Code

  11. ICCV
    Curvature Generation in Hyperbolic Spaces for Few-Shot Learning
    Zhi Gao, Yuwei Wu, Yunde Jia, Mehrtash Harandi
    IEEE InternationalConference on Computer Vision (ICCV), 2021
    PDF Code

  12. AAAI
    Learning a Gradient-free Riemannian Optimizer on Tangent Spaces
    Xiaomeng Fan*, Zhi Gao*, Yuwei Wu, Yunde Jia, Mehrtash Harandi (*Co-first author)
    AAAI Conference on Artificial Intelligence (AAAI), 2021
    PDF Code

  13. CVPR
    A Hyperbolic-to-Hyperbolic Graph Convolutional Network
    Jindou Dai, Yuwei Wu, Zhi Gao, Yunde Jia
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
    PDF Code

  14. PR
    Infinite-dimensional Feature Aggregation via a Factorized Bilinear Model
    Jindou Dai, Yuwei Wu, Zhi Gao, Yunde Jia
    Pattern Recognition (PR), 2021
    PDF

  15. CVPR
    Learning to Optimize on SPD Manifolds
    Zhi Gao, Yuwei Wu, Yunde Jia, Mehrtash Harandi
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020
    PDF Code

  16. AAAI
    Revisiting Bilinear Pooling: A Coding Perspective
    Zhi Gao, Yuwei Wu, Xiaoxun Zhang, Jindou Dai, Yunde Jia, Mehrtash Harandi
    AAAI Conference on Artificial Intelligence (AAAI), 2020
    PDF Code

  17. T-NNLS
    A Robust Distance Measure for Similarity-Based Classification on the SPD Manifold
    Zhi Gao, Yuwei Wu, Mehrtash Harandi, Yunde Jia
    IEEE Transactions on Neural Networks and Learning Systems (T-NNLS), 2019
    PDF Code

  18. PR
    Learning a robust representation via a deep network on symmetric positive definite manifolds
    Zhi Gao, Yuwei Wu, Xingyuan Bu, Tan Yu, Junsong Yuan, Yunde Jia
    Pattern Recognition (PR), 2021
    PDF Code

  19. PR
    Deep convolutional network with locality and sparsity constraints for texture classification
    Xingyuan Bu, Yuwei Wu, Zhi Gao, Yunde Jia
    Pattern Recognition (PR), 2021
    PDF

Others


Powered by Jekyll and Minimal Light theme.