Haopeng Li

Doctor of Philosophy

Personal Profile

My name is Haopeng (Hop) Li, and I received my PhD from The University of Melbourne. I was supervised by Prof. Tom Drummond, Dr. Mingming Gong, and Dr. Qiuhong Ke. I received my B.S. degree from the School of Science at Northwestern Polytechnical University, and my Master’s degree from the School of Artificial Intelligence, Optics, and Electronics (iOPEN) at Northwestern Polytechnical University. I’m currently an AI algorithm engineer at PICO, ByteDance.

My research interests include:

  • Computer Vision
  • Video Understanding
  • Multimodal Learning
  • Generative Models

I have published several papers in recognized journals and conferences, including T-PAMI, T-IP, ECCV, and ICML.

Education

Dec 2020 — Dec 2024

The University of Melbourne, Melbourne, Australia

PhD · Engineering and IT

Sep 2017 — May 2020

Northwestern Polytechnical University, Xi’an, China

MSc · Computer Science and Technology

Sep 2013 — Jun 2017

Northwestern Polytechnical University, Xi’an, China

BSc · Mathematics and Applied Mathematics

Experience

Jan 2025 — Now

PICO, ByteDance, China

AI Algorithm Engineer · Human Visual Perception

Jun 2023 — Aug 2023

Monash University, Melbourne, Australia

Research Assistant · Bridge Competition Cheating Detection GitHub Repo stars

Jun 2022 — Aug 2022

The University of Melbourne, Melbourne, Australia

Research Assistant · Sports Video Understanding

Jun 2020 — Dec 2020

SenseTime Group Ltd, Beijing, China

Research Intern · Full-time · Crowd Video Analysis

Publications

Jan 2026

SAM-Veteran: An MLLM-Based Human-like SAM Agent for Reasoning Segmentation Static Badge

2026 International Conference on Learning Representations (ICLR)

Tianyuan Du, Haopeng Li, Zhen Fan, Jiarui Zhang, Panwang Pan, Yang Zhang

Jan 2026

Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports
Static Badge GitHub Repo stars

International Journal of Computer Vision (IJCV)

Haopeng Li, Andong Deng, Jun Liu, Hossein Rahmani, Yulan Guo, Bernt Schiele, Mohammed Bennamoun, Qiuhong Ke

Jun 2025

Answering from Sure to Uncertain: Uncertainty-Aware Curriculum Learning for Video Question Answering Static Badge

2025 British Machine Vision Conference (BMVC)

Haopeng Li, Mohammed Bennamoun, Jun Liu, Hossein Rahmani, Qiuhong Ke

June 2025

Admitting Ignorance Helps the Video Question Answering Models to Answer Static Badge

IEEE Transactions on Multimedia (T-MM)

Haopeng Li, Tom Drummond, Mingming Gong, Mohammed Bennamoun, Qiuhong Ke

May 2024

Visual-Text Cross Alignment: Refining the Similarity Score in Vision-Language Models Static Badge GitHub Repo stars

2024 International Conference on Machine Learning (ICML)

Jinhao Li, Haopeng Li, Sarah Monazam Erfani, Lei Feng, James Bailey, Feng Liu

Jan 2023

Progressive Video Summarization via Multimodal Self-supervised Learning Static Badge Static Badge GitHub Repo stars

2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

Haopeng Li, Qiuhong Ke, Mingming Gong, Tom Drummond

Jan 2023

Precondition and Effect Reasoning for Action Recognition Static Badge GitHub Repo stars

Computer Vision and Image Understanding (CVIU)

Hongsang Yoo, Haopeng Li, Qiuhong Ke, Liangchen Liu, Rui Zhang

Oct 2022

Doubly Deformable Aggregation of Covariance Matrices for Few-Shot Segmentation Static Badge GitHub Repo stars

2022 European Conference on Computer Vision (ECCV)

Zhitong Xiong, Haopeng Li, Xiao Xiang Zhu

Sep 2022

Video Crowd Localization with Multifocus Gaussian Neighborhood Attention and a Large-Scale Benchmark Static Badge GitHub Repo stars

IEEE Transactions on Image Processing (T-IP)

Haopeng Li, Lingbo Liu, Kunlin Yang, Shinan Liu, Junyu Gao, Bin Zhao, Rui Zhang, Jun Hou

Jun 2022

Video Joint Modelling Based on Hierarchical Transformer for Co-summarization Static Badge GitHub Repo stars

IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI)

Haopeng Li, Qiuhong Ke, Mingming Gong, Rui Zhang

Dec 2021

Action-ViT: Pedestrian Intent Prediction in Traffic Scenes Static Badge

IEEE Signal Processing Letters (SPL)

Shengzhe Zhao, Haopeng Li, Qiuhong Ke, Liangchen Liu, Rui Zhang

Apr 2021

Reconstructive Sequence-Graph Network for Video Summarization Static Badge

IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI)

Bin Zhao, Haopeng Li, Xiaoqiang Lu, Xuelong Li

May 2020

Video Frame Interpolation via Residue Refinement Static Badge GitHub Repo stars

2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Haopeng Li, Yuan Yuan, Qi Wang

Awards and Honors

Mar 2020

Melbourne Research Scholarship

The University of Melbourne

Oct 2019

China National Scholarship

Ministry of Education of the People’s Republic of China

Apr 2016

International Mathematical Contest in Modeling (Meritorious Winner)

The Consortium for Mathematics and Its Applications (COMAP)