Yulu Pan

I'm a PhD student at the University of North Carolina at Chapel Hill in the Department of Computer Science.

I'm currently working with Prof. Gedas Bertasius on AI for sports, fine-grained skill analysis and video understanding. I'm also a research assistant at Zylka lab on developing computer vision models for spontaneous pain measurement from mouse.

Previously, I graduated from UNC in May 2023 with a B.S. in Computer Science and a B.A. in Mathematics, and received M.S. in Computer Science in May 2025. I worked with Prof. Roni Sengupta on computer vision during my undergraduate studies.

Email  /  CV  /  Google Scholar  /  Github  /  LinkedIn

profile photo
Research

I'm interested in Computer Vision, Video Understanding, and AI for Sports. My current focus is on fine-grained video understanding, particularly in the areas of sports analytics. I'm interested in how to leverage AI to improve the understadning of complex, fine-grained human action in sports.

Publication
exact img
ExAct: A Video-Language Benchmark for Expert Action Analysis
Han Yi, Yulu Pan, Feihong He, Xinyu Liu, Benjamin Zhang, Oluwatumininu Oguntola, Gedas Bertasius
arXiv, 2025
Project Page / Paper / Data

We introduce ExAct, a video-language benchmark for expert-level analysis of skilled human actions. It contains over 3,500 expert-curated video QA pairs across domains like sports, cooking, and music. Our benchmark reveals a significant performance gap between state-of-the-art VLMs and human experts, highlighting the need for models with a more nuanced understanding of complex human skills.

Basket GIF
BASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimation
Yulu Pan, Ce Zhang, Gedas Bertasius
CVPR 2025
Project Page / Paper / Code & Data

We present BASKET, a large-scale basketball video dataset for fine-grained skill estimation. BASKET contains more than 4,400 hours of video capturing 32,232 basketball players from all over the world. We benchmark multiple SOTA video recognition models and reveal that these models struggle to achieve good results on our benchmark.

Motion Matters: Neural Motion Transfer for Better Camera Physiological Sensing
Akshay Paruchuri, Xin Liu, Yulu Pan, Shwetak Patel, Daniel McDuff*, Soumyadip Sengupta*
WACV, 2024, Oral, Top 2.6%
Project Page / Paper / Code

Neural Motion Transfer serves as an effective data augmentation technique for PPG signal estimation from facial videos. We devise the best strategy to augment publicly available datasets with motion augmentation, improving up to 75% over SOTA techniques on five benchmark datasets.

semi Image
Semi-Supervised Semantic Segmentation with Multi-Reliability and Multi-Level Feature Augmentation
JianJian Yin, Zhichao Zheng, Yulu Pan, Yanhui Gu, Yi Chen*
Expert Systems with Applications, Volume 233, 15 December 2023, 120973
Paper / Code

Introducing a multi-reliability and multi-level feature augmentation framework for semi-supervised semantic segmentation, effectively utilizing labeled and unlabeled images and improving segmentation performance on benchmark datasets.

Misc

I am enthusiastic in helping other students succeed in computer science. I have shared my knowledge and support students' learning journey in the following course:

University of North Carolina at Chapel Hill, Undergraduate Learning Assistant:

  • COMP 301: Foundations of Programming
  • COMP 116: Introduction to Scientific Programming

Brandeis University, Teaching Assistant:

  • COSI 21A: Data Structures and the Fundamentals of Computing

Cloned from Jon Barron.