Multimodal understanding
Video-MME / Video-MME v2
Video understanding, temporal reasoning and cross-video-length performance.
About Video-MME / Video-MME v2
What it measures
Question accuracy by task, duration and input setting.
Scope & limitations
Understanding is distinct from generation. Changing subtitle/audio access changes the test.
Evaluation environment
Video model with declared frame sampling, audio and subtitle access.