Multimodal understanding / Benchmark leaderboard
Video-MME / Video-MME v2
Video understanding, temporal reasoning and cross-video-length performance.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Question accuracy by task, duration and input setting.
Execution requirements
Video model with declared frame sampling, audio and subtitle access.
Scope and limitations
Understanding is distinct from generation. Changing subtitle/audio access changes the test.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established family; newer v2
- Hugging Face · MME-Benchmarks/Video-MME-v2 ↗Public · Selected current video-understanding extension.
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Alibaba Qwen: Capability-aligned; adapter/access to qualify
Google DeepMind: Capability-aligned; adapter/access to qualify
Meta: Capability-aligned; adapter/access to qualify
OpenAI: Capability-aligned; adapter/access to qualify
Runway: Capability-aligned; adapter/access to qualify
Twelve Labs: Capability-aligned; adapter/access to qualify