Skip to content

Conversational voice and audio understanding

MMAU

Audio understanding/reasoning over speech, sound and music.

About MMAU

What it measures

Question-answer accuracy by audio category.

Scope & limitations

Harbor's 1,000-task adapter uses Qwen2-Audio transcripts for text models. That port does not measure native audio perception and must be labeled separately.

Evaluation environment

Audio-language model receiving the original clips.

Source

Original benchmark

Dataset & task catalog ↗