Spaces:

mii-llm
/

open_ita_llm_leaderboard

Running on CPU Upgrade

What is `m_mmul` benchmark?

by zhiminy - opened Mar 30, 2024

•

Is that MMLU?

mii-llm org Apr 1, 2024

yes but italian translated!

•

yes but italian translated!

Thanks! I mean, is it m_mmul in Italian for MMLU?

mii-llm org Apr 1, 2024

no it's a typo in my brain :), the metrics is mmlu_it but for some time I was convicted that the name of the evaluation was mmul.

FinancialSupport changed discussion status to closed Apr 9, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment