Model Details

Model: FrancescoArno94/SmolLM3-3B-math
Base Model: HuggingFaceTB/SmolLM3-3B
Dataset: microsoft/orca-math-word-problems-200k

Evaluation command

hf jobs uv run
--flavor a10g-large
--with "lighteval[vllm]"
-s HF_TOKEN
lighteval vllm "model_name=FrancescoArno94/SmolLM3-3B-math" "lighteval|gsm8k|0|0" --push-to-hub --results-org FrancescoArno94