YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Generated by llm-compressor

Throughput: 5.28 requests/s, 6087.72 total tokens/s, 676.41 output tokens/s

Perplexity (ppl; Accuracy):

|Tasks|Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k|      3|flexible-extract|     5|exact_match|↑  |0.6152|±  |0.0215|
|     |       |strict-match    |     5|exact_match|↑  |0.5918|±  |0.0217|
Downloads last month
1
Safetensors
Model size
0.6B params
Tensor type
I64
·
I32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support