josephmayo
/

gemma-4-E4B-it-coding-lora

Model card Files Files and versions

gemma-4-E4B-it-coding-lora / EVAL50_README.md

josephmayo's picture

Upload EVAL50_README.md with huggingface_hub

1689294 verified 12 days ago

|

history blame contribute delete

295 Bytes

	# Gemma-4-E4B-it-Coder 50-Problem Eval

	Executable HumanEval subset: 50 tasks.

	\| Metric \| Base \| Coder \|
	\|---\|---:\|---:\|
	\| Pass count \| 34 / 50 \| 42 / 50 \|
	\| Absolute lift \| - \| 16.0 pp \|
	\| Relative pass-count lift \| - \| 23.53% \|

	Full generated code is in `eval50_before_after_full_code.csv`.