File size: 295 Bytes
1689294
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
# Gemma-4-E4B-it-Coder 50-Problem Eval

Executable HumanEval subset: 50 tasks.

| Metric | Base | Coder |
|---|---:|---:|
| Pass count | 34 / 50 | 42 / 50 |
| Absolute lift | - | 16.0 pp |
| Relative pass-count lift | - | 23.53% |

Full generated code is in `eval50_before_after_full_code.csv`.