Possible to heretic these (for tuning) : 21B, 19B A4Bs ?
Love you stuff; excellent work as always!
Wondering if you can Heretic 19B and/or 21B :
https://huggingface.co/0xSero/gemma-4-19b-a4b-it-REAP
https://huggingface.co/0xSero/gemma-4-21b-a4b-it-REAP
"19" would be fantastic ; just finishing tuning on it atm ; out later today.
These models need to be heretic'ed.
Perfect size for tuning ; as right now must be tuned in 16 bit - high VRAM precision in Unsloth.
I too would enjoy this. 19b is like just small enough to largely squeeze into 8gb vram (maybe with turbo quant), and still only moderately effected by the prune. Which hasn't really been the case with qwen similar moe. Can imagine 21b is quite good for 12gb vram configs. Just on the inference side.
In progress!
Expect them in couple of hours!
Off the scale! thanks so much!
Exceptional !!! ;
Gonna tune it ASAP!