Pruned Version Please

#1
by Handyfff - opened

I loved your E4B model but my laptop is too broke for it to run more than 4 tokens/s.

I found this pruned Eng model. But it is censored.
https://huggingface.co/johnjg75/gemma-4-E4B-it-GGUF-pruned-Eng

I would actually prefer if you made an Uncensored pruned-English version yourself.

PLEASE.

Thank you for your kind words about the model!

Unfortunately, creating a pruned English-only version is beyond my current skills, as it requires significant expertise in model pruning and retraining.

Additionally, the repository you linked only provides a GGUF file. Decensoring from GGUF alone is also beyond my skills, as abliteration requires the original safetensors model to perform gradient-based matrix optimization.

I'm sorry I can't help with this one.

No problem, I am working on it myself. Thanks for replying anyways.

Handyfff changed discussion status to closed

Sign up or log in to comment