Spaces:
Sleeping
Sleeping
Hey could you update your space for Gemma4, transformers 5.5?
#1
by RyanoSaurus-Wrex - opened
Your space looks awesome, with the extra abilites of bybrid quants and all of it compared to the GGML space, but can't use it without an update, so can you update it? Thanks!
Thanks but I'm not sure how to update it for new archs like Gemma 4.
I used this for a while but have discontinued this tool because it was wasting SSD write cycles by making duplicate temporary copies of everything.
I've found llama.cpp direct quantizations via command prompt works quicker and easier.
Ok I don't have the ram to quant big models or I would, so thanks anyways.