Is there Q4_K_M version coming?
#1
by MartinPatterson - opened
Thank you anyways!
rich1 is currently busy with different models but it should soon resume work on this one so all our usual quants will eventually be provided. With such large models things just sometimes take a bit longer especially during busy times like this where a ton of new models are getting released. You can always check https://hf.tst.eu/status.html for a real time status update of where in our queue a model is located and estimate when your desired quants will get computed:
40 242 sI Step-3.5-Flash-REAP-121B-A11B ready/static
If it is urgent for you to have them, please let me know and I could prioritize this model.
Thanks for the offer, I actually might try your existing Step-3.5-Flash-REAP-121B-A11B.Q4_K_S.gguf first and may upgrade that to K_M eventually.
Cheers!