Help us Cerebras - you're our only hope
#2
by AImhotep - opened
Your GLM-4.6 25% REAP version is out of this world! Seriously - very good job, thank you!
Can I ask for support of GLM-4.7? I've tried to add new model to your reap repo on GitHub but unfortunately there is something that I've missed and cannot do reap by my own.
Thank you!
@alecm-cerebras we've just uploaded 4.7 REAPs:
25% FP8: https://hf.co/cerebras/GLM-4.7-REAP-268B-A32B-FP8
25% BF16: TBD
40% FP8: https://hf.co/cerebras/GLM-4.7-REAP-218B-A32B-FP8
40% BF16: https://hf.co/cerebras/GLM-4.7-REAP-218B-A32B
Enjoy!
lazarevich changed discussion status to closed
Thank you!
25% BF16: TBD <- dibs on that as I need to AWQ to 4 bits