Trade for ram
#2
by marduk191 - opened
we'll need to sell this 1955 Mercedes-Benz 300 SLR Uhlenhaut Coupe to get the ram to run this one. more to come.
We're uploading the rest of the quants. Should be around 200GB in size.
This comment has been hidden (marked as Off-Topic)
Ok they're uploading now! The rest will be uploaded in the next few hours
GLM-5-UD-IQ1_S-00001-of-00006.gguf is only 9mb? is this huggingface error? it should be around 50gb no?
@albert7jeong Oh yes this is correct - the first shard now is just a chat template + metadata, so if it changes in the future, people only need to replace this one component, so it's qutie small.
I have this kidney trading it for enough ram to run model, asking price is 512GB DDR5 /s