Some wrong when load the 32B model
I am encountering an issue when attempting to load the 32B model. While loading the 7B model works without any problems, trying to load the 32B model results in the following error:
safetensors_rust.SafetensorError: Error while deserializing header: InvalidHeaderDeserialization
I have already re-downloaded the official model files from Hugging Face twice to rule out any download corruption, but the error persists. This leads me to suspect that the model upload might be incomplete or corrupted on the source side.
Could anyone please help me troubleshoot this issue or confirm whether the 32B model files are intact?
Thank you in advance for your support.
I am encountering an issue when attempting to load the 32B model. While loading the 7B model works without any problems, trying to load the 32B model results in the following error:
safetensors_rust.SafetensorError: Error while deserializing header: InvalidHeaderDeserialization
I have already re-downloaded the official model files from Hugging Face twice to rule out any download corruption, but the error persists. This leads me to suspect that the model upload might be incomplete or corrupted on the source side.Could anyone please help me troubleshoot this issue or confirm whether the 32B model files are intact?
Thank you in advance for your support.
what is your transformer version? Some transformers versions are not compatible with our model. You may need to use transformers<=4.52.1