glm-edge-1.5B-CoreML

介绍(Introduction)

此模型是从glm-edge-1.5B导出的4bit, 6bit混合量化版本的CoreML模型,最大上下文长度为640。

下载

#安装Huggingface-cli
pip install huggingface-cli
#命令行工具下载
huggingface-cli download --model 'zhangaoxiang/glm-edge-1.5B-coreml-5bit-ctx-640' --local_dir 'path/to/dir'
#SDK模型下载
from huggingface_hub import snapshot_download
model_dir = snapshot_download('zhangaoxiang/glm-edge-1.5B-coreml-5bit-ctx-640')
Downloads last month
29
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for zhangaoxiang/glm-edge-1.5B-coreml-5bit-ctx-640

Quantized
(8)
this model