GGUFs for Faro Yi 34B 200K - https://huggingface.co/wenbopan/Faro-Yi-34B-200K

iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt

Files >50gb have been split with peazip. Recombine with peazip, 7zip, or simple concatenate command.

Downloads last month
9
GGUF
Model size
34B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Datasets used to train MarsupialAI/Faro-Yi-34B-200K_iMatrix_GGUF