Duplicated from v2ray/Mixtral-8x22B-v0.1

mistral-community
/

Mixtral-8x22B-v0.1

Text Generation

Mixture of Experts

Eval Results (legacy)

text-generation-inference

Model card Files Files and versions

Use model in LMStudio

#8

by MrZoidberg - opened Apr 11, 2024

How to run this model in LMStudio? I have the following error:

"llama.cpp error: 'error loading model architecture: unknown model architecture: '''"

Unofficial Mistral Community [deprecated] org Apr 11, 2024

You need GGUF quants

You can get the GGUF quants here https://huggingface.co/andrijdavid/Mixtral-8x22B-v0.1-GGUF

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment