TheBloke
/

OpenAssistant-SFT-7-Llama-30B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

AutoGptq

#9

by Kurapika993 - opened May 15, 2023

Hi does this work directly with autogptq ?

Owner May 15, 2023

It does!

Nice thank for the effort

Kurapika993 changed discussion status to closed May 15, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment