noctrex
/

UI-Venus-1.5-8B-GGUF

Model card Files Files and versions

These are quantizations of the model UI-Venus-1.5-8B, using a imatrix created from text_en_medium

Usage Notes:

Download the latest llama.cpp to use these quantizations.
Try to use the best quality you can run.
For the mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).

Downloads last month: 118

GGUF

Model size

8B params

Architecture

qwen3vl

Hardware compatibility

Log In to add your hardware

4-bit

5-bit

6-bit

8-bit

16-bit

View +1 variant

Model tree for noctrex/UI-Venus-1.5-8B-GGUF

Base model

inclusionAI/UI-Venus-1.5-8B

Quantized

(6)

this model