QuantFactory/CarbonVillain-en-10.7B-v4-GGUF

This is quantized version of jeonsworld/CarbonVillain-en-10.7B-v4 created using llama.cpp

Original Model Card

CarbonVillain

This is a model created without learning to oppose indiscriminate carbon emissions.

This model is an experimental version created using mergekit.

Ranked 1st 2023.12.30

thanks to KyujinHan, Yağız Çalık and VAGO solutions

Prompt Template(s)

### User:
{user}

### Assistant:
{asistant}

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 74.52
AI2 Reasoning Challenge (25-Shot) 71.25
HellaSwag (10-Shot) 88.48
MMLU (5-Shot) 66.27
TruthfulQA (0-shot) 71.95
Winogrande (5-shot) 83.58
GSM8k (5-shot) 65.58
Downloads last month
23
GGUF
Model size
11B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Evaluation results