Kooten

Kooten's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Kooten/gemma-4-31b-abliterated-v1.1 7 days ago

KL Div

3

#1 opened 7 days ago by

SerialKicked

New activity in Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2 about 1 year ago

vram

2

#2 opened about 1 year ago by

rakmik

New activity in Kooten/Mistral-Nemo-Instruct-2407-norefuse-OAS-6.5bpw-exl2 over 1 year ago

Issue with model.safetensors.index.json

2

#1 opened over 1 year ago by

ghostlamp

New activity in Kooten/Mistral-Nemo-Instruct-2407-norefuse-OAS over 1 year ago

Getting a ValueError upon loading the model, tensors are not matching.

3

#1 opened over 1 year ago by

johann15

New activity in Kooten/Kunoichi-DPO-v2-7B-6bpw-exl2 about 2 years ago

Help. Getting Gibberish Responses?

6

#1 opened about 2 years ago by deleted

New activity in Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2 about 2 years ago

Request for Higher 4bpw Quant

3

#1 opened about 2 years ago by deleted

New activity in NeverSleep/MiquMaid-v2-70B-GGUF about 2 years ago

Any plan of realeasing q2_k_s quants?

4

#1 opened about 2 years ago by

stduhpf

New activity in Kooten/MiquMaid-v1-70B-6bpw-exl2 about 2 years ago

can i request 8bpw?

1

#1 opened about 2 years ago by

Perpetuity7

New activity in Kooten/MiquMaid-v1-70B-IQ2-GGUF about 2 years ago

Thanks man!

❤️ 1

10

#1 opened about 2 years ago by

Nexesenex

Thank you so much for doing this chore. IQ2 > EXL2 @ <3bpw ?

❤️ 1

1

#2 opened about 2 years ago by

ProphetOfBostrom

New activity in Kooten/MiquMaid-v1-70B-3bpw-exl2 about 2 years ago

More quant?

2

#1 opened about 2 years ago by

Kotokin

New activity in Kooten/DaringMaid-20B-V1.1 about 2 years ago

Request for another exl quant

2

#1 opened about 2 years ago by

Clevyby

New activity in Kooten/DaringMaid-13B about 2 years ago

It Delivers!

❤️ 1

2

#1 opened about 2 years ago by

LunarAura

New activity in Kooten/FlatDolphinMaid-8x7B-4bpw-exl2 about 2 years ago

using context above 4096 - need to set compress_pos_emb above 1?

5

#1 opened over 2 years ago by

Samvanity

New activity in Kooten/Euryale-1.4-L2-70B-IQ2-GGUF about 2 years ago

Kobold can run IQ2

2

#1 opened about 2 years ago by

Nexesenex

New activity in Kooten/Noromaid-7B-0.4-DPO-4bpw-exl2 about 2 years ago

This is the other model that had the same problem to my knowledge.

2

#1 opened about 2 years ago by

Nitral-AI

New activity in Kooten/Lelantos-Maid-DPO-7B-4bpw-exl2 about 2 years ago

Thanks my dude <3

3

#1 opened about 2 years ago by

Nitral-AI

New activity in Kooten/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-3.5bpw-exl2 over 2 years ago

VRAM usage & card recommendations

1

#1 opened over 2 years ago by

tensiondriven

New activity in Kooten/DaringMaid-20B over 2 years ago

Thanks! I like this one :-)

1

#1 opened over 2 years ago by

ThiloteE

New activity in Kooten/FlatOrcamaid-13b-v0.2-4bit-mlx over 2 years ago

exllama version?

2

#1 opened over 2 years ago by

Nexesenex