cassum-test-q5_k_m - off-topic
Hey, I haven't tried many models lately since I'm on vacation and left my PC running with cassum-test-q5_k_m
I really like it, it can be a little incoherent from time to time, messing up some minor roles like ex's, family dynamics, etc... but I love the prose(?) it works very well with my minimal input/responses from my end. It's very steerable, doesn't repeat itself/is less repetitive than most models I've tried recently.
And then I saw it taken down. I have no idea if this model right here (DreadPoor/Strawberry_Smoothie-TEST-Q6_K-GGUF) is newer or not since I forgot when I got the model. But I'm loving it, seriously.
Do you have future plans with the merge configuration from that model? Any reason why it's gone? That's all, thank you.
Hi mate, thanks for the interest.
this here is the recipe for cassum:
models:
- model: PocketDoc/Dans-SakuraKaze-V1.0.0-12b
- model: P0x0/Astra-v1-12B
- model: ohyeah1/Violet-Lyra-Gutenberg-v2
- model: TheDrummer/UnslopNemo-12B-v3
- model: Sicarius-Prototyping/Impish_Longtail_12B
- model: DreadPoor/Ward-12B-Model_Stock
merge_method: model_stock
base_model: DreadPoor/Ward-12B-Model_Stock
normalize: true
int8_mask: true
dtype: bfloat16
note, it was labelled as "test", that is how i mark "transient" (non-permanent) models. my compute is weak, so testing is slow, and not too extensive.
If i dont like the model, or feel it can be better, or if its outright broken somehow, i delete them. If i feel they are of "passing grade", they get renamed, "graduating" out of being just a "test".
i did delete cassum for this reason, but i can remake it for you, it will be up before long.
i am reworking its recipe, trying to make a better merge, which will also be up soon.
have a nice day/night. Happy new year!
correction:
it might take a while.
That's awesome, thanks!
Will it have the same or a different name?
And a happy new year to you as well. : )
oi mate, its up here:
https://huggingface.co/DreadPoor/Cassum-TEST
you can make a GGUF of your choice with this: