Concedo's Beepo partial model card
Beepo-22B
This is a finetune done on top of https://huggingface.co/mistralai/Mistral-Small-Instruct-2409 making it less censored in general, while attempting to maintain excellent instruct capabilities.
Key Features:
Retains Intelligence - LR was kept low and dataset heavily pruned to avoid losing too much of the original model's intelligence.
Instruct prompt format supports Alpaca - Honestly, I don't know why more models don't use it. If you are an Alpaca format lover like me, this should help. The original Mistral instruct format can still be used, but is not recommended.
Instruct Decensoring Applied - You should not need a jailbreak for a model to obey the user. The model should always do what you tell it to. No need for weird "Sure, I will" or kitten-murdering-threat tricks. No abliteration was done, only finetuning. This model is not evil. It does not judge or moralize. Like a good tool, it simply obeys.
Prompt template: Alpaca
Instruction:
{prompt}
Response:
(there are three # followed by a space before the Instruction and Response words, they doesn't appear here due to formatting)