Hugging Face's logo

Yhyu13
/
LMCocktail-10.7B-v1

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Model card Files
xet
 Community
3

Quant pls

#1
by Yhyu13 - opened
Discussion
Yhyu13
 Owner

@LoneStriker @TheBloke

Hi, folks.

I tried a new llm merging technique backed by a paper called lm cocktail. Here is the result model I get from merging #1 and #2 on the current open llm leaderboard.

The test result looks promising. Would you like to quant this one?

Thanks!
LoneStriker

I'll add it to the queue.
LoneStriker

Quants here: https://huggingface.co/LoneStriker?sort_models=created&search_models=lmcocktail#models
Yhyu13
 Owner

Quants here: https://huggingface.co/LoneStriker?sort_models=created&search_models=lmcocktail#models

Thanks!
TheBloke

Sorry, didn't see this. For future, if I don't respond could you put it on my Discord #model-requests channel?

Doing it now

Yhyu13 changed discussion status to closed

Sign up or log in to comment