Num KV heads changed from 16 to 8?
#21
by keremturgutlu - opened
This is a breaking change!
Can you please provide more info about it and also host the previous model weights before this change. We have multiple finetuned models which are now not compatible.
Thanks,
Kerem - Answer.AI
You can get the old files in the git history.
For those asking about API access — I've been using Crazyrouter as a unified gateway. One API key, OpenAI SDK compatible. Works well for testing different models without managing multiple accounts.