Issue with LMStudio

#1
by Stilgar - opened

Hello,

With latest LMStudio 0.3.28 (build2) I can only run one request,
When I start the second prompt I get :

Failed to send message
Error rendering prompt with jinja template: "Cannot apply filter "length" to type: UndefinedValue".

This is usually an issue with the model's prompt template. If you are using a popular model, you can try to search the model under lmstudio-community, which will have fixed prompt templates. If you cannot find one, you are welcome to post this issue to our discord or issue tracker on GitHub. Alternatively, if you know how to write jinja templates, you can override the prompt template in My Models > model settings > Prompt Template.

I also notice some chinese characters time to time on the answer.

I'm using this quant : ServiceNow-AI_Apriel-1.5-15b-Thinker-Q8_0.gguf

I'll have to look into this, may need to adjust the chat template

Sign up or log in to comment