First noticed while using SillyTavern, confirmed using Oobabooga.
Prompt format (similar response no matter what I used):
Please advise on the correct prompt format if any. thanks :)
Try turning off this setting in the Parameters tab:
This worked. Thanks for the work you do in bringing us exl2 quants!
· Sign up or log in to comment