What am I doing wrong? Using Oobabooga.
#1
by Goldenblood56 - opened
Using fairly default setting. Ooba is fully updated. Llama.cpp using 8-bit quant.
Well other prompts are not so bad. Maybe it just responds poorly to hello.
Try this Template and see results:
TEMPLATE """{{ if .System }}
<|im_start|>system {{ .System }}<|im_end|>
{{- end }}
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
SYSTEM """"""
PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>
Thanks I will have to give that a try.
munish0838 changed discussion status to closed