GJ, overall pretty nice, occasionally infinite repetition, my goto model now after some sampler adjustment
#2
by imoc - opened
And I stumbled upon this:
https://www.reddit.com/r/LocalLLaMA/comments/1ap8mxh/what_causes_llms_to_fall_into_repetitions_while/
https://github.com/valine/NeuralFlow
Looks interesting, what do you think think think?
imoc changed discussion title from GJ, overall pretty nice, occasionally infinite repetition to GJ, overall pretty nice, occasionally infinite repetition, my goto model now after some sampler adjustment
Hi, would you mind sharing your prompt, sampling params and the quant version you are using?