Stopping Execution
#5
by clackingjack - opened
Not sure what is going on but, once I hit past 40k context size, running Q6 quant, with the recommended inference settings, it just stops doing things.
"Now let me do xyz"
Doesn't actually do anything, I have to prompt it to keep going.
i notice this issue too it starts responding and stops midway at longer context lenghts
same for me