Inference hanging on this model aswell
#1
by Bit101 - opened
Hello again, I downloaded this model to pair with impish and I've found that it suffers from the same hanging issue but thankfully seems to have been fixed by the same patch. https://huggingface.co/DeathGodlike/Impish-Bloodmoon-12B_EXL3/discussions/1#69cbabe2ed64eddc75017d41
Just thought it would be prudent to let you know
Hello!
Thank you for the information, I appreciate it.
Will update the configuration files within a day.
Had no internet for the entire day. Fix uploaded.