IQ2_XS variant
#2
by perelmanych - opened
Please add IQ2_XS variant to fit on a single 3090.
perelmanych changed discussion title from IQ2_XS variant to Not working with oobabooga text-generation-webui
perelmanych changed discussion title from Not working with oobabooga text-generation-webui to IQ2_XS variant
Cannot be done - static IQ2_XS is not a supported format. You have to use the imatrix one, which will be generated within the next few hours.
mradermacher changed discussion status to closed