NoobQ: Can this run split over 2x 24GB cards?

#11
by BingoBird - opened

Can this run split over 2x 24GB cards?

Sorry for noob question but the outputs look very quant-sensitive, would prefer q8 at least.

Ofcourse. I am running dev q8_0 + distillation lora with double sampler on a 16GB vram + 32GB dram system.

Sign up or log in to comment