FP8?

#1
by Dainzh - opened

Are there any plans on making an fp8 file?

Are there any plans on making an fp8 file?

smthem has a q6 gguf and is quanting a Q8 right now.

wait for the new Q6 hes quanting though if you get that one, its got tiling issues when i tested it. he said hes making a new one right now. should be up shortly.

model:
https://huggingface.co/smthem/HiDream-O1-Image-Dev/tree/main

youll need my nodes to run it though, there arent any out right now.

nodes:
https://github.com/RealRebelAI/Rebels_HiDream-01_Image_Dev_NODES/tree/main

follow the instructions ENTIRELY lol

Sign up or log in to comment