FP8?
#1
by Dainzh - opened
Are there any plans on making an fp8 file?
Are there any plans on making an fp8 file?
smthem has a q6 gguf and is quanting a Q8 right now.
wait for the new Q6 hes quanting though if you get that one, its got tiling issues when i tested it. he said hes making a new one right now. should be up shortly.
model:
https://huggingface.co/smthem/HiDream-O1-Image-Dev/tree/main
youll need my nodes to run it though, there arent any out right now.
nodes:
https://github.com/RealRebelAI/Rebels_HiDream-01_Image_Dev_NODES/tree/main
follow the instructions ENTIRELY lol