Lora Training
#3
by screamlouder - opened
For lora training, should I use the bf16 or fp8 version?
The loras trained on the klein-9b base works on this model. However, the issue is that it doesn't provide the full strength image changes to this model.
For lora training, should I use the bf16 or fp8 version?
The loras trained on the klein-9b base works on this model. However, the issue is that it doesn't provide the full strength image changes to this model.
Both of bf16 or fp8 should be work, it depending on which one your trainer supports.
Yes, The loras trained on the klein-9b base works on this model, but the weight of lora should be try yourself, The LoRA sensitivity of this model is still pretty good.