BnB Deprecation warning
#2
by Sciumo - opened
The load_in_4bit and load_in_8bit arguments are deprecated and will be removed in the future versions. Please, pass a BitsAndBytesConfig object in quantization_config argument instead.
The code example has been updated to using BitsAndBytesConfig. Thanks!
yifeihu changed discussion status to closed