Update README.md
Browse files
README.md
CHANGED
|
@@ -8,6 +8,8 @@ pipeline_tag: text-generation
|
|
| 8 |
|
| 9 |
This model is a mixed int4 model with group_size 128 and symmetric quantization of [stepfun-ai/Step-3.5-Flash](https://huggingface.co/stepfun-ai/Step-3.5-Flash) generated by [intel/auto-round](https://github.com/intel/auto-round). Please follow the license of the original model.
|
| 10 |
|
|
|
|
|
|
|
| 11 |
## How To Use
|
| 12 |
|
| 13 |
### INT4 Inference
|
|
|
|
| 8 |
|
| 9 |
This model is a mixed int4 model with group_size 128 and symmetric quantization of [stepfun-ai/Step-3.5-Flash](https://huggingface.co/stepfun-ai/Step-3.5-Flash) generated by [intel/auto-round](https://github.com/intel/auto-round). Please follow the license of the original model.
|
| 10 |
|
| 11 |
+
**The model is prone to generating unexpected outputs in some scenarios. Please use it with caution while we investigate the root cause.**
|
| 12 |
+
|
| 13 |
## How To Use
|
| 14 |
|
| 15 |
### INT4 Inference
|