How to use medimed/quantized_model_W8A8l with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("medimed/quantized_model_W8A8l", dtype="auto")
