Error with transformers library

#16

by ewinge - opened Mar 13

Mar 13

I try to use this model with HuggingFacePipeline from LangChain:

from langchain_huggingface import HuggingFacePipeline
llm = HuggingFacePipeline.from_model_id(
    model_id='mistralai/Ministral-3-8B-Instruct-2512',
    task='text-generation',
    device=device,
)

I get this error message:
ValueError: Unrecognized configuration class <class 'transformers.models.mistral3.configuration_mistral3.Mistral3Config'> for this kind of AutoModel: AutoModelForCausalLM.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment