why transformers version 4.47.1 specifically is required?

#12
by bver - opened

Hello,

Could you explain why transformers version 4.47.1 specifically is required? I've tried a newer version (4.57.3), and while the code runs without exceptions, the resulting embedding values differ significantly.

I prefer using AutoModel over other serving methods for your model, but I'd like to use more current dependency versions. I'm curious about the reasoning behind pinning this particular version. (Isn't this PR related? https://huggingface.co/nvidia/llama-nemotron-embed-1b-v2/discussions/3 )

Thank you for your help in advance.
Pavel

HI Pavel, Thanks for raising this question. In a recent change #16 we have made some changes to the implementation to support a broader set of transformers versions. The model now works in transformers 4.44 up to and including 5.0

nvidia-oliver-holworthy changed discussion status to closed

Sign up or log in to comment