Use matryoshka_dimensions to control the allowed output dimensions.
#13
by noooop9527 - opened
No description provided.
Once https://github.com/vllm-project/vllm/pull/16970 merged, matryoshka_dimensions will take effect.
Gotcha. Thanks!
pxyu changed pull request status to merged