ContextualAI
/

ctxl-rerank-v2-instruct-multilingual-6b-fp8

text-generation

text-embeddings-inference

compressed-tensors

Model card Files Files and versions

ctxl-rerank-v2-instruct-multilingual-6b-fp8 / generation_config.json

sheshansh-ctx's picture

Upload FP8 weights + bf16 README

7e187e2 verified about 1 month ago

history blame contribute delete

111 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 1,
	"eos_token_id": 2,
	"transformers_version": "4.56.2"
	}