Token Classification
MLX
openmed
openai_privacy_filter
apple-silicon
pii
de-identification
privacy-filter
multilingual
privacy-filter-multilingual-mlx-8bit / tokenizer_config.json
MaziyarPanahi's picture
Initial publish of OpenMed/privacy-filter-multilingual-mlx-8bit. MLX 8BIT export of OpenMed/privacy-filter-multilingual produced via the OpenMed export pipeline. See the base PyTorch repo for training details.
7712c3a verified
raw
history blame contribute delete
255 Bytes
{
"backend": "tokenizers",
"eos_token": "<|endoftext|>",
"is_local": false,
"model_input_names": [
"input_ids",
"attention_mask"
],
"model_max_length": 128000,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend"
}