How to use LycheeMem/reranker with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="LycheeMem/reranker")
# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("LycheeMem/reranker") model = AutoModelForSequenceClassification.from_pretrained("LycheeMem/reranker")
221f262
1
2
3
4
5
6
7
8
{ "cls_token": "[CLS]", "mask_token": "[MASK]", "pad_token": "[PAD]", "sep_token": "[SEP]", "unk_token": "[UNK]" }
