README.md exists but content is empty.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported75.925
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported39.096
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported69.943
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported67.670
- ap on MTEB AmazonPolarityClassificationtest set self-reported62.333
- f1 on MTEB AmazonPolarityClassificationtest set self-reported67.578
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported32.982
- f1 on MTEB AmazonReviewsClassification (en)test set self-reported32.427
- map_at_1 on MTEB ArguAnatest set self-reported19.132
- map_at_10 on MTEB ArguAnatest set self-reported32.364
- map_at_100 on MTEB ArguAnatest set self-reported33.591
- map_at_1000 on MTEB ArguAnatest set self-reported33.620
- map_at_3 on MTEB ArguAnatest set self-reported27.608
- map_at_5 on MTEB ArguAnatest set self-reported30.399
- mrr_at_1 on MTEB ArguAnatest set self-reported19.417
- mrr_at_10 on MTEB ArguAnatest set self-reported32.468
- mrr_at_100 on MTEB ArguAnatest set self-reported33.702
- mrr_at_1000 on MTEB ArguAnatest set self-reported33.731
- mrr_at_3 on MTEB ArguAnatest set self-reported27.703
- mrr_at_5 on MTEB ArguAnatest set self-reported30.526