README.md exists but content is empty.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported71.716
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported33.831
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported65.423
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported64.614
- ap on MTEB AmazonPolarityClassificationtest set self-reported59.730
- f1 on MTEB AmazonPolarityClassificationtest set self-reported64.388
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported33.842
- f1 on MTEB AmazonReviewsClassification (en)test set self-reported33.397
- map_at_1 on MTEB ArguAnatest set self-reported19.986
- map_at_10 on MTEB ArguAnatest set self-reported34.064
- map_at_100 on MTEB ArguAnatest set self-reported35.275
- map_at_1000 on MTEB ArguAnatest set self-reported35.303
- map_at_3 on MTEB ArguAnatest set self-reported29.611
- map_at_5 on MTEB ArguAnatest set self-reported32.104
- mrr_at_1 on MTEB ArguAnatest set self-reported20.413
- mrr_at_10 on MTEB ArguAnatest set self-reported34.205
- mrr_at_100 on MTEB ArguAnatest set self-reported35.429
- mrr_at_1000 on MTEB ArguAnatest set self-reported35.457
- mrr_at_3 on MTEB ArguAnatest set self-reported29.813
- mrr_at_5 on MTEB ArguAnatest set self-reported32.245