README.md exists but content is empty.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported66.433
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported30.297
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported60.965
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported65.516
- ap on MTEB AmazonPolarityClassificationtest set self-reported60.636
- f1 on MTEB AmazonPolarityClassificationtest set self-reported65.228
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported33.018
- f1 on MTEB AmazonReviewsClassification (en)test set self-reported32.566
- map_at_1 on MTEB ArguAnatest set self-reported20.768
- map_at_10 on MTEB ArguAnatest set self-reported33.792
- map_at_100 on MTEB ArguAnatest set self-reported34.961
- map_at_1000 on MTEB ArguAnatest set self-reported35.001
- map_at_3 on MTEB ArguAnatest set self-reported29.943
- map_at_5 on MTEB ArguAnatest set self-reported31.942
- mrr_at_1 on MTEB ArguAnatest set self-reported21.124
- mrr_at_10 on MTEB ArguAnatest set self-reported33.954
- mrr_at_100 on MTEB ArguAnatest set self-reported35.124
- mrr_at_1000 on MTEB ArguAnatest set self-reported35.164
- mrr_at_3 on MTEB ArguAnatest set self-reported30.133
- mrr_at_5 on MTEB ArguAnatest set self-reported32.082