README.md exists but content is empty.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported72.537
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported35.096
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported66.391
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported68.465
- ap on MTEB AmazonPolarityClassificationtest set self-reported63.195
- f1 on MTEB AmazonPolarityClassificationtest set self-reported68.143
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported36.722
- f1 on MTEB AmazonReviewsClassification (en)test set self-reported36.082
- map_at_1 on MTEB ArguAnatest set self-reported17.994
- map_at_10 on MTEB ArguAnatest set self-reported29.559
- map_at_100 on MTEB ArguAnatest set self-reported30.679
- map_at_1000 on MTEB ArguAnatest set self-reported30.730
- map_at_3 on MTEB ArguAnatest set self-reported25.320
- map_at_5 on MTEB ArguAnatest set self-reported27.710
- mrr_at_1 on MTEB ArguAnatest set self-reported18.421
- mrr_at_10 on MTEB ArguAnatest set self-reported29.730
- mrr_at_100 on MTEB ArguAnatest set self-reported30.850
- mrr_at_1000 on MTEB ArguAnatest set self-reported30.901
- mrr_at_3 on MTEB ArguAnatest set self-reported25.450
- mrr_at_5 on MTEB ArguAnatest set self-reported27.883