rasyosef commited on
Commit
773568a
·
verified ·
1 Parent(s): 08be6c0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -15
README.md CHANGED
@@ -16,18 +16,27 @@ tags:
16
  - dataset_size:118938
17
  - loss:Contrastive
18
  model-index:
19
- - name: PyLate model based on rasyosef/roberta-medium-amharic
20
  results:
21
  - task:
22
- type: col-berttriplet
23
- name: Col BERTTriplet
24
  dataset:
25
  name: Amharic Passage Retrieval Dataset V2
26
  type: rasyosef/Amharic-Passage-Retrieval-Dataset-V2
27
  metrics:
28
- - type: accuracy
29
- value: 0.9816875457763672
30
- name: Accuracy
 
 
 
 
 
 
 
 
 
31
  ---
32
 
33
  # ColBERT-Amharic-Medium
@@ -192,15 +201,12 @@ reranked_documents = rank.rerank(
192
 
193
  ## Evaluation
194
 
195
- ### Metrics
196
-
197
- #### Col BERTTriplet
198
-
199
- * Evaluated with `pylate.evaluation.colbert_triplet.ColBERTTripletEvaluator`
200
-
201
- | Metric | Value |
202
- |:-------------|:-----------|
203
- | **accuracy** | **0.9817** |
204
 
205
  ## Training Details
206
 
 
16
  - dataset_size:118938
17
  - loss:Contrastive
18
  model-index:
19
+ - name: ColBERT-Amharic-Medium
20
  results:
21
  - task:
22
+ type: information-retrieval
23
+ name: Information Retrieval
24
  dataset:
25
  name: Amharic Passage Retrieval Dataset V2
26
  type: rasyosef/Amharic-Passage-Retrieval-Dataset-V2
27
  metrics:
28
+ - type: cosine_recall@5
29
+ value: 0.882
30
+ name: Cosine Recall@5
31
+ - type: cosine_recall@10
32
+ value: 0.913
33
+ name: Cosine Recall@10
34
+ - type: cosine_ndcg@10
35
+ value: 0.811
36
+ name: Cosine Ndcg@10
37
+ - type: cosine_mrr@10
38
+ value: 0.778
39
+ name: Cosine Mrr@10
40
  ---
41
 
42
  # ColBERT-Amharic-Medium
 
201
 
202
  ## Evaluation
203
 
204
+ | Metric | Value |
205
+ |:--------------------|:-----------|
206
+ | cosine_recall@5 | 0.882 |
207
+ | cosine_recall@10 | 0.913 |
208
+ | **cosine_ndcg@10** | **0.811** |
209
+ | cosine_mrr@10 | 0.778 |
 
 
 
210
 
211
  ## Training Details
212