Finetuned Reranker

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,448 @@
+---
+tags:
+- sentence-transformers
+- cross-encoder
+- reranker
+- generated_from_trainer
+- dataset_size:443
+- loss:BinaryCrossEntropyLoss
+base_model: BAAI/bge-reranker-v2-m3
+pipeline_tag: text-ranking
+library_name: sentence-transformers
+metrics:
+- map
+- mrr@10
+- ndcg@10
+- accuracy
+- accuracy_threshold
+- f1
+- f1_threshold
+- precision
+- recall
+- average_precision
+model-index:
+- name: CrossEncoder based on BAAI/bge-reranker-v2-m3
+  results:
+  - task:
+      type: cross-encoder-reranking
+      name: Cross Encoder Reranking
+    dataset:
+      name: gooaq dev
+      type: gooaq-dev
+    metrics:
+    - type: map
+      value: 0.6246
+      name: Map
+    - type: mrr@10
+      value: 0.6246
+      name: Mrr@10
+    - type: ndcg@10
+      value: 0.7177
+      name: Ndcg@10
+  - task:
+      type: cross-encoder-classification
+      name: Cross Encoder Classification
+    dataset:
+      name: cls dev
+      type: cls-dev
+    metrics:
+    - type: accuracy
+      value: 0.9523809523809523
+      name: Accuracy
+    - type: accuracy_threshold
+      value: 6.58235585433431e-05
+      name: Accuracy Threshold
+    - type: f1
+      value: 0.975609756097561
+      name: F1
+    - type: f1_threshold
+      value: 6.58235585433431e-05
+      name: F1 Threshold
+    - type: precision
+      value: 1.0
+      name: Precision
+    - type: recall
+      value: 0.9523809523809523
+      name: Recall
+    - type: average_precision
+      value: 1.0000000000000002
+      name: Average Precision
+---
+
+# CrossEncoder based on BAAI/bge-reranker-v2-m3
+
+This is a [Cross Encoder](https://www.sbert.net/docs/cross_encoder/usage/usage.html) model finetuned from [BAAI/bge-reranker-v2-m3](https://huggingface.co/BAAI/bge-reranker-v2-m3) using the [sentence-transformers](https://www.SBERT.net) library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Cross Encoder
+- **Base model:** [BAAI/bge-reranker-v2-m3](https://huggingface.co/BAAI/bge-reranker-v2-m3) <!-- at revision 953dc6f6f85a1b2dbfca4c34a2796e7dde08d41e -->
+- **Maximum Sequence Length:** 512 tokens
+- **Number of Output Labels:** 1 label
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Documentation:** [Cross Encoder Documentation](https://www.sbert.net/docs/cross_encoder/usage/usage.html)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Cross Encoders on Hugging Face](https://huggingface.co/models?library=sentence-transformers&other=cross-encoder)
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import CrossEncoder
+
+# Download from the 🤗 Hub
+model = CrossEncoder("cross_encoder_model_id")
+# Get scores for pairs of texts
+pairs = [
+    ['What does dolus refer to?', 'According to the provision of Article 386 paragraph 1 of the Greek Penal Code,\n\n"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."\n\nFrom this provision, it follows that, for the crime of fraud to be established, the following elements are required:\n\na) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit, without requiring that the benefit actually materialize;\n\nb) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone is deceived and performs an act, omission, or acquiescence; and\n\nc) Damage to another’s property, according to civil law, which must be causally connected to the perpetrator’s deceptive acts or omissions. It is not required that the deceived person and the person who suffered the loss be the same.\n\nThe term “facts,” within the meaning of the above provision, refers to real circumstances relating to the past or present, and not to those that will occur in the future, such as mere promises or contractual obligations. However, when such promises or obligations are accompanied by false assurances and representations of other false facts relating to the present or the past, in such a way as to create the impression of future fulfillment, based on a false present situation fabricated by the perpetrator—who has already made the decision not to fulfill their obligation—then the crime of fraud is established.\n\nThe term “property” denotes the totality of a person’s economic assets possessing monetary value, while damage to property refers to its reduction—specifically, the difference between the property’s monetary value before the disposition caused by the fraudulent conduct and its value afterward. Property damage exists even if the victim has an active claim for its restitution.\n\nThe time of commission of fraud is considered to be the moment when the perpetrator acted and completed the deceptive conduct, that is, when they made the false representations which deceived the victim or a third party. Any later time at which the victim’s financial loss occurred—thus completing the fraud—or the time when the harmful act or omission of the deceived person took place, is irrelevant.\n\nThe reference to multiple modes of commission of fraud (i.e., both the misrepresentation of false facts and the concealment of true ones) may create ambiguity and contradiction, unless it is made clear from the overall findings that the offense was committed in one particular manner, and that the reference to the other merely serves to define the intent (mens rea) of the perpetrator—specifically, that the representations were false.\n\nFurthermore, a conviction must contain the specific and well-reasoned justification required by Articles 93 paragraph 3 of the Constitution and 139 of the Code of Criminal Procedure. The absence of such reasoning constitutes grounds for cassation (appeal) under Article 510 paragraph 1(d) of the Code of Criminal Procedure, when the judgment does not set out, with clarity, completeness, and consistency, the factual circumstances established by the evidence, upon which the court based its findings regarding the objective and subjective elements of the offense, the evidence supporting those findings, and the legal reasoning through which those facts were subsumed under the applicable substantive criminal provision.\n\nFor the existence of such reasoning, the explanatory and operative parts of the decision may complement each other, as they form a single, unified whole.\n\nThe existence of intent (dolus) does not generally need to be specially justified, since it is inherent in the will to bring about the factual circumstances constituting the objective elements of the offense, and it is presumed from their realization in each particular case—unless the law requires additional elements for criminal liability, such as the act being committed with knowledge of a specific circumstance (direct intent) or with the pursuit of a further purpose, i.e., the achievement of an additional result (offenses requiring a special subjective element).\n\nFurthermore, under Article 510 paragraph 1(e) of the Code of Criminal Procedure, a misapplication of substantive criminal law also constitutes grounds for cassation. Such misapplication occurs when the trial court incorrectly applies the law to the facts it has found to be true, or when the violation occurs indirectly, namely when the reasoning of the judgment—comprising the combination of its factual and operative parts and relating to the elements and identity of the offense—contains ambiguities, contradictions, or logical gaps, rendering it impossible to verify, on appeal, whether the law was applied correctly. In such cases, the judgment lacks a lawful basis.'],
+    ['What does dolus refer to?', 'According to Article 386 paragraph 1 of the Greek Penal Code,\n\n"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."\n\nFrom these provisions, it follows that, for the crime of fraud to be established, the following elements are required:\n\na) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit;\n\nb) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone is deceived and proceeds to an act, omission, or acquiescence detrimental to themselves or another; and\n\nc) Damage to another’s property, as defined under civil law, which must be causally connected to the perpetrator’s deceptive acts.\n\nFrom the above provisions, it is deduced that the crime of fraud is established both objectively and subjectively through the knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true ones, by which another person is deceived and, as a result, performs an act, omission, or acquiescence involving a disposition of property that directly and necessarily causes financial damage to the deceived person or another, with the intent that the perpetrator or another gain an unlawful benefit. It is irrelevant whether this intended benefit was ultimately achieved.\n\nThe term “facts,” within the meaning of the above provision, refers to real circumstances relating to the past or present, and not to those expected to occur in the future, such as mere promises or contractual obligations. The false fact must have existed in the past or must be a present circumstance at the time it is asserted, and cannot relate to the future.\n\nHowever, when future circumstances—that is, promises or contractual obligations—are accompanied by false assurances and representations of other false facts referring to the present or past, in such a way as to create the impression of future fulfillment, based on a false present situation or supposed ability of the perpetrator, who had already made the decision not to fulfill their obligation, then the crime of fraud is established.'],
+    ['What does dolus refer to?', 'According to the provision of Article 386 paragraph 1 of the Greek Penal Code,\n\n"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."\n\nFrom this provision it follows that, for the crime of fraud to be established, the following elements are required:\n\na) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit, without it being necessary that the benefit actually materialize;\n\nb) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone is deceived and proceeds to an act, omission, or acquiescence that is detrimental to themselves or another; and\n\nc) Damage to another person’s property, as defined under civil law, which must be causally linked to the deceptive acts or omissions of the perpetrator. It is not required that the person deceived and the person who suffered the damage be the same individual.\n\nThe term “facts”, within the meaning of the above provision, refers to real circumstances relating to the past or present, and not to those that will occur in the future, such as mere promises or contractual obligations. However, when such promises or obligations are accompanied by false assurances and representations of other false facts referring to the present or the past, in such a manner as to create the impression of future fulfillment based on a false present situation fabricated by the perpetrator, who has already formed the decision not to fulfill their obligation, the crime of fraud is established.\n\nThe term “property” refers to the totality of a person’s economic assets that possess monetary value, while damage to property means its reduction—specifically, the difference between the monetary value the property had before the disposition caused by the fraudulent conduct and the value remaining after it. Property damage exists even if the victim possesses an active claim for restitution.\n\nThe time of commission of the fraud is considered to be the moment when the perpetrator acted and completed their fraudulent conduct, namely when they made the false representations that deceived the victim or a third party. Any subsequent moment at which the victim’s damage actually occurred—thereby completing the fraud—or the time when the victim carried out the harmful act or omission, is irrelevant.'],
+    ['What does dolus refer to?', 'According to Article 386 paragraph 1 of the Greek Penal Code, the crime of fraud is established both objectively and subjectively when a person knowingly presents false facts as true, or unlawfully conceals or suppresses true facts, thereby deceiving another person who, as a result of this deception, performs an act, omission, or acquiescence that involves a disposition of property, which directly and necessarily causes financial harm to the deceived person or another, with the intent of obtaining an unlawful benefit for themselves or another. It is irrelevant whether or not this intended benefit was actually achieved.\n\nFurthermore, within the meaning of the law, “facts” also include those referring to future events and promises, when they are accompanied by false assurances and representations of other false facts relating to the past or present, in such a manner as to create the impression of future fulfillment, based on the false situation presented by the perpetrator, who has already made the decision not to fulfill their obligation.'],
+    ['What does dolus refer to?', 'According to the provision of Article 386 paragraph 1 of the Greek Penal Code,\n\n"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another person’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."\n\nFrom this provision, it follows that for the crime of fraud to be established, the following elements are required:\n\na) Intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit, regardless of whether this benefit was actually realized;\n\nb) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which, as a causal factor, someone is deceived and acts in a way that is detrimental to themselves or another (by an act, omission, or acquiescence); and\n\nc) Damage to another’s property, in the sense recognized by civil law, which must be causally linked to the fraudulent conduct (the deceptive act or omission of the perpetrator) and to the resulting deception of the person who made the property disposition. It is not required that the person deceived be the same person who suffered the damage.\n\nProperty damage exists when there is a reduction or deterioration in the victim’s assets, even if the victim has an active claim to restitution. However, as an element of the objective aspect of the crime of fraud, the damage must be the direct, necessary, and exclusive result of the property disposition—namely, the act, omission, or acquiescence performed by the person deceived by the perpetrator’s fraudulent conduct.\n\nThere must therefore be a causal connection between the perpetrator’s deceptive behavior and the deception it caused, as well as between this deception and the resulting property damage, which must be the direct, necessary, and exclusive outcome of the deception and of the act, omission, or acquiescence of the deceived person.\n\nThe term “facts” refers to real circumstances relating to the past or present, and not to those expected to occur in the future, such as mere promises or contractual obligations. However, when such promises or obligations are accompanied by false assurances and representations of other false facts relating to the present or the past, in such a way as to create the impression of future fulfillment, based on the false present situation presented by a perpetrator who has already made the decision not to fulfill their obligation, then the crime of fraud is established.\n\nThe time of commission of the fraud is considered to be the moment when the perpetrator acted and completed their deceptive conduct—that is, when they made the false representations that deceived the victim or a third party. Any later time at which the victim’s financial loss actually occurred—thus completing the fraud—or the time when the deceived person performed the harmful act or omission, is irrelevant.'],
+]
+scores = model.predict(pairs)
+print(scores.shape)
+# (5,)
+
+# Or rank different texts based on similarity to a single text
+ranks = model.rank(
+    'What does dolus refer to?',
+    [
+        'According to the provision of Article 386 paragraph 1 of the Greek Penal Code,\n\n"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."\n\nFrom this provision, it follows that, for the crime of fraud to be established, the following elements are required:\n\na) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit, without requiring that the benefit actually materialize;\n\nb) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone is deceived and performs an act, omission, or acquiescence; and\n\nc) Damage to another’s property, according to civil law, which must be causally connected to the perpetrator’s deceptive acts or omissions. It is not required that the deceived person and the person who suffered the loss be the same.\n\nThe term “facts,” within the meaning of the above provision, refers to real circumstances relating to the past or present, and not to those that will occur in the future, such as mere promises or contractual obligations. However, when such promises or obligations are accompanied by false assurances and representations of other false facts relating to the present or the past, in such a way as to create the impression of future fulfillment, based on a false present situation fabricated by the perpetrator—who has already made the decision not to fulfill their obligation—then the crime of fraud is established.\n\nThe term “property” denotes the totality of a person’s economic assets possessing monetary value, while damage to property refers to its reduction—specifically, the difference between the property’s monetary value before the disposition caused by the fraudulent conduct and its value afterward. Property damage exists even if the victim has an active claim for its restitution.\n\nThe time of commission of fraud is considered to be the moment when the perpetrator acted and completed the deceptive conduct, that is, when they made the false representations which deceived the victim or a third party. Any later time at which the victim’s financial loss occurred—thus completing the fraud—or the time when the harmful act or omission of the deceived person took place, is irrelevant.\n\nThe reference to multiple modes of commission of fraud (i.e., both the misrepresentation of false facts and the concealment of true ones) may create ambiguity and contradiction, unless it is made clear from the overall findings that the offense was committed in one particular manner, and that the reference to the other merely serves to define the intent (mens rea) of the perpetrator—specifically, that the representations were false.\n\nFurthermore, a conviction must contain the specific and well-reasoned justification required by Articles 93 paragraph 3 of the Constitution and 139 of the Code of Criminal Procedure. The absence of such reasoning constitutes grounds for cassation (appeal) under Article 510 paragraph 1(d) of the Code of Criminal Procedure, when the judgment does not set out, with clarity, completeness, and consistency, the factual circumstances established by the evidence, upon which the court based its findings regarding the objective and subjective elements of the offense, the evidence supporting those findings, and the legal reasoning through which those facts were subsumed under the applicable substantive criminal provision.\n\nFor the existence of such reasoning, the explanatory and operative parts of the decision may complement each other, as they form a single, unified whole.\n\nThe existence of intent (dolus) does not generally need to be specially justified, since it is inherent in the will to bring about the factual circumstances constituting the objective elements of the offense, and it is presumed from their realization in each particular case—unless the law requires additional elements for criminal liability, such as the act being committed with knowledge of a specific circumstance (direct intent) or with the pursuit of a further purpose, i.e., the achievement of an additional result (offenses requiring a special subjective element).\n\nFurthermore, under Article 510 paragraph 1(e) of the Code of Criminal Procedure, a misapplication of substantive criminal law also constitutes grounds for cassation. Such misapplication occurs when the trial court incorrectly applies the law to the facts it has found to be true, or when the violation occurs indirectly, namely when the reasoning of the judgment—comprising the combination of its factual and operative parts and relating to the elements and identity of the offense—contains ambiguities, contradictions, or logical gaps, rendering it impossible to verify, on appeal, whether the law was applied correctly. In such cases, the judgment lacks a lawful basis.',
+        'According to Article 386 paragraph 1 of the Greek Penal Code,\n\n"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."\n\nFrom these provisions, it follows that, for the crime of fraud to be established, the following elements are required:\n\na) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit;\n\nb) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone is deceived and proceeds to an act, omission, or acquiescence detrimental to themselves or another; and\n\nc) Damage to another’s property, as defined under civil law, which must be causally connected to the perpetrator’s deceptive acts.\n\nFrom the above provisions, it is deduced that the crime of fraud is established both objectively and subjectively through the knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true ones, by which another person is deceived and, as a result, performs an act, omission, or acquiescence involving a disposition of property that directly and necessarily causes financial damage to the deceived person or another, with the intent that the perpetrator or another gain an unlawful benefit. It is irrelevant whether this intended benefit was ultimately achieved.\n\nThe term “facts,” within the meaning of the above provision, refers to real circumstances relating to the past or present, and not to those expected to occur in the future, such as mere promises or contractual obligations. The false fact must have existed in the past or must be a present circumstance at the time it is asserted, and cannot relate to the future.\n\nHowever, when future circumstances—that is, promises or contractual obligations—are accompanied by false assurances and representations of other false facts referring to the present or past, in such a way as to create the impression of future fulfillment, based on a false present situation or supposed ability of the perpetrator, who had already made the decision not to fulfill their obligation, then the crime of fraud is established.',
+        'According to the provision of Article 386 paragraph 1 of the Greek Penal Code,\n\n"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."\n\nFrom this provision it follows that, for the crime of fraud to be established, the following elements are required:\n\na) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit, without it being necessary that the benefit actually materialize;\n\nb) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone is deceived and proceeds to an act, omission, or acquiescence that is detrimental to themselves or another; and\n\nc) Damage to another person’s property, as defined under civil law, which must be causally linked to the deceptive acts or omissions of the perpetrator. It is not required that the person deceived and the person who suffered the damage be the same individual.\n\nThe term “facts”, within the meaning of the above provision, refers to real circumstances relating to the past or present, and not to those that will occur in the future, such as mere promises or contractual obligations. However, when such promises or obligations are accompanied by false assurances and representations of other false facts referring to the present or the past, in such a manner as to create the impression of future fulfillment based on a false present situation fabricated by the perpetrator, who has already formed the decision not to fulfill their obligation, the crime of fraud is established.\n\nThe term “property” refers to the totality of a person’s economic assets that possess monetary value, while damage to property means its reduction—specifically, the difference between the monetary value the property had before the disposition caused by the fraudulent conduct and the value remaining after it. Property damage exists even if the victim possesses an active claim for restitution.\n\nThe time of commission of the fraud is considered to be the moment when the perpetrator acted and completed their fraudulent conduct, namely when they made the false representations that deceived the victim or a third party. Any subsequent moment at which the victim’s damage actually occurred—thereby completing the fraud—or the time when the victim carried out the harmful act or omission, is irrelevant.',
+        'According to Article 386 paragraph 1 of the Greek Penal Code, the crime of fraud is established both objectively and subjectively when a person knowingly presents false facts as true, or unlawfully conceals or suppresses true facts, thereby deceiving another person who, as a result of this deception, performs an act, omission, or acquiescence that involves a disposition of property, which directly and necessarily causes financial harm to the deceived person or another, with the intent of obtaining an unlawful benefit for themselves or another. It is irrelevant whether or not this intended benefit was actually achieved.\n\nFurthermore, within the meaning of the law, “facts” also include those referring to future events and promises, when they are accompanied by false assurances and representations of other false facts relating to the past or present, in such a manner as to create the impression of future fulfillment, based on the false situation presented by the perpetrator, who has already made the decision not to fulfill their obligation.',
+        'According to the provision of Article 386 paragraph 1 of the Greek Penal Code,\n\n"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another person’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."\n\nFrom this provision, it follows that for the crime of fraud to be established, the following elements are required:\n\na) Intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit, regardless of whether this benefit was actually realized;\n\nb) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which, as a causal factor, someone is deceived and acts in a way that is detrimental to themselves or another (by an act, omission, or acquiescence); and\n\nc) Damage to another’s property, in the sense recognized by civil law, which must be causally linked to the fraudulent conduct (the deceptive act or omission of the perpetrator) and to the resulting deception of the person who made the property disposition. It is not required that the person deceived be the same person who suffered the damage.\n\nProperty damage exists when there is a reduction or deterioration in the victim’s assets, even if the victim has an active claim to restitution. However, as an element of the objective aspect of the crime of fraud, the damage must be the direct, necessary, and exclusive result of the property disposition—namely, the act, omission, or acquiescence performed by the person deceived by the perpetrator’s fraudulent conduct.\n\nThere must therefore be a causal connection between the perpetrator’s deceptive behavior and the deception it caused, as well as between this deception and the resulting property damage, which must be the direct, necessary, and exclusive outcome of the deception and of the act, omission, or acquiescence of the deceived person.\n\nThe term “facts” refers to real circumstances relating to the past or present, and not to those expected to occur in the future, such as mere promises or contractual obligations. However, when such promises or obligations are accompanied by false assurances and representations of other false facts relating to the present or the past, in such a way as to create the impression of future fulfillment, based on the false present situation presented by a perpetrator who has already made the decision not to fulfill their obligation, then the crime of fraud is established.\n\nThe time of commission of the fraud is considered to be the moment when the perpetrator acted and completed their deceptive conduct—that is, when they made the false representations that deceived the victim or a third party. Any later time at which the victim’s financial loss actually occurred—thus completing the fraud—or the time when the deceived person performed the harmful act or omission, is irrelevant.',
+    ]
+)
+# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+## Evaluation
+
+### Metrics
+
+#### Cross Encoder Reranking
+
+* Dataset: `gooaq-dev`
+* Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator) with these parameters:
+  ```json
+  {
+      "at_k": 10,
+      "always_rerank_positives": false
+  }
+  ```
+
+| Metric      | Value                |
+|:------------|:---------------------|
+| map         | 0.6246 (-0.0024)     |
+| mrr@10      | 0.6246 (-0.0024)     |
+| **ndcg@10** | **0.7177 (-0.0021)** |
+
+#### Cross Encoder Classification
+
+* Dataset: `cls-dev`
+* Evaluated with [<code>CrossEncoderClassificationEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderClassificationEvaluator)
+
+| Metric                | Value   |
+|:----------------------|:--------|
+| accuracy              | 0.9524  |
+| accuracy_threshold    | 0.0001  |
+| f1                    | 0.9756  |
+| f1_threshold          | 0.0001  |
+| precision             | 1.0     |
+| recall                | 0.9524  |
+| **average_precision** | **1.0** |
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### Unnamed Dataset
+
+* Size: 443 training samples
+* Columns: <code>query</code>, <code>response</code>, and <code>label</code>
+* Approximate statistics based on the first 443 samples:
+  |         | query                                                                                           | response                                                                                            | label                                           |
+  |:--------|:------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------|:------------------------------------------------|
+  | type    | string                                                                                          | string                                                                                              | int                                             |
+  | details | <ul><li>min: 25 characters</li><li>mean: 74.23 characters</li><li>max: 167 characters</li></ul> | <ul><li>min: 294 characters</li><li>mean: 1983.03 characters</li><li>max: 5250 characters</li></ul> | <ul><li>0: ~81.49%</li><li>1: ~18.51%</li></ul> |
+* Samples:
+  | query                                  | response                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         | label          |
+  |:---------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------|
+  | <code>What does dolus refer to?</code> | <code>According to the provision of Article 386 paragraph 1 of the Greek Penal Code,<br><br>"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."<br><br>From this provision, it follows that, for the crime of fraud to be established, the following elements are required:<br><br>a) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit, without requiring that the benefit actually materialize;<br><br>b) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone is dece...</code> | <code>1</code> |
+  | <code>What does dolus refer to?</code> | <code>According to Article 386 paragraph 1 of the Greek Penal Code,<br><br>"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."<br><br>From these provisions, it follows that, for the crime of fraud to be established, the following elements are required:<br><br>a) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit;<br><br>b) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone is deceived and proceeds to an act, omission, or acquiescence detrimental to th...</code> | <code>0</code> |
+  | <code>What does dolus refer to?</code> | <code>According to the provision of Article 386 paragraph 1 of the Greek Penal Code,<br><br>"Whoever, with the intent to obtain for themselves or another an unlawful pecuniary benefit, causes damage to another’s property by persuading someone to act, omit, or tolerate something through the knowing misrepresentation of false facts as true, or through the unlawful concealment or suppression of true facts, shall be punished by imprisonment of at least three months, and if the damage caused is particularly large, by imprisonment of at least two years."<br><br>From this provision it follows that, for the crime of fraud to be established, the following elements are required:<br><br>a) The intent of the perpetrator to obtain for themselves or another an unlawful pecuniary benefit, without it being necessary that the benefit actually materialize;<br><br>b) The knowing misrepresentation of false facts as true, or the unlawful concealment or suppression of true facts, as a result of which—serving as the causal factor—someone...</code> | <code>0</code> |
+* Loss: [<code>BinaryCrossEntropyLoss</code>](https://sbert.net/docs/package_reference/cross_encoder/losses.html#binarycrossentropyloss) with these parameters:
+  ```json
+  {
+      "activation_fn": "torch.nn.modules.linear.Identity",
+      "pos_weight": null
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: steps
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 16
+- `learning_rate`: 2e-05
+- `num_train_epochs`: 20
+- `warmup_ratio`: 0.1
+- `seed`: 12
+- `dataloader_num_workers`: 4
+- `load_best_model_at_end`: True
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: steps
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 16
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 1
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 20
+- `max_steps`: -1
+- `lr_scheduler_type`: linear
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 12
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: False
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 4
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `tp_size`: 0
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: batch_sampler
+- `multi_dataset_batch_sampler`: proportional
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+| Epoch   | Step | Training Loss | gooaq-dev_ndcg@10 | cls-dev_average_precision |
+|:-------:|:----:|:-------------:|:-----------------:|:-------------------------:|
+| -1      | -1   | -             | 0.8520 (+0.1323)  | -                         |
+| 0.0357  | 1    | 0.9641        | -                 | -                         |
+| 0.7143  | 20   | 0.5838        | -                 | -                         |
+| 1.4286  | 40   | 0.3681        | -                 | -                         |
+| 2.1429  | 60   | 0.3216        | -                 | -                         |
+| 2.8571  | 80   | 0.3218        | -                 | -                         |
+| 3.5714  | 100  | 0.2768        | -                 | -                         |
+| 4.2857  | 120  | 0.2571        | -                 | -                         |
+| 5.0     | 140  | 0.2517        | -                 | -                         |
+| 5.7143  | 160  | 0.214         | -                 | -                         |
+| 6.4286  | 180  | 0.1952        | -                 | -                         |
+| 7.1429  | 200  | 0.1884        | -                 | -                         |
+| 7.8571  | 220  | 0.1793        | -                 | -                         |
+| 8.5714  | 240  | 0.1328        | -                 | -                         |
+| 9.2857  | 260  | 0.1964        | -                 | -                         |
+| 10.0    | 280  | 0.1444        | -                 | -                         |
+| 10.7143 | 300  | 0.1408        | -                 | -                         |
+| 11.4286 | 320  | 0.1308        | -                 | -                         |
+| 12.1429 | 340  | 0.1147        | -                 | -                         |
+| 12.8571 | 360  | 0.1495        | -                 | -                         |
+| 13.5714 | 380  | 0.0991        | -                 | -                         |
+| 14.2857 | 400  | 0.168         | -                 | -                         |
+| 15.0    | 420  | 0.0972        | -                 | -                         |
+| 15.7143 | 440  | 0.0859        | -                 | -                         |
+| 16.4286 | 460  | 0.1162        | -                 | -                         |
+| 17.1429 | 480  | 0.0693        | -                 | -                         |
+| 17.8571 | 500  | 0.0836        | -                 | -                         |
+| 18.5714 | 520  | 0.056         | -                 | -                         |
+| 19.2857 | 540  | 0.0727        | -                 | -                         |
+| 20.0    | 560  | 0.0715        | -                 | -                         |
+| -1      | -1   | -             | 0.7177 (-0.0021)  | 1.0000                    |
+
+
+### Framework Versions
+- Python: 3.12.12
+- Sentence Transformers: 5.1.1
+- Transformers: 4.51.3
+- PyTorch: 2.8.0+cu126
+- Accelerate: 1.11.0
+- Datasets: 4.0.0
+- Tokenizers: 0.21.4
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,37 @@
+{
+  "architectures": [
+    "XLMRobertaForSequenceClassification"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "classifier_dropout": null,
+  "eos_token_id": 2,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 1024,
+  "id2label": {
+    "0": "LABEL_0"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 4096,
+  "label2id": {
+    "LABEL_0": 0
+  },
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 8194,
+  "model_type": "xlm-roberta",
+  "num_attention_heads": 16,
+  "num_hidden_layers": 24,
+  "output_past": true,
+  "pad_token_id": 1,
+  "position_embedding_type": "absolute",
+  "sentence_transformers": {
+    "activation_fn": "torch.nn.modules.activation.Sigmoid",
+    "version": "5.1.1"
+  },
+  "torch_dtype": "float32",
+  "transformers_version": "4.51.3",
+  "type_vocab_size": 1,
+  "use_cache": true,
+  "vocab_size": 250002
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce1483c47d31ce657985d4dfe229ef16a1326faa195dc0de24d2c52d60813ac5
+size 2271071852

sentencepiece.bpe.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cfc8146abe2a0488e9e2a0c56de7952f7c11ab059eca145a0a727afce0db2865
+size 5069051

special_tokens_map.json

@@ -0,0 +1,51 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "cls_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "<mask>",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cf44dabfaa82b1276a7af64a2ea2c76c047d560cf7bfb5711d6135382372c93d
+size 17083153

tokenizer_config.json

@@ -0,0 +1,56 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "250001": {
+      "content": "<mask>",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "<s>",
+  "eos_token": "</s>",
+  "extra_special_tokens": {},
+  "mask_token": "<mask>",
+  "model_max_length": 512,
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "XLMRobertaTokenizer",
+  "unk_token": "<unk>"
+}