sarel commited on
Commit
c6b88ea
·
verified ·
1 Parent(s): de0ec4d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -18,7 +18,7 @@ pipeline_tag: text-generation
18
 
19
  # 🛡️ HEBATRON: Hebrew-Specialized Mamba2-MoE
20
 
21
- HEBATRON is a state-of-the-art, high-performance language model specialized for the Hebrew language. Developed through a collaboration between **PwC Israel** and **MAFAT**, it introduces a unique hybrid architecture combining **Mamba2** and **Mixture-of-Experts (MoE)**.
22
 
23
  ## 🚀 Model Summary
24
  HEBATRON is designed to handle the structural and morphological complexities of Hebrew while providing linear scaling for long-context tasks. It is a localized and enhanced version of the **Nemotron-3-Nano-30B** framework, optimized for native-level reasoning in Hebrew and English.
@@ -79,4 +79,5 @@ The model was trained using a three-phase **Curriculum Learning** strategy:
79
  * **PwC Israel Team:** Noam Kayzer, Dan Revital, Ori Bar Joseph, Smadar Arbatz, Or Levi, Kate Zinkovskaia, Omer Baruch (PwC Next)
80
  * **MAFAT Team:** Noam Ordan
81
  * **Partners:** Amir Nissan Hacohen (Origin.ai)
82
- * **Research Collaborators:** Shaltiel Shmidman (Dicta)
 
 
18
 
19
  # 🛡️ HEBATRON: Hebrew-Specialized Mamba2-MoE
20
 
21
+ HEBATRON is a state-of-the-art, high-performance language model specialized for the Hebrew language. Developed through a collaboration between **PwC Israel** and **MAFAT** and **AWS**, it introduces a unique hybrid architecture combining **Mamba2** and **Mixture-of-Experts (MoE)**.
22
 
23
  ## 🚀 Model Summary
24
  HEBATRON is designed to handle the structural and morphological complexities of Hebrew while providing linear scaling for long-context tasks. It is a localized and enhanced version of the **Nemotron-3-Nano-30B** framework, optimized for native-level reasoning in Hebrew and English.
 
79
  * **PwC Israel Team:** Noam Kayzer, Dan Revital, Ori Bar Joseph, Smadar Arbatz, Or Levi, Kate Zinkovskaia, Omer Baruch (PwC Next)
80
  * **MAFAT Team:** Noam Ordan
81
  * **Partners:** Amir Nissan Hacohen (Origin.ai)
82
+ * **Research Collaborators:** Shaltiel Shmidman (Dicta)
83
+ **AWS Infrastructure Support:** Ilouz Netanel