Add files using upload-large-folder tool

README.md

@@ -1,384 +1,49 @@
 ---
-language:
-- zh
-- en
-pipeline_tag: text-generation
+base_model: []
 library_name: transformers
----
-<div align="center">
-  <picture>
-      <img src="figures/joyai-logo.png" width="30%" alt="JoyAI-LLM Flash">
-  </picture>
-</div>
-<hr>
-
-<div align="center" style="line-height: 1;">
-  <a href="https://huggingface.co/jdopensource" target="_blank"><img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-JD-ffc107?color=ffc107&logoColor=white"/></a>
-  <a href="https://huggingface.co/jdopensource/JoyAI-LLM-Flash/blob/main/LICENSE"><img alt="License" src="https://img.shields.io/badge/License-Modified_MIT-f5de53?&color=f5de53"/></a>
-</div>
-
-<p align="center">
-<b>📰&nbsp;&nbsp;<a href="https://huggingface.co/jdopensource/JoyAI-LLM-Flash/blob/main/JoyAI_Flash_techreport.pdf">Tech Report</a>
-</p>
-
-
-
-## 1. Model Introduction
-
-JoyAI-LLM Flash is a state-of-the-art medium-sized instruct language model with 3 billion activated parameters and 48 billion total parameters. JoyAI-LLM Flash was pretrained on 20 trillion text tokens using Muon optimizer, followed by large-scale supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning (RL) across diverse environments. JoyAI-LLM Flash achieves strong performance across frontier knowledge, reasoning, coding tasks and agentic capabilities.
-
-### Key Features
-
-- Fibration Policy Optimization: Introduces fiber bundle theory into reinforcement learning, proposing a novel optimization framework, FiberPO. This method is specifically designed to handle the challenges of large-scale and heterogeneous agent training, improving stability and robustness under complex data distributions. [paper link](https://arxiv.org/abs/2603.08239)
-- Training-Inference Collaboration: apply Muon optimizer with dense MTP, develop novel optimization techniques to resolve instabilities while scaling up, delivering 1.3× to 1.7× the throughput of the non-MTP version.
-- Agentic Intelligence: designed for tool use, reasoning, and autonomous problem-solving.
-
-## 2. Model Summary
-
-|                                             |                          |
-| :-----------------------------------------: | :----------------------: |
-|              **Architecture**               | Mixture-of-Experts (MoE) |
-|            **Total Parameters**             |           48B            |
-|          **Activated Parameters**           |            3B            |
-| **Number of Layers** (Dense layer included) |            40            |
-|         **Number of Dense Layers**          |            1             |
-|       **Attention Hidden Dimension**        |           2048           |
-|    **MoE Hidden Dimension** (per Expert)    |           768            |
-|        **Number of Attention Heads**        |            32            |
-|            **Number of Experts**            |           256            |
-|       **Selected Experts per Token**        |            8             |
-|        **Number of Shared Experts**         |            1             |
-|             **Vocabulary Size**             |           129K           |
-|             **Context Length**              |           128K           |
-|           **Attention Mechanism**           |           MLA            |
-|           **Activation Function**           |          SwiGLU          |
-|                   </div>                    |                          |
-
-
-## 3. Evaluation Results
-
-<table>
-<thead>
-<tr>
-<th align="center">Benchmark</th>
-<th align="center"><sup>JoyAI-LLM Flash</sup></th>
-<th align="center"><sup>Qwen3-30B-A3B-Instuct-2507</sup></th>
-<th align="center"><sup>GLM-4.7-Flash<br>(Non-thinking)</sup></th>
-</tr>
-</thead>
-<tbody>
-
-
-<tr>
-<td align="center" colspan=8><strong>Knowledge &amp; Alignment</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">MMLU</td>
-<td align="center" style="vertical-align: middle"><strong>89.50</strong></td>
-<td align="center" style="vertical-align: middle">86.87</td>
-<td align="center" style="vertical-align: middle">80.53</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">MMLU-Pro</td>
-<td align="center" style="vertical-align: middle"><strong>81.02</strong></td>
-<td align="center" style="vertical-align: middle">73.88</td>
-<td align="center" style="vertical-align: middle">63.62</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">CMMLU</td>
-<td align="center" style="vertical-align: middle"><strong>87.03</strong></td>
-<td align="center" style="vertical-align: middle">85.88</td>
-<td align="center" style="vertical-align: middle">75.85</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">GPQA-Diamond</td>
-<td align="center" style="vertical-align: middle"><strong>74.43</strong></td>
-<td align="center" style="vertical-align: middle">68.69</td>
-<td align="center" style="vertical-align: middle">39.90</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">SuperGPQA</td>
-<td align="center" style="vertical-align: middle"><strong>55.00</strong></td>
-<td align="center" style="vertical-align: middle">52.00</td>
-<td align="center" style="vertical-align: middle">32.00</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">LiveBench</td>
-<td align="center" style="vertical-align: middle"><strong>72.90</strong></td>
-<td align="center" style="vertical-align: middle">59.70</td>
-<td align="center" style="vertical-align: middle">43.10</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">IFEval</td>
-<td align="center" style="vertical-align: middle"><strong>86.69</strong></td>
-<td align="center" style="vertical-align: middle">83.18</td>
-<td align="center" style="vertical-align: middle">82.44</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">AlignBench</td>
-<td align="center" style="vertical-align: middle"><strong>8.24</strong></td>
-<td align="center" style="vertical-align: middle">8.07</td>
-<td align="center" style="vertical-align: middle">6.85</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">HellaSwag</td>
-<td align="center" style="vertical-align: middle"><strong>91.79</strong></td>
-<td align="center" style="vertical-align: middle">89.90</td>
-<td align="center" style="vertical-align: middle">60.84</td>
-</tr>
-
-<tr>
-<td align="center" colspan=8><strong>Coding</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">HumanEval</td>
-<td align="center" style="vertical-align: middle"><strong>96.34</strong></td>
-<td align="center" style="vertical-align: middle">95.12</td>
-<td align="center" style="vertical-align: middle">74.39</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">LiveCodeBench</td>
-<td align="center" style="vertical-align: middle"><strong>65.60</strong></td>
-<td align="center" style="vertical-align: middle">39.71</td>
-<td align="center" style="vertical-align: middle">27.43</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">SciCode</td>
-<td align="center" style="vertical-align: middle"><strong>3.08/22.92</strong></td>
-<td align="center" style="vertical-align: middle"><strong>3.08/22.92</strong></td>
-<td align="center" style="vertical-align: middle">3.08/15.11</td>
-</tr>
-<tr>
-<td align="center" colspan=8><strong>Mathematics</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">GSM8K</td>
-<td align="center" style="vertical-align: middle"><strong>95.83</strong></td>
-<td align="center" style="vertical-align: middle">79.83</td>
-<td align="center" style="vertical-align: middle">81.88</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">AIME2025</td>
-<td align="center" style="vertical-align: middle"><strong>65.83</strong></td>
-<td align="center" style="vertical-align: middle">62.08</td>
-<td align="center" style="vertical-align: middle">24.17</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">MATH 500</td>
-<td align="center" style="vertical-align: middle"><strong>97.10</strong></td>
-<td align="center" style="vertical-align: middle">89.80</td>
-<td align="center" style="vertical-align: middle">90.90</td>
-</tr>
-
-<tr>
-<td align="center" colspan=8><strong>Agentic</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">SWE-bench Verified</td>
-<td align="center" style="vertical-align: middle"><strong>60.60</strong></td>
-<td align="center" style="vertical-align: middle">24.44</td>
-<td align="center" style="vertical-align: middle">51.60</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">Tau2-Retail</td>
-<td align="center" style="vertical-align: middle"><strong>67.55</strong></td>
-<td align="center" style="vertical-align: middle">53.51</td>
-<td align="center" style="vertical-align: middle">62.28</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">Tau2-Airline</td>
-<td align="center" style="vertical-align: middle"><strong>54.00</strong></td>
-<td align="center" style="vertical-align: middle">32.00</td>
-<td align="center" style="vertical-align: middle">52.00</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">Tau2-Telecom</td>
-<td align="center" style="vertical-align: middle">79.83</td>
-<td align="center" style="vertical-align: middle">4.39</td>
-<td align="center" style="vertical-align: middle"><strong>88.60</strong></td>
-</tr>
-
-<tr>
-<td align="center" colspan=8><strong>Long Context</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">RULER</td>
-<td align="center" style="vertical-align: middle"><strong>95.60</strong></td>
-<td align="center" style="vertical-align: middle">89.66</td>
-<td align="center" style="vertical-align: middle">56.12</td>
-</tr>
-</tbody>
-</table>
-
-
-## 4. Deployment
-
-> [!Note]
-> You can access JoyAI-LLM Flash API on https://docs.jdcloud.com/cn/jdaip/chat and we provide OpenAI/Anthropic-compatible API for you. 
-> Currently, JoyAI-LLM Flash is recommended to run on the following inference engines:
-
-* vLLM
-* SGLang
-
-The minimum version requirement for `transformers` is `4.57.1`.
-
-Deployment examples can be found in the [Model Deployment Guide](docs/deploy_guidance.md).
-
-
-
-## 5. Model Usage
-
-The usage demos below demonstrate how to call our official API.
-
-For third-party APIs deployed with vLLM or SGLang, please note that:
-
-> [!Note] Recommended sampling parameters: `temperature=0.6`, `top_p=1.0`
-
-### Chat Completion
-
-This is a simple chat completion script which shows how to call JoyAI-Flash API.
-
-```python
-from openai import OpenAI
-
-client = OpenAI(base_url="http://IP:PORT/v1", api_key="EMPTY")
-
-
-def simple_chat(client: OpenAI):
-    messages = [
-        {
-            "role": "user",
-            "content": [
-                {
-                    "type": "text",
-                    "text": "which one is bigger, 9.11 or 9.9? think carefully.",
-                }
-            ],
-        },
-    ]
-    model_name = client.models.list().data[0].id
-    response = client.chat.completions.create(
-        model=model_name, messages=messages, stream=False, max_tokens=4096
-    )
-    print(f"response: {response.choices[0].message.content}")
-
-
-if __name__ == "__main__":
-    simple_chat(client)
-```
-
-
-### Tool call Completion
-
-This is a simple toll call completion script which shows how to call JoyAI-Flash API.
-
-```python
-import json
-
-from openai import OpenAI
-
-client = OpenAI(base_url="http://IP:PORT/v1", api_key="EMPTY")
-
-
-def my_calculator(expression: str) -> str:
-    return str(eval(expression))
-
-
-def rewrite(expression: str) -> str:
-    return str(expression)
-
-
-def simple_tool_call(client: OpenAI):
-    messages = [
-        {
-            "role": "user",
-            "content": [
-                {
-                    "type": "text",
-                    "text": "use my functions to compute the results for the equations: 6+1",
-                },
-            ],
-        },
-    ]
-    tools = [
-        {
-            "type": "function",
-            "function": {
-                "name": "my_calculator",
-                "description": "A calculator that can evaluate a mathematical equation and compute its results.",
-                "parameters": {
-                    "type": "object",
-                    "properties": {
-                        "expression": {
-                            "type": "string",
-                            "description": "The mathematical expression to evaluate.",
-                        },
-                    },
-                    "required": ["expression"],
-                },
-            },
-        },
-        {
-            "type": "function",
-            "function": {
-                "name": "rewrite",
-                "description": "Rewrite a given text for improved clarity",
-                "parameters": {
-                    "type": "object",
-                    "properties": {
-                        "text": {
-                            "type": "string",
-                            "description": "The input text to rewrite",
-                        }
-                    },
-                },
-            },
-        },
-    ]
-    model_name = client.models.list().data[0].id
-    response = client.chat.completions.create(
-        model=model_name,
-        messages=messages,
-        temperature=1.0,
-        max_tokens=1024,
-        tools=tools,
-        tool_choice="auto",
-    )
-    tool_calls = response.choices[0].message.tool_calls
-
-    results = []
-    for tool_call in tool_calls:
-        function_name = tool_call.function.name
-        function_args = tool_call.function.arguments
-        if function_name == "my_calculator":
-            result = my_calculator(**json.loads(function_args))
-            results.append(result)
-    messages.append({"role": "assistant", "tool_calls": tool_calls})
-    for tool_call, result in zip(tool_calls, results):
-        messages.append(
-            {
-                "role": "tool",
-                "tool_call_id": tool_call.id,
-                "name": tool_call.function.name,
-                "content": result,
-            }
-        )
-    response = client.chat.completions.create(
-        model=model_name,
-        messages=messages,
-        temperature=1.0,
-        max_tokens=1024,
-    )
-    print(response.choices[0].message.content)
-
-
-if __name__ == "__main__":
-    simple_tool_call(client)
-
-```
+tags:
+- mergekit
+- merge
 
 ---
-
-## 6. License
-
-Both the code repository and the model weights are released under the [Modified MIT License](LICENSE).
+# c362_step50_ta05
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [Linear DARE](https://arxiv.org/abs/2311.03099) merge method using /root/myCodeLab/host/downloads/models/40Bra as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* /root/myCodeLab/host/verl/ckpts/40bra_k8s_single_domain/40bra_k8s_16node_sd_c362_20260327_205644_unknown/global_step_50/actor/huggingface
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+base_model: /root/myCodeLab/host/downloads/models/40Bra
+dtype: float32
+merge_method: dare_linear
+modules:
+  default:
+    slices:
+    - sources:
+      - layer_range: [0, 40]
+        model: /root/myCodeLab/host/downloads/models/40Bra
+      - layer_range: [0, 40]
+        model: /root/myCodeLab/host/verl/ckpts/40bra_k8s_single_domain/40bra_k8s_16node_sd_c362_20260327_205644_unknown/global_step_50/actor/huggingface
+        parameters:
+          density: 1.0
+          weight:
+          - filter: .mlp.gate.
+            value: 0.0
+          - value: 0.5
+    - sources:
+      - layer_range: [40, 41]
+        model: /root/myCodeLab/host/downloads/models/40Bra
+out_dtype: bfloat16
+```

chat_template.jinja

@@ -100,4 +100,4 @@
 
 {%- if add_generation_prompt -%}
     {{ '<|Assistant|>' }}{{ '<|end_of_thought|>' }}
-{%- endif -%}
+{%- endif -%}

config.json

@@ -10,9 +10,11 @@
     "AutoModelForCausalLM": "modeling_deepseek.DeepseekV3ForCausalLM"
   },
   "bos_token_id": 0,
+  "dtype": "bfloat16",
   "eos_token_id": 1,
   "ep_size": 1,
   "first_k_dense_replace": 1,
+  "head_dim": 64,
   "hidden_act": "silu",
   "hidden_size": 2048,
   "initializer_range": 0.02,
@@ -31,18 +33,21 @@
   "num_hidden_layers": 40,
   "num_key_value_heads": 32,
   "num_nextn_predict_layers": 1,
+  "pretraining_tp": 1,
   "q_lora_rank": 1536,
+  "qk_head_dim": 192,
   "qk_nope_head_dim": 128,
   "qk_rope_head_dim": 64,
   "rms_norm_eps": 1e-06,
+  "rope_interleave": true,
+  "rope_scaling": null,
   "rope_theta": 32000000,
   "routed_scaling_factor": 2.5,
   "scoring_func": "sigmoid",
   "tie_word_embeddings": false,
   "topk_group": 1,
   "topk_method": "noaux_tc",
-  "torch_dtype": "bfloat16",
-  "transformers_version": "4.44.2",
+  "transformers_version": "4.57.3",
   "use_cache": true,
   "v_head_dim": 128,
   "vocab_size": 129280

mergekit_config.yml

@@ -0,0 +1,21 @@
+base_model: /root/myCodeLab/host/downloads/models/40Bra
+dtype: float32
+merge_method: dare_linear
+modules:
+  default:
+    slices:
+    - sources:
+      - layer_range: [0, 40]
+        model: /root/myCodeLab/host/downloads/models/40Bra
+      - layer_range: [0, 40]
+        model: /root/myCodeLab/host/verl/ckpts/40bra_k8s_single_domain/40bra_k8s_16node_sd_c362_20260327_205644_unknown/global_step_50/actor/huggingface
+        parameters:
+          density: 1.0
+          weight:
+          - filter: .mlp.gate.
+            value: 0.0
+          - value: 0.5
+    - sources:
+      - layer_range: [40, 41]
+        model: /root/myCodeLab/host/downloads/models/40Bra
+out_dtype: bfloat16

model-1-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ebd70bcbb0406a3ac84a410bbcb2084663eaff71777ff849b88c94a8f8e573fe
+oid sha256:d4ff3a9595c500b44c308dcb352de70289268867c1cb95398c991b6bda655288
 size 140785016

model-10-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4c7b0f180f1554d3f60a93f174c0d213ad21b5d8eafc5ab203391eea018d985b
-size 2479205264
+oid sha256:8096a32b85bba11dc67645fe3041e4a645b8e4f0a24395ff31de9499da1ef298
+size 2479204768

model-11-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:14f08cc780cb9f13942ddac1e573e07ce29e901d3cdc1d841011f2f4d4b15d40
-size 2479206048
+oid sha256:880cefe33cd0a1b2a110c31607ead991f7573c8639e6801cf4a31d4daa46600a
+size 2479205552

model-12-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:494e82e9f99e062d72f0966ed459690accdf793853e9734452f6a6a09e24e13b
-size 2479206048
+oid sha256:affdadcbfaac3364e4dd7a63274c9076f101375eb23225a01cebd22746e2b184
+size 2479205552

model-13-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5c2697b5a70d52b52d60a23019b5129c81826ac49b6ec34ddf83020fc1ffa688
-size 2479206048
+oid sha256:3f07893d0fb8981886ec8b10be24f262361548b634288fdfd4f4051b52326342
+size 2479205552

model-14-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7d835adf4c7ca8ef751936453f0db435a012194d9c77861575e25b200f6c5bc0
-size 2479206048
+oid sha256:2b5efe61c515172e2cb5266f912bcec2c3a2c03d51e1c0c25efe868c5f053fca
+size 2479205552

model-15-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8e16104b8a0d1ec2cad06bf04ace8e15f0cb0224c0990dc752e7371094d63e36
-size 2479206048
+oid sha256:4c19c4f37e88bd0bd89a5508e70e4fafa6d4181bf025136936448e514a647346
+size 2479205552

model-16-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e0cb41f206e6cbe78c1ec3ce09de8449cbe606d4ebb77e45c35677454633b073
-size 2479206048
+oid sha256:7a3360e97b75b40ec35001b28ecd2d78c63d613d2f0edf7dc17f55b55a9679d4
+size 2479205552

model-17-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8179fa2fd5f3f9450c7820eb28dd63cb830495b02ff246e45791e619af75027e
-size 2479206048
+oid sha256:5f8f695bb1d77d99ad3065101b88848ebbd266b2f078185b400e35ffc54d62b3
+size 2479205552

model-18-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fd4b60bfa3641938bd8494c504a32193ef6f9eb42b5b4d4c5284782e8e24ab24
-size 2479206048
+oid sha256:3ae0bd94998fedda4bc3a39607b18c19591c94f657435ed7fe5b3b547ac2407e
+size 2479205552

model-19-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1cea9127593cd0f693721ad5c7f8a1c183878238d012f98b8b2eb5933b5e423e
-size 2479206048
+oid sha256:02eb943552fa1d1d31264da582a46f60afcf6afeef5e73359ad16e5487bf538b
+size 2479205552

model-2-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3760de2dd7bd538e71b618298b336cfff46e79aae5d6688cb1fcb8ab7ecdf725
-size 2479205264
+oid sha256:465e3b5a60dc5196b0838dfbc2722d8d37e5d47867aecd8fb9faec0c8abafe68
+size 2479204768

model-20-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:32c9d913ad38fffee7a633c458c79e5f16dd3cf96b31ab0827745bcca40b5f32
-size 2479206048
+oid sha256:d97a05f96c7c68c5c7484c712297a893096a8288254984b4f89ec3f44737a9c3
+size 2479205552

model-21-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ef6673a8b0a10657e2d0bcd32929c4458149b5dca2cfcfd47834c4f003a194ce
-size 2479206048
+oid sha256:ca6c2d58a25c901fef688f21b46c1d10efd96300ccff833bdd173da7e5f07f6d
+size 2479205552

model-22-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8f4c26ce9345eb72793fbe7635080c232d74339645a6a10233cb7c3b7717c960
-size 2479206048
+oid sha256:77d715e55c5fdd77903d1221e4a443c044aa0261cdefefa44b8483649ace2410
+size 2479205552

model-23-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8f8b312280ea0902c49fd27f12711d4cb34266b8b8de1ad28fa4ba51871479d3
-size 2479206048
+oid sha256:c412898f5bf7edae9012022990e216e93c12173927d997ec517ebf1050f7aa31
+size 2479205552

model-24-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bae31fdcf14f47b289ea101d25c39bbd3971788ccd3dde4d5012d79135f58ded
-size 2479206048
+oid sha256:992bad2935e2ae6f78edb01857f36b8a662aa96f21f37c5c5b0c34af1b363636
+size 2479205552

model-25-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9159819fce18e9948e2923487d56260dfef56b8f78a0800a1992e1c5e6b2a04c
-size 2479206048
+oid sha256:91249980356b8748e863e725939f32f532ea7566e7cf22abbe51cdc40e69a65c
+size 2479205552

model-26-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6c21c2331132706da9eaea2d48f9c571a37ae0d08f2b854585edc34f7687f837
-size 2479206048
+oid sha256:edcd51b69499278d63a20f4a923cf2649bf13ed387dc11e9d7a8e832a3d467a0
+size 2479205552

model-27-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bbe6f39372236e7fa059a8df1c5bac3241074ff0b5665aefd5987ceceaefd5df
-size 2479206048
+oid sha256:3e0d6460b021bb4c72d67c948e849880817cd65e5db11a4a35464ef5cf831f47
+size 2479205552

model-28-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f7ee0362080f92100521a4097e7a4e9bf34cf5d562e79670cae734927fa227fa
-size 2479206048
+oid sha256:aa4cb2ea2d19e607d00da452ccc43b81230c01cae6676f17623a2fcd42efcc87
+size 2479205552

model-29-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:70cb8b677597afb6041623e15d70be7e39e2790e0904b1eb200282e06df722c2
-size 2479206048
+oid sha256:d6bc2b82240380b2844ff5a20b34c3ed0ed8bdd8732e18072b2750ee60e97466
+size 2479205552

model-3-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ff03acde235f71818ca55862cdadc4e0e4c903cc444ddb4ff507d87ce2a485fd
-size 2479205264
+oid sha256:c57dec86e995872b1a560a9269c3fec464bb0ace701eecbf169d26109a9a7ec1
+size 2479204768

model-30-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:66dab417ceacffd83d835b7efa3170e181b8cb052cfa1e663ea40e16039c02ca
-size 2479206048
+oid sha256:2c0d93e33fa2a56e590b7c31aa08fcdaafbf06d7c38820599e5ea3eb6b85f80a
+size 2479205552

model-31-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a8e9400d587dce7c550ab535db78e2de4199ac4ecb94253ee1c21de43c3bc075
-size 2479206048
+oid sha256:f3fef3bf7fab89f904c3215fc2e1dfbf6921c1eaaae87111099f1405f8e3c5cf
+size 2479205552

model-32-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0fefd56e0b80b6e5925299cb3043e9395be1f8890202fd77f72fd80d0b388e43
-size 2479206048
+oid sha256:86f69cad4c5713a826d0ae126f024dace6dbd9a05f02a0777d1a91c76ecd47e0
+size 2479205552

model-33-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:92e15e004bb68a34c25e93960ec02e36181991adec25743d33f2de6ae964c2ea
-size 2479206048
+oid sha256:2b71cd4eed73a24147f38ecf5fd0c10a28e2c43eb1824739d75e3ba20ad14eb6
+size 2479205552

model-34-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:41e3eec85cb83bfbb30271454ad1faf9172f55204a6ec40bd5aef9f6d2281d64
-size 2479206048
+oid sha256:1bc48c177e7228314326f07ac6f6999e780c3a5df157b1df2625d194781a62a5
+size 2479205552

model-35-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ea0b32f02196c668878b3b7a6e8fe588483527a048e143ae8cceee0110a5140
-size 2479206048
+oid sha256:b61c4624b49d88254f798c5ebca2bb19e083613ac7fc301a3ec6e01eaaeb709b
+size 2479205552

model-36-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:012a873cc36f35ba111b27f256ccd7e3b0d13e4ef5900b36b2c5c322fb68e805
-size 2479206048
+oid sha256:830787087384987c57ab0d3a8c0f3f913396915c02a64fc4799a5c13ac8eb2c2
+size 2479205552

model-37-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:91fb83607d81219803a6dbd9a2004719c3d49989287c8450aed34124f7e44574
-size 2479206048
+oid sha256:141767d0b815eda3264cb783082b607bbfa0dfcb86ceaff424f5a54a567574d3
+size 2479205552

model-38-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fc42535f05b94b2060dba56f2c497a73bee85ccf53cc53ca415dd0bca6a5ff01
-size 2479206048
+oid sha256:a58d307ba5dfc6422e26ae3bfe87b6ad1324a68c25e3fc1237f1b74c67ba551c
+size 2479205552

model-39-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e0a60f258dee34202ba221ae076ee0a44ecca6366c6b7ca903ed339f6a33d391
-size 2479206048
+oid sha256:ea0e3899c69f7c4a1d17dc7333da311c72462258fef37515d562e646bad018c4
+size 2479205552

model-4-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1581b89e67c704979da46f27258d091af31312cd623a6836b3565bf3e27fef2b
-size 2479205264
+oid sha256:c7255b501667852f85e93c263a17829eac1fdb22e6ffd786a348b0e843d66aa7
+size 2479204768

model-40-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cbccb4f7be82a2ee4bd5d6fea515b1ae337308199f2140a5908d502d97c86ee9
-size 2479206048
+oid sha256:d2cedb85f49ce19e3e1e6576614399e85a093643b1d906f0c6cae46e185c0702
+size 2479205552

model-5-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:eec85b4df90822d3cbeceb32710b02dcef607e43dc388713637276345892cab0
-size 2479205264
+oid sha256:17c9d61c739221cf01880c787238f2edd9a4cbad5de3172c92788bb4c29f07ee
+size 2479204768

model-6-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e812075888d32153bdcf01722fb0140bfd50165056b4e9d11823d10f668b5cef
-size 2479205264
+oid sha256:b1448a397d403279f66d069270407e2a1d0831fe1ab311f7ec00c93cb4368d9b
+size 2479204768

model-7-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3a1beb221b1d03b21eb4338a053ececdd193ebe558b19499d65a8eef9a0c4016
-size 2479205264
+oid sha256:b6b385d20630cf0b241630984e08777dfbb5913c5e089f0537390eaa6afee880
+size 2479204768

model-8-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fe3eb4fc70a3a8fa61fbf51b05b834c952e87f1ea5cebce16b47e7e088c4ee72
-size 2479205264
+oid sha256:ee65a49d6ae2adafbc90c4ce3defeffa4124db76c8dd37ef8ed29acbf305f688
+size 2479204768

model-9-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e89d4e726a1b80ac5000be27c1faab5e1624ce425bdbf2425f288a7a50e03405
-size 2479205264
+oid sha256:7e27db86d323e90f81d526086ae89249f8a67545e1bbc1bc332d8da7d2735e8d
+size 2479204768

model-non-layer.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:358810bbba6e784b3be7462f7398fed2ba159a0edcec4f586aa72e877f4187ca
+oid sha256:9b992b0a3e3ab06a9490d364bf942df3bcf69874dcb9f940e935f674672f09cd
 size 1059066184