Add files using upload-large-folder tool

README.md

@@ -1,378 +1,49 @@
 ---
-language:
-- zh
-- en
-pipeline_tag: text-generation
+base_model: []
 library_name: transformers
----
-<div align="center">
-  <picture>
-      <img src="figures/joyai-logo.png" width="30%" alt="JoyAI-LLM Flash">
-  </picture>
-</div>
-<hr>
-
-<div align="center" style="line-height: 1;">
-  <a href="https://huggingface.co/jdopensource" target="_blank"><img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-JD-ffc107?color=ffc107&logoColor=white"/></a>
-  <a href="https://huggingface.co/jdopensource/JoyAI-LLM-Flash/blob/main/LICENSE"><img alt="License" src="https://img.shields.io/badge/License-Modified_MIT-f5de53?&color=f5de53"/></a>
-</div>
-
-## 1. Model Introduction
-
-JoyAI-LLM-Flash is a state-of-the-art medium-sized instruct language model with 3 billion activated parameters and 48 billion total parameters. JoyAI-LLM-Flash was pretrained on 20 trillion text tokens using Muon optimizer, followed by large-scale supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning (RL) across diverse environments. JoyAI-LLM-Flash achieves strong performance across frontier knowledge, reasoning, coding tasks and agentic capabilities.
-
-### Key Features
-
-- Fiber Bundle RL: Introduces fiber bundle theory into reinforcement learning, proposing a novel optimization framework, FiberPO. This method is specifically designed to handle the challenges of large-scale and heterogeneous agent training, improving stability and robustness under complex data distributions.
-- Training-Inference Collaboration: apply Muon optimizer with dense MTP, develop novel optimization techniques to resolve instabilities while scaling up, delivering 1.3× to 1.7× the throughput of the non-MTP version.
-- Agentic Intelligence: designed for tool use, reasoning, and autonomous problem-solving.
-
-## 2. Model Summary
-
-|                                             |                          |
-| :-----------------------------------------: | :----------------------: |
-|              **Architecture**               | Mixture-of-Experts (MoE) |
-|            **Total Parameters**             |           48B            |
-|          **Activated Parameters**           |            3B            |
-| **Number of Layers** (Dense layer included) |            40            |
-|         **Number of Dense Layers**          |            1             |
-|       **Attention Hidden Dimension**        |           2048           |
-|    **MoE Hidden Dimension** (per Expert)    |           768            |
-|        **Number of Attention Heads**        |            32            |
-|            **Number of Experts**            |           256            |
-|       **Selected Experts per Token**        |            8             |
-|        **Number of Shared Experts**         |            1             |
-|             **Vocabulary Size**             |           129K           |
-|             **Context Length**              |           128K           |
-|           **Attention Mechanism**           |           MLA            |
-|           **Activation Function**           |          SwiGLU          |
-|                   </div>                    |                          |
-
-
-## 3. Evaluation Results
-
-<table>
-<thead>
-<tr>
-<th align="center">Benchmark</th>
-<th align="center"><sup>JoyAI-LLM Flash</sup></th>
-<th align="center"><sup>Qwen3-30B-A3B-Instuct-2507</sup></th>
-<th align="center"><sup>GLM-4.7-Flash<br>(Non-thinking)</sup></th>
-</tr>
-</thead>
-<tbody>
-
-
-<tr>
-<td align="center" colspan=8><strong>Knowledge &amp; Alignment</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">MMLU</td>
-<td align="center" style="vertical-align: middle"><strong>89.50</strong></td>
-<td align="center" style="vertical-align: middle">86.87</td>
-<td align="center" style="vertical-align: middle">80.53</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">MMLU-Pro</td>
-<td align="center" style="vertical-align: middle"><strong>81.02</strong></td>
-<td align="center" style="vertical-align: middle">73.88</td>
-<td align="center" style="vertical-align: middle">63.62</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">CMMLU</td>
-<td align="center" style="vertical-align: middle"><strong>87.03</strong></td>
-<td align="center" style="vertical-align: middle">85.88</td>
-<td align="center" style="vertical-align: middle">75.85</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">GPQA-Diamond</td>
-<td align="center" style="vertical-align: middle"><strong>74.43</strong></td>
-<td align="center" style="vertical-align: middle">68.69</td>
-<td align="center" style="vertical-align: middle">39.90</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">SuperGPQA</td>
-<td align="center" style="vertical-align: middle"><strong>55.00</strong></td>
-<td align="center" style="vertical-align: middle">52.00</td>
-<td align="center" style="vertical-align: middle">32.00</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">LiveBench</td>
-<td align="center" style="vertical-align: middle"><strong>72.90</strong></td>
-<td align="center" style="vertical-align: middle">59.70</td>
-<td align="center" style="vertical-align: middle">43.10</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">IFEval</td>
-<td align="center" style="vertical-align: middle"><strong>86.69</strong></td>
-<td align="center" style="vertical-align: middle">83.18</td>
-<td align="center" style="vertical-align: middle">82.44</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">AlignBench</td>
-<td align="center" style="vertical-align: middle"><strong>8.24</strong></td>
-<td align="center" style="vertical-align: middle">8.07</td>
-<td align="center" style="vertical-align: middle">6.85</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">HellaSwag</td>
-<td align="center" style="vertical-align: middle"><strong>91.79</strong></td>
-<td align="center" style="vertical-align: middle">89.90</td>
-<td align="center" style="vertical-align: middle">60.84</td>
-</tr>
-
-<tr>
-<td align="center" colspan=8><strong>Coding</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">HumanEval</td>
-<td align="center" style="vertical-align: middle"><strong>96.34</strong></td>
-<td align="center" style="vertical-align: middle">95.12</td>
-<td align="center" style="vertical-align: middle">74.39</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">LiveCodeBench</td>
-<td align="center" style="vertical-align: middle"><strong>65.60</strong></td>
-<td align="center" style="vertical-align: middle">39.71</td>
-<td align="center" style="vertical-align: middle">27.43</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">SciCode</td>
-<td align="center" style="vertical-align: middle"><strong>3.08/22.92</strong></td>
-<td align="center" style="vertical-align: middle"><strong>3.08/22.92</strong></td>
-<td align="center" style="vertical-align: middle">3.08/15.11</td>
-</tr>
-<tr>
-<td align="center" colspan=8><strong>Mathematics</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">GSM8K</td>
-<td align="center" style="vertical-align: middle"><strong>95.83</strong></td>
-<td align="center" style="vertical-align: middle">79.83</td>
-<td align="center" style="vertical-align: middle">81.88</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">AIME2025</td>
-<td align="center" style="vertical-align: middle"><strong>65.83</strong></td>
-<td align="center" style="vertical-align: middle">62.08</td>
-<td align="center" style="vertical-align: middle">24.17</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">MATH 500</td>
-<td align="center" style="vertical-align: middle"><strong>97.10</strong></td>
-<td align="center" style="vertical-align: middle">89.80</td>
-<td align="center" style="vertical-align: middle">90.90</td>
-</tr>
-
-<tr>
-<td align="center" colspan=8><strong>Agentic</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">SWE-bench Verified</td>
-<td align="center" style="vertical-align: middle"><strong>60.60</strong></td>
-<td align="center" style="vertical-align: middle">24.44</td>
-<td align="center" style="vertical-align: middle">51.60</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">Tau2-Retail</td>
-<td align="center" style="vertical-align: middle"><strong>67.55</strong></td>
-<td align="center" style="vertical-align: middle">53.51</td>
-<td align="center" style="vertical-align: middle">62.28</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">Tau2-Airline</td>
-<td align="center" style="vertical-align: middle"><strong>54.00</strong></td>
-<td align="center" style="vertical-align: middle">32.00</td>
-<td align="center" style="vertical-align: middle">52.00</td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">Tau2-Telecom</td>
-<td align="center" style="vertical-align: middle">79.83</td>
-<td align="center" style="vertical-align: middle">4.39</td>
-<td align="center" style="vertical-align: middle"><strong>88.60</strong></td>
-</tr>
-
-<tr>
-<td align="center" colspan=8><strong>Long Context</strong></td>
-</tr>
-<tr>
-<td align="center" style="vertical-align: middle">RULER</td>
-<td align="center" style="vertical-align: middle"><strong>95.60</strong></td>
-<td align="center" style="vertical-align: middle">89.66</td>
-<td align="center" style="vertical-align: middle">56.12</td>
-</tr>
-</tbody>
-</table>
-
-
-## 4. Deployment
-
-> [!Note]
-> You can access JoyAI-LLM Flash API on https://docs.jdcloud.com/cn/jdaip/chat and we provide OpenAI/Anthropic-compatible API for you. 
-> Currently, JoyAI-LLM-Flash-FP8 is recommended to run on the following inference engines:
-
-* vLLM
-* SGLang
-
-The minimum version requirement for `transformers` is `4.57.1`.
-
-Deployment examples can be found in the [Model Deployment Guide](docs/deploy_guidance.md).
-
-
-
-## 5. Model Usage
-
-The usage demos below demonstrate how to call our official API.
-
-For third-party APIs deployed with vLLM or SGLang, please note that:
-
-> [!Note] Recommended sampling parameters: `temperature=0.6`, `top_p=1.0`
-
-### Chat Completion
-
-This is a simple chat completion script which shows how to call JoyAI-Flash API.
-
-```python
-from openai import OpenAI
-
-client = OpenAI(base_url="http://IP:PORT/v1", api_key="EMPTY")
-
-
-def simple_chat(client: OpenAI):
-    messages = [
-        {
-            "role": "user",
-            "content": [
-                {
-                    "type": "text",
-                    "text": "which one is bigger, 9.11 or 9.9? think carefully.",
-                }
-            ],
-        },
-    ]
-    model_name = client.models.list().data[0].id
-    response = client.chat.completions.create(
-        model=model_name, messages=messages, stream=False, max_tokens=4096
-    )
-    print(f"response: {response.choices[0].message.content}")
-
-
-if __name__ == "__main__":
-    simple_chat(client)
-```
-
-
-### Tool call Completion
-
-This is a simple toll call completion script which shows how to call JoyAI-Flash API.
-
-```python
-import json
-
-from openai import OpenAI
-
-client = OpenAI(base_url="http://IP:PORT/v1", api_key="EMPTY")
-
-
-def my_calculator(expression: str) -> str:
-    return str(eval(expression))
-
-
-def rewrite(expression: str) -> str:
-    return str(expression)
-
-
-def simple_tool_call(client: OpenAI):
-    messages = [
-        {
-            "role": "user",
-            "content": [
-                {
-                    "type": "text",
-                    "text": "use my functions to compute the results for the equations: 6+1",
-                },
-            ],
-        },
-    ]
-    tools = [
-        {
-            "type": "function",
-            "function": {
-                "name": "my_calculator",
-                "description": "A calculator that can evaluate a mathematical equation and compute its results.",
-                "parameters": {
-                    "type": "object",
-                    "properties": {
-                        "expression": {
-                            "type": "string",
-                            "description": "The mathematical expression to evaluate.",
-                        },
-                    },
-                    "required": ["expression"],
-                },
-            },
-        },
-        {
-            "type": "function",
-            "function": {
-                "name": "rewrite",
-                "description": "Rewrite a given text for improved clarity",
-                "parameters": {
-                    "type": "object",
-                    "properties": {
-                        "text": {
-                            "type": "string",
-                            "description": "The input text to rewrite",
-                        }
-                    },
-                },
-            },
-        },
-    ]
-    model_name = client.models.list().data[0].id
-    response = client.chat.completions.create(
-        model=model_name,
-        messages=messages,
-        temperature=1.0,
-        max_tokens=1024,
-        tools=tools,
-        tool_choice="auto",
-    )
-    tool_calls = response.choices[0].message.tool_calls
-
-    results = []
-    for tool_call in tool_calls:
-        function_name = tool_call.function.name
-        function_args = tool_call.function.arguments
-        if function_name == "my_calculator":
-            result = my_calculator(**json.loads(function_args))
-            results.append(result)
-    messages.append({"role": "assistant", "tool_calls": tool_calls})
-    for tool_call, result in zip(tool_calls, results):
-        messages.append(
-            {
-                "role": "tool",
-                "tool_call_id": tool_call.id,
-                "name": tool_call.function.name,
-                "content": result,
-            }
-        )
-    response = client.chat.completions.create(
-        model=model_name,
-        messages=messages,
-        temperature=1.0,
-        max_tokens=1024,
-    )
-    print(response.choices[0].message.content)
-
-
-if __name__ == "__main__":
-    simple_tool_call(client)
-
-```
+tags:
+- mergekit
+- merge
 
 ---
-
-## 6. License
-
-Both the code repository and the model weights are released under the [Modified MIT License](LICENSE).
+# c362_step50_ta05
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [Linear DARE](https://arxiv.org/abs/2311.03099) merge method using /root/myCodeLab/host/downloads/models/40Bra as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* /root/myCodeLab/host/verl/ckpts/40bra_k8s_single_domain/40bra_k8s_16node_sd_c362_20260327_205644_unknown/global_step_50/actor/huggingface
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+base_model: /root/myCodeLab/host/downloads/models/40Bra
+dtype: float32
+merge_method: dare_linear
+modules:
+  default:
+    slices:
+    - sources:
+      - layer_range: [0, 40]
+        model: /root/myCodeLab/host/downloads/models/40Bra
+      - layer_range: [0, 40]
+        model: /root/myCodeLab/host/verl/ckpts/40bra_k8s_single_domain/40bra_k8s_16node_sd_c362_20260327_205644_unknown/global_step_50/actor/huggingface
+        parameters:
+          density: 1.0
+          weight:
+          - filter: .mlp.gate.
+            value: 0.0
+          - value: 0.5
+    - sources:
+      - layer_range: [40, 41]
+        model: /root/myCodeLab/host/downloads/models/40Bra
+out_dtype: bfloat16
+```

config.json

@@ -10,9 +10,11 @@
         "AutoModelForCausalLM": "modeling_deepseek.DeepseekV3ForCausalLM"
     },
     "bos_token_id": 0,
+    "dtype": "bfloat16",
     "eos_token_id": 1,
     "ep_size": 1,
     "first_k_dense_replace": 1,
+    "head_dim": 64,
     "hidden_act": "silu",
     "hidden_size": 2048,
     "initializer_range": 0.02,
@@ -31,7 +33,9 @@
     "num_hidden_layers": 40,
     "num_key_value_heads": 32,
     "num_nextn_predict_layers": 1,
+    "pretraining_tp": 1,
     "q_lora_rank": 1536,
+    "qk_head_dim": 192,
     "qk_nope_head_dim": 128,
     "qk_rope_head_dim": 64,
     "quantization_config": {
@@ -44,15 +48,16 @@
         ]
     },
     "rms_norm_eps": 1e-06,
+    "rope_interleave": true,
+    "rope_scaling": null,
     "rope_theta": 32000000,
     "routed_scaling_factor": 2.5,
     "scoring_func": "sigmoid",
     "tie_word_embeddings": false,
     "topk_group": 1,
     "topk_method": "noaux_tc",
-    "torch_dtype": "bfloat16",
-    "transformers_version": "4.44.2",
+    "transformers_version": "4.57.3",
     "use_cache": true,
     "v_head_dim": 128,
     "vocab_size": 129280
-}
+}

mergekit_config.yml

@@ -0,0 +1,21 @@
+base_model: /root/myCodeLab/host/downloads/models/40Bra
+dtype: float32
+merge_method: dare_linear
+modules:
+  default:
+    slices:
+    - sources:
+      - layer_range: [0, 40]
+        model: /root/myCodeLab/host/downloads/models/40Bra
+      - layer_range: [0, 40]
+        model: /root/myCodeLab/host/verl/ckpts/40bra_k8s_single_domain/40bra_k8s_16node_sd_c362_20260327_205644_unknown/global_step_50/actor/huggingface
+        parameters:
+          density: 1.0
+          weight:
+          - filter: .mlp.gate.
+            value: 0.0
+          - value: 0.5
+    - sources:
+      - layer_range: [40, 41]
+        model: /root/myCodeLab/host/downloads/models/40Bra
+out_dtype: bfloat16

model-1-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:48497c8832fcf0b1af0fccba0c9eacf948580b18d57dd735021a75330f95b394
+oid sha256:cc85f33946c03617a348c77b0e531bbe3aa23fd4b84315d421d1b7d9d85aed41
 size 70417464

model-10-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bf9fd692aa8ce99badb836897a561176653f7eeb7693c9e21e1906ea47196ac0
-size 1240579032
+oid sha256:b9097c460b873d4516ff20141d67fdd0721fd82b46aca831bf9989dff57c81f1
+size 1240578520

model-11-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bb7fa33ede9d972a415d227eb101e605c95bb5ef73b179a3681af2abb9471a57
-size 1240580584
+oid sha256:237d865c2017c0650a97230107ed95af4e6e6da923b4db7bd2cd028146e223e9
+size 1240580072

model-12-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bde73a20d75033a5b9f10c27dc6a11d29982f59c484765e5a0abcdbc379dc978
-size 1240580584
+oid sha256:84920a879a35f42d01019f8d5822f90d8502cc695c5c35e5dd52a2892e4a4a07
+size 1240580072

model-13-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ee6ff449b07098d305305073a34182b9a9fe06f3e2aa29a3b709bb01c4e2089b
-size 1240580584
+oid sha256:5dd36e86ab7016ebb6c5f94e15ab56a3319f6e75e44b61a9adf8aa40183a40bb
+size 1240580072

model-14-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ea091e6db39fc79d5c41313dae709355bc3575f2a3f2404501502dd2682f3ec1
-size 1240580584
+oid sha256:95084b9fb5c03fbc307909dc494b1c98b114bbd1695a0f1df512f7ce1ade66dd
+size 1240580072

model-15-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5e733587d3c0245e7e9ae939a8322ab99a9ee6a57fcc37a050bb7087e4546a44
-size 1240580584
+oid sha256:2cc293475f45401d5f5f6ca0b8ce5364a1b52f4ee378c266ee5ea7da4b9f31bf
+size 1240580072

model-16-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fba336f7bca7eb6c5d4e6741ae2c6414c4cb6b6eee00cc3d83592edcb4c48e21
-size 1240580584
+oid sha256:2755ee609aa76d2e3c8ff63ca20dfd4c9b989887b8d9b5aad4097f914d59a67d
+size 1240580072

model-17-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:298748f91a66d94a7892a34c3951c7de9d38fa57126ac4d8d8f29a903e0219ea
-size 1240580584
+oid sha256:4abcf8eb68e256b1f41603cb44d2124b10430e1c2645bfd63e5e28d730d515a2
+size 1240580072

model-18-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a66ff92c1b42acc3dd7cddb454c751480467b990694e86e657bb07be55a165f7
-size 1240580584
+oid sha256:ff661321d1168e3442457cf7f14bffe58803955244a0ac83acaa3f54b40dbc01
+size 1240580072

model-19-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:88fb0f0ce805762bb7d49e479f2d2b2047fa685ff18a937ac36e988030e8fd5f
-size 1240580584
+oid sha256:1ada3f96b5526bea7547c7786e8515d61c8fa635bed6bc83be4c5d38651c5afa
+size 1240580072

model-2-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3f70aed8f1f9abd325c36385fb129a97d9e10f6a3ba3a98f1d02eb86d1eb9201
-size 1240579032
+oid sha256:f4b3368a5db87ea37a4048138b0cd818b520d9e9139f099938d5b5a1517b4d56
+size 1240578520

model-20-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a47822cfab0deaf9ae7365458d49c3d143744ab988ce9a126782c63888b95b0a
-size 1240580584
+oid sha256:436fcb426b20fd83c765180998b02fbf97b8c3259266f36984cda8f30fe58729
+size 1240580072

model-21-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7465adef3c55ea170471a501b9acf24b88f6de9976d1ac8473c1e337ca75c81f
-size 1240580584
+oid sha256:7371ff51bbc2a48221b6c2b81c86da02b750e8947e1a55dfe0c754fd01308545
+size 1240580072

model-22-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:253d68a26c0b9057109db575f853d04ba50f12075648c93a4843ba90aa2c3456
-size 1240580584
+oid sha256:b8cd39cc3575aac9daa4c5e44e21d28dde6a7391be7184cac0b5c562e34d24a0
+size 1240580072

model-23-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2d071fa057c15ada66ab549d9bd854c092789f8803f4a6135668ee87ca4690c2
-size 1240580584
+oid sha256:c7c8affbc0b48e9518fb7fb1c522ed7db43c00bda1581552c23995c9f383d691
+size 1240580072

model-24-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c9d9768e6f052664386193a0b9b8ffdb74b189f806d824ec701bd684cbef252d
-size 1240580584
+oid sha256:0bf3022e758147fea8278e0fcca88118006c1e4b6922c523b3e559d8d7fc65b0
+size 1240580072

model-25-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:36b3273f48e8005b6d43875a1b8c3ed16711ee9af36799bd44f3918a91dc6c37
-size 1240580584
+oid sha256:5c78c8c378cd24fa1e86103689811388093ef2e3a21e9d509c5ed3027cd5aca7
+size 1240580072

model-26-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a7f5f636d5cd0e81fb1d13284c6981db2f35e0a61bb014d48353c1329245f4f0
-size 1240580584
+oid sha256:266b691abf43456d9fcec51c1de5d82e444e2d72b43fc33aab6d445c4ac9ecd3
+size 1240580072

model-27-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c02f9e2237cb3af60eae5cf4ca3dcdd581184571019655502274b995017f681a
-size 1240580584
+oid sha256:21b6d4647f74277f6c1289f31a34ad4ed9073397e71317e314c73d142f7ec146
+size 1240580072

model-28-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bf2ae06caae01d992a7934975cc0e812bd628e6061c98b04137821bf93cc1e1a
-size 1240580584
+oid sha256:2cf3660846e254ef7f787c47d80f719a180818e9b4f8b89562ca29d5bc526618
+size 1240580072

model-29-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:92ceb810aba74a674768ac5acc5b92754adb734b5dc5a4c03783b1c2d6a40b35
-size 1240580584
+oid sha256:66db0cc04446a371b8ddb5520c3122ca74b3cf5833ec08c988475dc0640e84f6
+size 1240580072

model-3-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2d9eb12db9bf0b95b00d4a3c4ae8b80302b8fd7832db02b08edc43e62956b9e8
-size 1240579032
+oid sha256:3cecafcd2aceb1cceca16ff9d9fac145759a98292672f9d0bd2715b710bad28a
+size 1240578520

model-30-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2ead2b2e2900e23825a2895aecd6f0e66c9b829ed29ba842f5dae37c39ec041b
-size 1240580584
+oid sha256:a478fe13e731d27ffb034d4664f3e38e7ed7117b73dc25a6760871ae04727ea5
+size 1240580072

model-31-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:21fb5a191d41f3fd1608f2ddfcb32bfc3a91e0f639cacde56494006d080067d5
-size 1240580584
+oid sha256:d783ab8ec47f1a5f93af5cfb1a1d044926e720db6cc63c1d7c54484d8d747902
+size 1240580072

model-32-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0c3d2a82580d097fed63224daf4f199cc1389e9284f9e1463bf5285577baa147
-size 1240580584
+oid sha256:3a97d136a1c0d672c612f37217caf32a31b7e970032ed417f7a2c0d4fd54b69a
+size 1240580072

model-33-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b093b9e98d02a6dc5aef34989ce766e294e32685d6c16067ddcc1b5d34d2ba75
-size 1240580584
+oid sha256:4070ccecd012e00af245a02458f25a6dcc14b95b0de7f2ed3c7760c2b8249cdd
+size 1240580072

model-34-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ab3f9d0b02a4c0018f84885323d46498ffd0f887adfb514b38ff7cd12b257801
-size 1240580584
+oid sha256:78ff2e57c05958c6f6392ce9121d3cfbf26a7ed82e6b74c44939dc38059ea8a1
+size 1240580072

model-35-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4d14d0c3eed182277e98c1c65dacc512ab0378a853915df9977152b0acc02f2d
-size 1240580584
+oid sha256:bd7cc1dd46b36b01063c0c99569ecfed2a6c03fe99aab5011751c8b83c598762
+size 1240580072

model-36-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9644ccd0bb9c8574233d8c125e7e47d99814daf8982509caf774e88e5e2f1346
-size 1240580584
+oid sha256:6261773ee2afad34e25963aab9ad86e8423d683f16fd64edb00d8de9a8b83667
+size 1240580072

model-37-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a1be01191c347a9871c535553c404b03e5e824b00d88ee1692b5f493ad239146
-size 1240580584
+oid sha256:ee6fbb7dbfbca4722f57f5c7b2735ca7471f9856e9c372afc3fcde8bf54fecd9
+size 1240580072

model-38-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:19778856b18e6f3be4891561ad8cabe5087a716791835e95a5b47928e891103f
-size 1240580584
+oid sha256:09e777939bec8cc63499c13a6bcfec397df2cce926fda01ad3ab519b9b6baa71
+size 1240580072

model-39-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:567cecfd87ecb858cb52841b34396ba60c33dc8513a6db54567bd6df4b758aa0
-size 1240580584
+oid sha256:cfd4647bdc71bd5ee4504915eeab60fad8662a75019c081098e107c4afac6c15
+size 1240580072

model-4-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:72e7477976fe7223bb9d4c5bc36a0fadd9aef97cafe05758764565353e18394c
-size 1240579032
+oid sha256:6dec30ce10e3273f1962859ef39dab1beb5a631e3b3fba54a368aba237ab8246
+size 1240578520

model-40-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9734d1dc7611dd095009ae3e198d03ee4bb525cd0d08ac48929fdfe914bd6165
-size 1240580584
+oid sha256:46bf7ddc6a8344577a39367d6beac2c27b57b9ab945ab9fc8b93d22f5e3ff25e
+size 1240580072

model-5-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f25ce7802ce04cc54be0fd059e77b00f4576957d8ed7f7536c3bfc4d599e6583
-size 1240579032
+oid sha256:f31e319a194084721abf93ddf3d5ab402c636c35f6a4d424eff37461123769b1
+size 1240578520

model-6-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b654fcd83e86a401aa8a77eb58aae2470f939e858da553929555c43b1b89e3b9
-size 1240579032
+oid sha256:df9a79ee73887ff51346c491dd3524443b499a4b41243b5aa584ff94a4610740
+size 1240578520

model-7-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:80f8b7d82c2da928acff09102ff78b514a4a9afdb6b63bde6f455354b31d9614
-size 1240579032
+oid sha256:26f1214b569092c9a2bc5eb67c8a8f07a412415eb88b3039c538f8fe47e9bfac
+size 1240578520

model-8-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:032578714641e56a3f899f02245e3e444e1596b2a9c7bb50aa63c215771a87ae
-size 1240579032
+oid sha256:148f670344a44a55774e7e48470615f5757ef3f9f30654435319b23ab66d6db1
+size 1240578520

model-9-of-40.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4d9c00db95ab26608f6aed129da66aad35218d52d56bb71a6b0706d26565c818
-size 1240579032
+oid sha256:278ca8a74e1c390dab71e3b6427f80777122dada5eccacf8ee7d0c4ae1e78e7f
+size 1240578520

model-non-layer.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:358810bbba6e784b3be7462f7398fed2ba159a0edcec4f586aa72e877f4187ca
+oid sha256:9b992b0a3e3ab06a9490d364bf942df3bcf69874dcb9f940e935f674672f09cd
 size 1059066184