clemsail commited on
Commit
a46795b
·
verified ·
1 Parent(s): 44b112b

Add EU AI Act compliant model card

Browse files
Files changed (1) hide show
  1. README.md +82 -0
README.md ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: mistralai/Devstral-Small-2-24B-Instruct-2512
4
+ library_name: peft
5
+ tags:
6
+ - mlx
7
+ - lora
8
+ - peft
9
+ - ailiance
10
+ - devstral
11
+ - cpp
12
+ language:
13
+ - en
14
+ - fr
15
+ pipeline_tag: text-generation
16
+ ---
17
+
18
+ # Ailiance — Devstral-Small-2-24B-Instruct cpp (curriculum) LoRA
19
+
20
+ LoRA adapter fine-tuned on `mistralai/Devstral-Small-2-24B-Instruct-2512` for **cpp** tasks.
21
+
22
+ > **Variant**: trained with multi-phase length curriculum.
23
+
24
+ > Maintained by **Ailiance** — French AI org publishing EU AI Act aligned LoRA adapters and datasets.
25
+
26
+ ## Quick start (MLX)
27
+
28
+ ```python
29
+ from mlx_lm import load, generate
30
+
31
+ model, tokenizer = load(
32
+ "mistralai/Devstral-Small-2-24B-Instruct-2512",
33
+ adapter_path="Ailiance-fr/devstral-cpp-curriculum-lora",
34
+ )
35
+
36
+ print(generate(model, tokenizer, prompt="..."))
37
+ ```
38
+
39
+ ## Training
40
+
41
+ | Hyperparameter | Value |
42
+ |------------------|------------------------|
43
+ | Base model | `mistralai/Devstral-Small-2-24B-Instruct-2512` |
44
+ | Method | LoRA via `mlx-lm` |
45
+ | Rank | 16 |
46
+ | Scale | 2.0 |
47
+ | Alpha | 32 |
48
+ | Max seq length | 8192 |
49
+ | Iterations | 500 |
50
+ | Optimizer | Adam, LR 1e-5 |
51
+ | Hardware | Apple M3 Ultra 512 GB |
52
+
53
+ Training data lineage: derived from the **eu-kiki / mascarade** corpus
54
+ (Ailiance-fr datasets) curated for the `cpp` domain. See the
55
+ [Ailiance-fr dataset catalog](https://huggingface.co/Ailiance-fr) for upstream cards.
56
+
57
+ ## EU AI Act compliance
58
+
59
+ - **Article 53(1)(c)**: training data licenses preserved (permissive only).
60
+ - **Article 53(1)(d)**: training data summary — see source dataset cards on Ailiance-fr.
61
+ - **GPAI Code of Practice (July 2025)**: base `mistralai/Devstral-Small-2-24B-Instruct-2512` released under apache-2.0; this LoRA inherits.
62
+ - **No web scraping**, **no licensed data**, **no PII**.
63
+
64
+ ## License
65
+
66
+ LoRA weights: **apache-2.0** (inherited from base).
67
+
68
+ ## Citation
69
+
70
+ ```bibtex
71
+ @misc{ailiance_devstral_cpp_curriculum_2026,
72
+ author = {Ailiance},
73
+ title = {Ailiance — Devstral-Small-2-24B-Instruct cpp (curriculum) LoRA},
74
+ year = {2026},
75
+ publisher = {Hugging Face},
76
+ url = {https://huggingface.co/Ailiance-fr/devstral-cpp-curriculum-lora}
77
+ }
78
+ ```
79
+
80
+ ## Related
81
+
82
+ See the full [Ailiance-fr LoRA collection](https://huggingface.co/Ailiance-fr).