Hugging Face's logo

mlx-community
/
DeepSeek-V4-Flash-4bit

Text Generation
MLX
Safetensors
English
deepseek_v4
conversational
4-bit precision
Model card Files
xet
 Community
2
prince-canuma commited on
Commit
811fe46
·
verified ·
1 Parent(s): c29bfd5

Clean stale weights

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +0 -31
  2. config.json +0 -0
  3. generation_config.json +0 -9
  4. model-00001-of-00033.safetensors +0 -3
  5. model-00001-of-00036.safetensors +0 -3
  6. model-00002-of-00033.safetensors +0 -3
  7. model-00002-of-00036.safetensors +0 -3
  8. model-00003-of-00033.safetensors +0 -3
  9. model-00003-of-00036.safetensors +0 -3
  10. model-00004-of-00033.safetensors +0 -3
  11. model-00004-of-00036.safetensors +0 -3
  12. model-00005-of-00033.safetensors +0 -3
  13. model-00005-of-00036.safetensors +0 -3
  14. model-00006-of-00033.safetensors +0 -3
  15. model-00006-of-00036.safetensors +0 -3
  16. model-00007-of-00033.safetensors +0 -3
  17. model-00007-of-00036.safetensors +0 -3
  18. model-00008-of-00033.safetensors +0 -3
  19. model-00008-of-00036.safetensors +0 -3
  20. model-00009-of-00033.safetensors +0 -3
  21. model-00009-of-00036.safetensors +0 -3
  22. model-00010-of-00033.safetensors +0 -3
  23. model-00010-of-00036.safetensors +0 -3
  24. model-00011-of-00033.safetensors +0 -3
  25. model-00011-of-00036.safetensors +0 -3
  26. model-00012-of-00033.safetensors +0 -3
  27. model-00012-of-00036.safetensors +0 -3
  28. model-00013-of-00033.safetensors +0 -3
  29. model-00013-of-00036.safetensors +0 -3
  30. model-00014-of-00033.safetensors +0 -3
  31. model-00014-of-00036.safetensors +0 -3
  32. model-00015-of-00033.safetensors +0 -3
  33. model-00015-of-00036.safetensors +0 -3
  34. model-00016-of-00033.safetensors +0 -3
  35. model-00016-of-00036.safetensors +0 -3
  36. model-00017-of-00033.safetensors +0 -3
  37. model-00017-of-00036.safetensors +0 -3
  38. model-00018-of-00033.safetensors +0 -3
  39. model-00018-of-00036.safetensors +0 -3
  40. model-00019-of-00033.safetensors +0 -3
  41. model-00019-of-00036.safetensors +0 -3
  42. model-00020-of-00033.safetensors +0 -3
  43. model-00020-of-00036.safetensors +0 -3
  44. model-00021-of-00033.safetensors +0 -3
  45. model-00021-of-00036.safetensors +0 -3
  46. model-00022-of-00033.safetensors +0 -3
  47. model-00022-of-00036.safetensors +0 -3
  48. model-00023-of-00033.safetensors +0 -3
  49. model-00023-of-00036.safetensors +0 -3
  50. model-00024-of-00033.safetensors +0 -3
README.md DELETED
@@ -1,31 +0,0 @@
1
- ---
2
- language: en
3
- pipeline_tag: text-generation
4
- library_name: mlx
5
- tags:
6
- - mlx
7
- ---
8
-
9
- # mlx-community/DeepSeek-V4-Flash-4bit
10
-
11
- ## Use with mlx
12
-
13
- ```bash
14
- pip install mlx-lm
15
- ```
16
-
17
- ```python
18
- from mlx_lm import load, generate
19
-
20
- model, tokenizer = load("mlx-community/DeepSeek-V4-Flash-4bit")
21
-
22
- prompt = "hello"
23
-
24
- if tokenizer.chat_template is not None:
25
- messages = [{"role": "user", "content": prompt}]
26
- prompt = tokenizer.apply_chat_template(
27
- messages, add_generation_prompt=True, return_dict=False,
28
- )
29
-
30
- response = generate(model, tokenizer, prompt=prompt, verbose=True)
31
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
config.json DELETED
The diff for this file is too large to render. See raw diff
 
generation_config.json DELETED
@@ -1,9 +0,0 @@
1
- {
2
- "_from_model_config": true,
3
- "bos_token_id": 0,
4
- "eos_token_id": 1,
5
- "do_sample": true,
6
- "temperature": 1.0,
7
- "top_p": 1.0,
8
- "transformers_version": "4.46.3"
9
- }
 
 
 
 
 
 
 
 
 
 
model-00001-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2763f13df412307d33e4716dd3fdabfaa8f45a400d9bdd00e38f10654e65ae14
3
- size 5015525498
 
 
 
 
model-00001-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:fef56d4a4dfbe23124b35ab58364423b42013fb2ee5937cf22bc36b4559c552b
3
- size 4478654688
 
 
 
 
model-00002-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe4764a66492166775fe59f7505fa06f7972a4c79056657dab0aebf19ddf9537
3
- size 4659972401
 
 
 
 
model-00002-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d1c18825aa46b5c72382d8c1af673c5bcd007e22634a2cc6dabecbffd73ff866
3
- size 5331061438
 
 
 
 
model-00003-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d79301976c52ed3d410d012c21ccce4e307149aef907eb1c7531d1804ee24ea0
3
- size 4735845835
 
 
 
 
model-00003-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:665a1470a6e3fdc71bc77520a21f25056bcaff12f9be24121af8585705e5fc30
3
- size 5316570854
 
 
 
 
model-00004-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:54d478ece03e889350bcf1b56559974ece40fcff459586856fb4ba3bff801c07
3
- size 4645481801
 
 
 
 
model-00004-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:3c52b546ec7c0914b77a2aac12d2dc9f10706976f8570d66349770c6cbd6581d
3
- size 4385332932
 
 
 
 
model-00005-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:64eb31e4e073a80145681f0aebb9a0dbfe3a443d6088abd727d9a11e1ee10553
3
- size 4653767996
 
 
 
 
model-00005-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:47f81e2aebbf14001a10d8f3ff82b73caa4459aa913b6b0bc4eb7a95ae1736b6
3
- size 5316570901
 
 
 
 
model-00006-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:e71c041fa00e87df9f15148057c9b7699b25d5d2464881063f51783f71241ddb
3
- size 4735845885
 
 
 
 
model-00006-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:325f47003b727e51e6f7fd3abece5e60e941e6a2d4564c84f5aa9615cbb6c769
3
- size 4333193053
 
 
 
 
model-00007-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:49ed543421226f258763fc577fd01faddf4b082c41c3883b535943e83fa1a5b4
3
- size 4645481873
 
 
 
 
model-00007-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a7c9db488d14e689f6b1e8e4ed726d3024fe90e2c947c08835342dac99c1248
3
- size 5324857027
 
 
 
 
model-00008-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:40ad2fc8b4230dcf9b7ed44117f077795acef3aabe1cad407366d6dec6b86391
3
- size 4653768046
 
 
 
 
model-00008-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:bf22873f77046371a410e63b9012bc537249525e85fe4410b9833cb96ce99d50
3
- size 5316570900
 
 
 
 
model-00009-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:dabc986ff93c9fae524aa7f893f5a5ca51b360a51ced2e34901a33e4adbfb937
3
- size 4735845921
 
 
 
 
model-00009-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:8aecbea8d37b641bda95a3760b9f3f8523481b9dde015443adbaf4cf628619d4
3
- size 4385332980
 
 
 
 
model-00010-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d9cbdb339bab35eb93e7fc4d23192a779cc10085009bba14b8cc69cd89fd1593
3
- size 4645481926
 
 
 
 
model-00010-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7953f06831fce22a493edf3304cd8d77da6b5409c59b0828ef19f3ae9794f954
3
- size 5316570957
 
 
 
 
model-00011-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:acfbe66924d47ac8387453203f67d7b1c94d846c56093ee7fe930bb7d01dbe7e
3
- size 4653768061
 
 
 
 
model-00011-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:366876c173e6003245fab6824825559b11c3ebcfeeb65119b62d7a9af5829229
3
- size 4333193153
 
 
 
 
model-00012-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2b977cdf64da2190990b81911688306ea11c78db6b3633885a541fd9291df2e7
3
- size 4735845965
 
 
 
 
model-00012-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:8d6201e1dc5abef1c5df9622ba5319ef44d123d7752cac684bf210479fc2c831
3
- size 5324857101
 
 
 
 
model-00013-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:079eec798fd7f6f311b679feb7be3b88c21db90e2c508a174be856246fe7163d
3
- size 4645481892
 
 
 
 
model-00013-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f14c642519e6c042b2cf57c07087d044a4a44f15061889e2216d491dc75ba872
3
- size 5316570956
 
 
 
 
model-00014-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:bafe215768e85ca59160d319482733d10a70c568bca6a95011eae483e1f61974
3
- size 4653768063
 
 
 
 
model-00014-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:a088dd92e2381dffb8606e7d9c3fffa05283e7b22e1b22464b99b817d104d172
3
- size 4385333000
 
 
 
 
model-00015-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:74694b8618092f14c6148cdbb657303d2809a9638834713a85a6d2e2736a2087
3
- size 4735845991
 
 
 
 
model-00015-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:3a1eb94c4e78a2bdcc6c7a86c46d8135fc5b521be42d2bea0f0a4cd9510184c4
3
- size 5316570957
 
 
 
 
model-00016-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:85de0e36c501814acf859e54a4f7b53fbd6929447f9b6ca3e28318fb60ac46ae
3
- size 4645481894
 
 
 
 
model-00016-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c04bf745b3d1aadd8fc47ab8fb70c1589b55ce3c47e72063980e04db7ab7b52
3
- size 4333193165
 
 
 
 
model-00017-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1487d0475f381fe35a6876445432b4ad00a90eaa09330aa62b924816cbb7ef3
3
- size 4653768045
 
 
 
 
model-00017-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0078ef7238ff727affa7c4ed8092766b2b1231969ae04076de8aea8f17afb049
3
- size 5324857103
 
 
 
 
model-00018-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:85215616a269526360e98c37a9f9c0b581b6b659546d343256ba12e7a089fbbc
3
- size 4735845959
 
 
 
 
model-00018-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:3471c74a7c1f5bddcc66b5913d3935b95b2f120e4b7e6863096d2866d44e28d3
3
- size 5316570924
 
 
 
 
model-00019-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:74ee98730727d1ebe1a025700f05a5b8fe2f3c8bf2d6c475e67769c742de1bca
3
- size 4645481926
 
 
 
 
model-00019-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:382ec301b4be7bdc16e0234f7a144c946f8171bb6fcd5d35352f3ff758018947
3
- size 4385332994
 
 
 
 
model-00020-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f2de220562db8d1886d9a31bbe07629c6f88dd6f4c2444bc2494a314b976ce99
3
- size 4653768063
 
 
 
 
model-00020-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2e7aefe87ce91213491c7dced136eb0b9aa18a884f428e50f5f66de8edf10a3f
3
- size 5316570957
 
 
 
 
model-00021-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2bde5c610cbb9e4dd0aacf1a78077b898d09bc00aa924fec736fe8681851628d
3
- size 4735845999
 
 
 
 
model-00021-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d8882b4837ecb9069535a3fbb0f5f86cf973de83833d8af7389a494d3ac5f904
3
- size 4333193125
 
 
 
 
model-00022-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:31d792be1896b6275222a1f851542d8610634994f02367bfb1ce44cdfad65dd9
3
- size 4645481922
 
 
 
 
model-00022-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c22f242ecbdfd17d50992870209a1faea7e069f5e6629fc0a8b0d4988fcf137
3
- size 5324857103
 
 
 
 
model-00023-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:5f201fcffcb0ead8bd75709084169f38af1dd2903508794cb02635127d4d1deb
3
- size 4653768063
 
 
 
 
model-00023-of-00036.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:9c8452eef7543f40181f1b76644e2f04be516ae6ea549feab36550dc38fcc6b9
3
- size 5316570956
 
 
 
 
model-00024-of-00033.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:232e1f0e197a25fad05e0892605846cb93b3209bbfd15dde8faa3ed0a1bd7ebe
3
- size 4735845995