deepseek-ai
/

DeepSeek-R1-Distill-Llama-70B

Text Generation

text-generation-inference

Model card Files Files and versions

Resources

View closed (2)

I built a unified wrapper for llmcompressor, llama.cpp & coremltools. Looking for LLM users to help me break it!

#24 opened about 1 month ago by

Update README.md

#23 opened 3 months ago by

Create Zeng

#22 opened 4 months ago by

Tool Use

#21 opened about 1 year ago by

使用llama-factory训练70B最低的硬件配置是什么？

#20 opened about 1 year ago by

Do not require reasoning but just the ouput

#19 opened about 1 year ago by

chat_template中为什么要把assistant角色中的<think>过程切掉

#18 opened about 1 year ago by

能否发布一个awq版本的模型：deepseek-r1-distill-llama-70b-AWQ

#17 opened about 1 year ago by

Update README.md

#16 opened about 1 year ago by

shubham-kothari

chnsmth

#15 opened about 1 year ago by

Does DeepSeek-Llama-70B support tensor parallelism for multi-GPU inference?

#14 opened about 1 year ago by

weight files naming is not regular rule

#13 opened about 1 year ago by

How much vram do you need?

#12 opened about 1 year ago by

Upload IMG_4815.jpeg

#11 opened about 1 year ago by

Amazon Sagemaker deployment failing with CUDA OutOfMemory error

#10 opened about 1 year ago by

<thinking> is the proper tag?

#8 opened about 1 year ago by

Add pipeline tag

#7 opened about 1 year ago by

Template

#6 opened about 1 year ago by

Lora

#4 opened about 1 year ago by

SFT (Non-RL) distillation is this good on a sub-100B model?

#2 opened about 1 year ago by

Lfg

#1 opened about 1 year ago by