DeepSeek-V2-Lite EAGLE3 Draft Model

EAGLE3 speculative decoding draft model for DeepSeek-V2-Lite.

Model Details

  • Target Model: deepseek-ai/DeepSeek-V2-Lite
  • Training Data: ShareGPT
  • Epochs: 10
  • Framework: SpecForge
  • Author: Yuseon Choi

Usage

This model is designed to be used with EAGLE3 speculative decoding.

Downloads last month
13
Safetensors
Model size
0.2B params
Tensor type
I64
·
BF16
·
BOOL
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yschoi31/DeepSeek-V2-Lite-Eagle3

Finetuned
(27)
this model

Dataset used to train yschoi31/DeepSeek-V2-Lite-Eagle3