Update README.md
#1
by ofirzaf - opened
README.md
CHANGED
|
@@ -6,7 +6,7 @@ license: other
|
|
| 6 |
## Description
|
| 7 |
|
| 8 |
FastDraft is a novel and efficient approach for pre-training and aligning a draft model to any LLM to be used with speculative decoding, by incorporating efficient pre-training followed by fine-tuning over synthetic datasets generated by the target model.
|
| 9 |
-
FastDraft was presented in [paper](https://
|
| 10 |
|
| 11 |
This is a draft model that was trained with FastDraft to accompany [Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct).
|
| 12 |
|
|
|
|
| 6 |
## Description
|
| 7 |
|
| 8 |
FastDraft is a novel and efficient approach for pre-training and aligning a draft model to any LLM to be used with speculative decoding, by incorporating efficient pre-training followed by fine-tuning over synthetic datasets generated by the target model.
|
| 9 |
+
FastDraft was presented in [paper](https://huggingface.co/papers/2411.11055) at ACL2025 by Intel Labs.
|
| 10 |
|
| 11 |
This is a draft model that was trained with FastDraft to accompany [Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct).
|
| 12 |
|