charlescao2023
/

vicuna-13b-v1.5-medusa1-3head

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

base: include Llama base model and medusa head head: only medusa head

convert

prepare medusa

git clone https://github.com/FasterDecoding/Medusa.git
cd Medusa
pip install -e .

python3 medusa_model_demo.py -m base -o head --use-full-key --verbose

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support