YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
LLaMA2-7B Fused QKV
Custom LLaMA2-7B model with fused QKV projections.
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"vuiseng9/llama2-7b-fused-qkv",
trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained("vuiseng9/llama2-7b-fused-qkv")
inputs = tokenizer("Hello, I'm", return_tensors="pt")
outputs = model.generate(**inputs, max_length=50)
print(tokenizer.decode(outputs[0]))
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support