Hugging Face's logo

gstaff
/
TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

Transformers
Model card Files
xet
 Community

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

TensorRT-LLM Engine Files for Mistral-7B-instruct-v0.2

This repo contains TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 in single-GPU mode on a RTX 3080Ti GPU.

Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support