Meta Llama 3 8B
Forkjoin.ai conversion of meta-llama/Meta-Llama-3-8B to GGUF format for edge deployment.
Model Details
- Source Model: meta-llama/Meta-Llama-3-8B
- Format: GGUF
- Converted by: Forkjoin.ai
Usage
With llama.cpp
./llama-cli -m meta-llama-3-8b-gguf.gguf -p "Your prompt here" -n 256
With Ollama
Create a Modelfile:
FROM ./meta-llama-3-8b-gguf.gguf
ollama create meta-llama-3-8b-gguf -f Modelfile
ollama run meta-llama-3-8b-gguf
About Forkjoin.ai
Forkjoin.ai runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.
All conversions are optimized for edge deployment within browser and mobile memory constraints.
License
Apache 2.0 (follows upstream model license)
- Downloads last month
- 14
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for forkjoin-ai/meta-llama-3-8b-gguf
Base model
meta-llama/Meta-Llama-3-8B