MPI-vLLM Test Models - a wenyiwang Collection

wenyiwang 's Collections

GGUF CPU Testing

MPI-vLLM Test Models

MPI-vLLM Test Models

updated Nov 6, 2025

deepseek-ai/deepseek-coder-33b-instruct

Text Generation • 33B • Updated Mar 7, 2024 • 4.2k • 566
meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Jun 18, 2025 • 1.34M • • 4.49k
meta-llama/Meta-Llama-3-8B

Text Generation • 8B • Updated Sep 27, 2024 • 3.3M • • 6.52k
Qwen/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 12.5M • • 1.22k
facebook/opt-1.3b

Text Generation • Updated Sep 15, 2023 • 218k • 184
meta-llama/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Dec 21, 2024 • 494k • • 2.73k
Qwen/Qwen3-4B-Instruct-2507

Text Generation • 4B • Updated Sep 17, 2025 • 9.69M • • 813
deepseek-ai/DeepSeek-V3

Text Generation • 685B • Updated Mar 27, 2025 • 893k • • 4.06k
Qwen/Qwen3-30B-A3B-Instruct-2507

Text Generation • Updated Sep 17, 2025 • 991k • • 801
Qwen/Qwen3-235B-A22B-Instruct-2507

Text Generation • Updated Sep 17, 2025 • 160k • • 773
meta-llama/Llama-2-13b-chat-hf

Text Generation • Updated Apr 17, 2024 • 158k • • 1.11k
tiiuae/falcon-40b

Text Generation • 42B • Updated Aug 9, 2024 • 19.8k • 2.44k