Inference Providers
Active filters: nncf
AIFunOver/Qwen2.5-7B-Instruct-openvino-fp16
Text Generation
• Updated • 3
AIFunOver/Qwen2.5-7B-Instruct-openvino-4bit
Text Generation
• Updated • 13
AIFunOver/Llama-3.2-1B-Instruct-openvino-8bit
Text Generation
• Updated • 4
AIFunOver/Llama-3.2-1B-Instruct-openvino-fp16
Text Generation
• Updated • 8
AIFunOver/Llama-3.2-1B-Instruct-openvino-4bit
Text Generation
• Updated • 19
• 1
AIFunOver/Llama-3.2-3B-Instruct-openvino-8bit
Text Generation
• Updated • 10
• 1
AIFunOver/Llama-3.2-3B-Instruct-openvino-fp16
Text Generation
• Updated • 7
AIFunOver/Llama-3.2-3B-Instruct-openvino-4bit
Text Generation
• Updated • 19
AIFunOver/Llama-3.1-8B-Instruct-openvino-8bit
Text Generation
• Updated • 6
AIFunOver/Llama-3.1-8B-Instruct-openvino-fp16
Text Generation
• Updated • 5
AIFunOver/Llama-3.1-8B-Instruct-openvino-4bit
Text Generation
• Updated • 16
AIFunOver/Llama-2-7b-hf-openvino-8bit
Text Generation
• Updated • 12
• 1
AIFunOver/Llama-2-7b-hf-openvino-fp16
Text Generation
• Updated • 15
AIFunOver/Llama-2-7b-hf-openvino-4bit
Text Generation
• Updated • 9
• 1
AIFunOver/Llama-2-13b-hf-openvino-8bit
Text Generation
• Updated • 8
AIFunOver/Llama-2-13b-hf-openvino-fp16
Text Generation
• Updated • 5
NikolayKozloff/MKLLM-7B-Instruct-openvino-4bit
Updated • 2
• 1
NikolayKozloff/MKLLM-7B-Instruct-openvino-8bit
Updated • 6
• 1
AIFunOver/Llama-2-13b-hf-openvino-4bit
Text Generation
• Updated • 4
AIFunOver/Qwen2.5-Coder-7B-Instruct-openvino-8bit
Text Generation
• Updated • 4
AIFunOver/Qwen2.5-Coder-7B-Instruct-openvino-fp16
Text Generation
• Updated • 8
• 1
AIFunOver/Qwen2.5-Coder-7B-Instruct-openvino-4bit
Text Generation
• Updated • 13
AIFunOver/Qwen2.5-1.5B-Instruct-openvino-8bit
Text Generation
• Updated • 1
AIFunOver/Qwen2.5-1.5B-Instruct-openvino-fp16
Text Generation
• Updated • 6
AIFunOver/Qwen2.5-1.5B-Instruct-openvino-4bit
Text Generation
• Updated • 5
AIFunOver/stable-diffusion-v1-5-openvino-fp16
Text-to-Image
• Updated AIFunOver/sdxl-turbo-openvino-8bit
Text-to-Image
• Updated AIFunOver/sdxl-turbo-openvino-fp16
Text-to-Image
• Updated AIFunOver/FLUX.1-dev-openvino-fp16
Text-to-Image
• Updated AIFunOver/glm-4-9b-chat-1m-openvino-8bit