Inference Providers
Active filters: int8
Intel/gpt-j-6B-int8-dynamic-inc
Text Generation
• Updated • 32
• 16
Intel/gpt-j-6B-int8-static-inc
Text Generation
• Updated • 33
• 9
DataAgent/llama-7b-alpaca-zh-20k
Updated
ENOT-AutoDL/gpt-j-6B-tensorrt-int8
Text Generation
• Updated • 7
Intel/gpt-j-6B-pytorch-int8-static-inc
Text Generation
• Updated • 35
DataAgent/llama-7b-alpaca-zh-120k
michaelfeil/ct2fast-gpt-j-6b
Updated • 2
• 2
michaelfeil/ct2fast-pythia-12b
michaelfeil/ct2fast-pythia-160m
Updated • 19
• 1
michaelfeil/ct2fast-gpt-neox-20b
michaelfeil/ct2fast-Pythia-Chat-Base-7B
Updated • 5
• 1
michaelfeil/ct2fast-pythia-2.8b
Updated • 5
• 1
michaelfeil/ct2fast-pythia-6.9b
Updated • 6
• 1
michaelfeil/ct2fast-stablelm-7b-sft-v7-epoch-3
Text Generation
• Updated • 5
michaelfeil/ct2fast-stablelm-tuned-alpha-7b
michaelfeil/ct2fast-stablelm-base-alpha-3b
michaelfeil/ct2fast-stablelm-tuned-alpha-3b
michaelfeil/ct2fast-RedPajama-INCITE-Instruct-3B-v1
Updated • 1
• 3
michaelfeil/ct2fast-GPT-JT-6B-v0
Text Generation
• Updated • 5
• 1
Intel/bert-large-uncased-rte-int8-dynamic-inc
Text Classification
• Updated • 6
Intel/bert-large-uncased-rte-int8-static-inc
Text Classification
• Updated • 6
Intel/distilbert-base-uncased-MRPC-int8-dynamic-inc
Text Classification
• Updated • 6
• 1
Intel/distilbert-base-uncased-MRPC-int8-static-inc
Text Classification
• Updated • 5
Intel/albert-base-v2-MRPC-int8-inc
Text Classification
• Updated • 12
Intel/bert-base-uncased-CoLA-int8-inc
Text Classification
• Updated • 10
Intel/bert-large-uncased-cola-int8-inc
Text Classification
• Updated • 4
Intel/bert-base-uncased-STS-B-int8-inc
Text Classification
• Updated • 6
Intel/bert-base-cased-finetuned-sst2-int8-inc
Text Classification
• Updated • 9
Intel/bert-base-uncased-QNLI-int8-inc
Text Classification
• Updated • 7
michaelfeil/ct2fast-RedPajama-INCITE-Chat-7B-v0.1
Updated • 3
• 1