Inference Providers
Active filters: nncf
HelloSun/inswapper-Openvino
Image-to-Image • Updated • 1
alanfzc/gliner2.5-multi-v1-int8-ov
Token Classification • Updated • 39
• 1
echarlaix/distilgpt2-openvino-4bit
Text Generation • Updated • 74
echarlaix/distilbert-base-uncased-distilled-squad-openvino-8bit
Question Answering • Updated • 68
emmacall/Phi-3-mini-4k-instruct-openvino-4bit
Text Generation • Updated • 19
riacheruvu/Qwen2-7B-Instruct-openvino-4bit
Text Generation • Updated • 5
riacheruvu/Qwen2-7B-Instruct-openvino-8bit
Text Generation • Updated • 6
fiorezhang/Qwen2-7B-Instruct-openvino-4bit
Text Generation • Updated • 4
malcolmchan/Phi-3-mini-4k-instruct-openvino-8bit
Text Generation • Updated • 7
emmacall/Phi-3-medium-4k-instruct-openvino-4bit
Text Generation • Updated • 10
elucidator8918/Lynx-8B-Instruct-4bit
Text Generation • Updated • 17
AlexKoff88/Phi-3-mini-4k-instruct-openvino-4bit
Text Generation • Updated • 11
AlexKoff88/Phi-3-mini-4k-instruct-openvino-8bit
Text Generation • Updated • 12
yujiepan/llama-2-tiny-3layers-random-openvino-8bit
Text Generation • Updated • 26
yujiepan/mixtral-8xtiny-random-openvino-8bit
Text Generation • Updated • 92
• 1
FM-1976/stablelm-zephyr-3b-openvino-4bit
Updated • 16
riacheruvu/phi-2-openvino-8bit
Text Generation • Updated • 15
chgk13/Qwen2-0.5B-openvino-8bit
Text Generation • Updated • 13
AlexKoff88/TinyLlama-1.1B-Chat-v1.0-openvino-4bit
Updated • 14
AlexKoff88/opt-125m-openvino-4bit
Text Generation • Updated • 15
AlexKoff88/Phi-3.5-mini-instruct-openvino-fp16
Text Generation • Updated • 31
AlexKoff88/Phi-3.5-mini-instruct-openvino-4bit
Text Generation • Updated • 32
AlexKoff88/Phi-3.5-mini-instruct-openvino-8bit
Text Generation • Updated • 31
AIFunOver/Phi-3.5-mini-instruct-openvino-fp16
Text Generation • Updated • 51
AIFunOver/Phi-3.5-mini-instruct-openvino-4bit
Text Generation • Updated • 31
AIFunOver/SmolLM2-1.7B-Instruct-openvino-8bit
Text Generation • Updated • 27
AIFunOver/SmolLM2-1.7B-Instruct-openvino-fp16
Text Generation • Updated • 28
AIFunOver/SmolLM2-1.7B-Instruct-openvino-4bit
Text Generation • Updated • 38
AIFunOver/SmolLM2-360M-Instruct-openvino-8bit
Text Generation • Updated • 105
AIFunOver/SmolLM2-360M-Instruct-openvino-fp16
Text Generation • Updated • 103