-
-
-
-
-
-
Inference Providers
Active filters:
INT4
RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
95
•
1
iSolver-AI/test123-quantized.w4a16
Image-to-Text
•
Updated
•
2
RedHatAI/phi-4-quantized.w4a16
Text Generation
•
3B
•
Updated
•
311
•
4
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text
•
5B
•
Updated
•
1.27k
•
10
RedHatAI/DeepSeek-R1-quantized.w4a16
Text Generation
•
104B
•
Updated
•
8
•
7
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text
•
20B
•
Updated
•
192k
•
12
RedHatAI/Qwen3-4B-quantized.w4a16
Text Generation
•
1B
•
Updated
•
3.77k
•
4
RedHatAI/Qwen3-1.7B-quantized.w4a16
Text Generation
•
0.8B
•
Updated
•
80
•
3
RedHatAI/Qwen3-0.6B-quantized.w4a16
Text Generation
•
0.4B
•
Updated
•
260
RedHatAI/Qwen3-32B-quantized.w4a16
Text Generation
•
6B
•
Updated
•
1.21k
•
11
RedHatAI/Qwen3-14B-quantized.w4a16
Text Generation
•
3B
•
Updated
•
426
RedHatAI/Qwen3-8B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
6.05k
•
3
WaveCut/PixelWave_FLUX.1-schnell_04_SVDQuant-int4
Text-to-Image
•
Updated
•
90
•
1
RedHatAI/Qwen3-30B-A3B-quantized.w4a16
Text Generation
•
5B
•
Updated
•
1.41k
•
5
RedHatAI/DeepSeek-R1-0528-quantized.w4a16
Text Generation
•
104B
•
Updated
•
242
•
12
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16
Image-Text-to-Text
•
59B
•
Updated
•
132
•
1
RedHatAI/Kimi-K2-Instruct-quantized.w4a16
Text Generation
•
146B
•
Updated
•
278
•
12
RedHatAI/Devstral-Small-2507-quantized.w4a16
Text Generation
•
4B
•
Updated
•
28
•
1
ChibuUkachi/Qwen3-4B-Instruct-2507.w4a16
Text Generation
•
1B
•
Updated
•
208
inference-optimization/Qwen3-4B-Thinking-2507.w4a16
Text Generation
•
1B
•
Updated
•
55
inference-optimization/Qwen3-4B-Instruct-2507.w4a16
Text Generation
•
1B
•
Updated
•
6
inference-optimization/Qwen3-30B-A3B-Thinking-2507.w4a16
Text Generation
•
5B
•
Updated
•
3
RedHatAI/Qwen3-30B-A3B-Instruct-2507.w4a16
Text Generation
•
5B
•
Updated
•
96
RedHatAI/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
Text Generation
•
Updated
•
84
EmbeddedLLM/Qwen3-VL-30B-A3B-Instruct.w4a16
Text Generation
•
5B
•
Updated
•
59
EmbeddedLLM/Qwen3-VL-30B-A3B-Thinking.w4a16
Text Generation
•
5B
•
Updated
•
8