Model Catalog
26 items
unsloth /
Qwen3-Coder-Next-GGUF
8
Deployed 8 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia A100
$ 2.5
Qwen /
Qwen3-VL-30B-A3B-Thinking
38
Deployed 38 times
Image-Text-to-Text
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Qwen /
Qwen3-VL-8B-Instruct
109
Deployed 109 times
Image-Text-to-Text
vLLM
Accelerated vLLM
GPU 1x Nvidia A100
$ 2.5
Qwen /
Qwen3-Embedding-8B-GGUF
21
Deployed 21 times
Feature Extraction
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Qwen /
Qwen3-Embedding-4B-GGUF
12
Deployed 12 times
Feature Extraction
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Qwen /
Qwen3-Embedding-0.6B-GGUF
18
Deployed 18 times
Feature Extraction
Llama.cpp
Accelerated llama.cpp
F16
CPU 2x Intel Sapphire Rapids
$ 0.067
Qwen /
Qwen3-Next-80B-A3B-Instruct
35
Deployed 35 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
Qwen /
Qwen3-Next-80B-A3B-Thinking
13
Deployed 13 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
Qwen /
Qwen3-32B
91
Deployed 91 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Qwen /
Qwen3-Embedding-0.6B
155
Deployed 155 times
Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-Embedding-4B
109
Deployed 109 times
Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-Embedding-8B
192
Deployed 192 times
Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen3-1.7B
117
Deployed 117 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
ggml-org /
Qwen2.5-VL-3B-Instruct-GGUF
45
Deployed 45 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
ggml-org /
Qwen2.5-VL-7B-Instruct-GGUF
49
Deployed 49 times
Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
beethogedeon /
gte-Qwen2-7B-instruct-Q4_K_M-GGUF
25
Deployed 25 times
Sentence Embeddings
Llama.cpp
Accelerated llama.cpp
Q4_K_M
CPU 8x Intel Sapphire Rapids
$ 0.268
Qwen /
Qwen2.5-VL-7B-Instruct
238
Deployed 238 times
Image-Text-to-Text
vLLM
Accelerated vLLM
GPU 1x Nvidia A100
$ 2.5
Qwen /
Qwen2.5-Coder-32B-Instruct
118
Deployed 118 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Qwen /
Qwen2.5-72B-Instruct
46
Deployed 46 times
Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
bartowski /
Qwen2.5-Coder-32B-Instruct-GGUF
65
Deployed 65 times
Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
Qwen /
Qwen2.5-Coder-7B-Instruct
69
Deployed 69 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
Qwen /
Qwen2.5-14B-Instruct
158
Deployed 158 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Qwen /
Qwen2.5-7B-Instruct
273
Deployed 273 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
Qwen /
QwQ-32B
62
Deployed 62 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
deepseek-ai /
DeepSeek-R1-Distill-Qwen-32B
140
Deployed 140 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Qwen /
Qwen2.5-Coder-14B-Instruct
31
Deployed 31 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
You can try extending your search to .