Model Catalog

30 items
Applied Filters
Author avatar
unsloth /

Qwen3.5-397B-A17B-GGUF

Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
MXFP4_MOE
GPU 4x Nvidia A100
$ 10
Author avatar
Qwen /

Qwen3-Embedding-8B

Feature Extraction
vLLM
Accelerated vLLM
INF2 2x Cores
$ 1.95
Author avatar
Qwen /

Qwen3-Embedding-4B

Feature Extraction
vLLM
Accelerated vLLM
INF2 2x Cores
$ 1.95
Author avatar
Qwen /

Qwen3-Embedding-0.6B

Feature Extraction
vLLM
Accelerated vLLM
INF2 2x Cores
$ 1.95
Author avatar
unsloth /

Qwen3-Coder-Next-GGUF

Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia A100
$ 2.5
Author avatar
Qwen /

Qwen3-VL-30B-A3B-Thinking

Image-Text-to-Text
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Author avatar
Qwen /

Qwen3-VL-8B-Instruct

Image-Text-to-Text
vLLM
Accelerated vLLM
GPU 1x Nvidia A100
$ 2.5
Author avatar
Qwen /

Qwen3-Embedding-8B-GGUF

Feature Extraction
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Author avatar
Qwen /

Qwen3-Embedding-4B-GGUF

Feature Extraction
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Author avatar
Qwen /

Qwen3-Embedding-0.6B-GGUF

Feature Extraction
Llama.cpp
Accelerated llama.cpp
F16
CPU 2x Intel Sapphire Rapids
$ 0.067
Author avatar
Qwen /

Qwen3-Next-80B-A3B-Instruct

Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
Author avatar
Qwen /

Qwen3-Next-80B-A3B-Thinking

Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
Author avatar
Qwen /

Qwen3-32B

Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Author avatar
Qwen /

Qwen3-Embedding-0.6B

Deployed 160 times
Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
Author avatar
Qwen /

Qwen3-Embedding-4B

Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
Author avatar
Qwen /

Qwen3-Embedding-8B

Deployed 198 times
Feature Extraction
TEI
Accelerated Text Embeddings Inference
GPU 1x Nvidia L4
$ 0.8
Author avatar
Qwen /

Qwen3-1.7B

Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L4
$ 0.8
Author avatar
ggml-org /

Qwen2.5-VL-3B-Instruct-GGUF

Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Author avatar
ggml-org /

Qwen2.5-VL-7B-Instruct-GGUF

Image-Text-to-Text
Llama.cpp
Accelerated llama.cpp
Q8_0
GPU 1x Nvidia T4
$ 0.5
Author avatar
beethogedeon /

gte-Qwen2-7B-instruct-Q4_K_M-GGUF

Sentence Embeddings
Llama.cpp
Accelerated llama.cpp
Q4_K_M
CPU 8x Intel Sapphire Rapids
$ 0.268
Author avatar
Qwen /

Qwen2.5-VL-7B-Instruct

Deployed 248 times
Image-Text-to-Text
vLLM
Accelerated vLLM
GPU 1x Nvidia A100
$ 2.5
Author avatar
bartowski /

Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation
Llama.cpp
Accelerated llama.cpp
Q4_K_M
GPU 1x Nvidia L4
$ 0.8
Author avatar
Qwen /

QwQ-32B

Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Author avatar
Qwen /

Qwen2.5-72B-Instruct

Text Generation
vLLM
Accelerated vLLM
GPU 4x Nvidia A100
$ 10
Author avatar
Qwen /

Qwen2.5-14B-Instruct

Deployed 159 times
Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Author avatar
Qwen /

Qwen2.5-Coder-7B-Instruct

Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
Author avatar
Qwen /

Qwen2.5-7B-Instruct

Deployed 285 times
Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
Author avatar
Qwen /

Qwen2.5-Coder-32B-Instruct

Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Author avatar
deepseek-ai /

DeepSeek-R1-Distill-Qwen-32B

Text Generation
vLLM
Accelerated vLLM
GPU 2x Nvidia A100
$ 5
Author avatar
Qwen /

Qwen2.5-Coder-14B-Instruct

Text Generation
vLLM
Accelerated vLLM
GPU 1x Nvidia L40S
$ 1.8
You can try extending your search to .