Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,440

Base only

Active filters: llama-cpp

mitkox/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

8B • Updated Jan 20, 2025 • 338 • 3

matrixportalx/Dolphin3.0-Llama3.1-8B-GGUF

8B • Updated Jan 20, 2025 • 112 • 1

aiplatforms/ru-uncensored-v2-gguf

Text Generation • 12B • Updated May 7 • 1.3k • 8

asuglia/Qwen2-VL-2B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 2B • Updated Mar 10, 2025 • 705 • 4

typhoon-ai/typhoon2.1-gemma3-12b-gguf

Text Generation • 12B • Updated Jun 11 • 310 • 5

POWERHACK/Qwen3-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated May 10, 2025 • 829 • 1

Manojb/Qwen3-4b-toolcall-gguf-llamacpp-codex

Text Generation • 4B • Updated Sep 25, 2025 • 961 • 9

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 17 • 6

vito95311/Qwen3-Omni-30B-A3B-Thinking-GGUF-INT8FP16

Text Generation • 16B • Updated Sep 28, 2025 • 334 • 19

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 35.5k • 25

AXONVERTEX-AI-RESEARCH/Qwen3-VL-4B-Instruct-Q8_0-GGUF

Image-Text-to-Text • 4B • Updated Nov 1, 2025 • 23 • 1

mauroneto/Jurema-7B-Q4_K_M-GGUF

8B • Updated Nov 8, 2025 • 552 • 6

mauroneto/Jurema-7B-Q8_0-GGUF

8B • Updated Nov 8, 2025 • 58 • 2

infil00p/shieldgemma-2-4b-it-GGUF

Image Classification • 4B • Updated Nov 15, 2025 • 1.07k • 2

Edge-Quant/GLM-4.6V-Flash-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Dec 8, 2025 • 23 • 1

t-tech/T-pro-it-2.1-GGUF

33B • Updated Dec 23, 2025 • 1.24k • 9

wasirmen123/GLM-Z1-32B-0414-Q5_K_M-GGUF

Text Generation • 33B • Updated Jan 5 • 32 • 2

jwest33/gemma-3-4b-null-space-abliterated-RP-writer-GGUF

4B • Updated Jan 9 • 678 • 1

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model-mlx-8Bit

15B • Updated Jan 16 • 8 • 13

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 134 • 5

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Mar 28 • 6.72k • 187

jwest33/ministral-3-3b-instruct-2512-null-space-abliterated-GGUF

Image-Text-to-Text • 4B • Updated Jan 21 • 387 • 4

audarai/Audar-TTS-V1-Turbo

Text-to-Speech • 2B • Updated 6 days ago • 155 • 2

intrect/VELA

Text Generation • 8B • Updated Apr 1 • 145 • 3

EMD123/DictaLM-3.0-1.7B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Feb 3 • 74 • 2

TaidanaHito/STORM-Qwen3-4B-Q4_K_M-GGUF

4B • Updated Feb 3 • 18 • 1

aldigobbler/stt-qwen3-1.7b-merged-GGUF

Text Generation • 2B • Updated Feb 13 • 41 • 2

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated Mar 3 • 2.34k • 9

CorryL/piccolo_gorgone

9B • Updated Mar 11 • 88 • 6

forkjoin-ai/qwen2-audio-7b-instruct-gguf

Text-to-Audio • 8B • Updated Jun 9 • 1.17k • 3