Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

613

Base only

Active filters: llm-compressor

lyf/Huihui-gemma-4-31B-it-abliterated-v2-NVFP4

Image-Text-to-Text • 18B • Updated Apr 12 • 2.8k • 3

Vishva007/Qwen3.5-4B-W4A16-AutoRound

Image-Text-to-Text • 2B • Updated 3 days ago • 80

YuYu1015/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-NVFP4

Text Generation • 17B • Updated Apr 12 • 233

YuYu1015/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-NVFP4

Text Generation • 7B • Updated Apr 13 • 151 • 1

YuYu1015/Huihui-Qwen3.5-4B-Claude-4.6-Opus-abliterated-NVFP4

Text Generation • 3B • Updated Apr 13 • 16

YuYu1015/Huihui-Qwopus3.5-27B-v3-abliterated-NVFP4

Text Generation • 19B • Updated Apr 13 • 6 • 1

dangvansam/chandra-ocr-2-FP8-dynamic

Image-Text-to-Text • 5B • Updated May 26 • 1.99k • 1

jamesleeht/gemma-4-31B-it-FP8-block-8192

Image-Text-to-Text • 31B • Updated Apr 15 • 9

RedHatAI/Qwen3.5-4B-quantized.w8a8

Image-Text-to-Text • 5B • Updated Apr 16 • 8.11k • 1

ghecko78/Voxtral-Mini-4B-Realtime-2602-FP8-Dynamic

Automatic Speech Recognition • 4B • Updated May 22 • 91 • 3

wjacksonrd/prometheus-8x7b-v2.0-W4A16

Text Generation • 6B • Updated Apr 17 • 13

binedge/dots.mocr-FP8

Image-Text-to-Text • 3B • Updated Apr 16 • 1.23k • 1

RedHatAI/Qwen3.5-9B-quantized.w8a8

Image-Text-to-Text • 9B • Updated Apr 16 • 5.67k • 2

LittleNicky55/MiniMax-M2.7-abliterated-Heretic-FP8

Text Generation • 229B • Updated Apr 19 • 80 • 2

binedge/Qwen3-Embedding-0.6B-FP8

Feature Extraction • 0.6B • Updated Apr 19 • 246 • 1

0ppxnhximxr/gemma-4-31B-it-heretic-FP8-Dynamic

Image-Text-to-Text • 33B • Updated Apr 19 • 680 • 1

lovethayo/MiniMax-M2.5-FP8-INT4-AWQ

Text Generation • 39B • Updated Apr 20 • 15

AMbaye018/sarvam-30b-AWQ-then-FP8

Text Generation • 7B • Updated Apr 22 • 13

ocicek/Qwen3.6-27B-NVFP4

Text Generation • 17B • Updated May 2 • 372 • 7

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Text Generation • 21B • Updated Jun 8 • 1.84k • 2

RedHatAI/Qwen3.5-9B-quantized.w4a16

Image-Text-to-Text • 9B • Updated May 11 • 177k • 9

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 28 • 1

RedHatAI/Qwen3.6-35B-A3B-FP8-dynamic

Image-Text-to-Text • 35B • Updated Jul 13 • 2.34k • 5

RedHatAI/Kimi-K2.6-FP8-BLOCK

Image-Text-to-Text • 1T • Updated Jul 16 • 4.17k • 4

RedHatAI/Kimi-K2.6-NVFP4

Image-Text-to-Text • Updated Jul 17 • 150 • 13

depop-ml/Qwen3.5-9B-FP8-Dynamic

Image-Text-to-Text • 9B • Updated May 27 • 380 • 3

RedHatAI/Qwen3.6-35B-A3B-FP8

Image-Text-to-Text • 36B • Updated about 1 month ago • 8.85k

zdy1995love/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 74B • Updated May 3 • 265 • 3

plezan/Mistral-Medium-3.5-128B-W4A16

Image-Text-to-Text • 22B • Updated May 4 • 1.06k • 5

darkc0de/gemma-4-31B-it-heretic-FP8-Dynamic-Q4_K_M-GGUF

Image-Text-to-Text • 31B • Updated May 2 • 793 • 3