Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

594

Base only

Active filters: fp4

FreedomAISVR/Qwen3.5-4B-Instruct-MTP-MXFP4-GGUF

Text Generation • 0.3B • Updated May 25 • 93

FreedomAISVR/Qwen3.5-9B-Instruct-MTP-MXFP4-GGUF

Text Generation • 0.5B • Updated May 25 • 1.45k

crushleorey/Qwopus3.6-27B-v2-NVFP4

Image-Text-to-Text • 15B • Updated May 26 • 14.5k • 6

dlsxj101/A.X-3.1-NVFP4

Text Generation • 18B • Updated Jun 7 • 11 • 2

giangndm/qwen3-30b-omni-text-only-nvfp4

Text Generation • 17B • Updated May 29 • 7

lemuralabs/Step-3.7-Flash-MXFP4-mlx

Image-Text-to-Text • 38B • Updated 19 days ago • 184

sakamakismile/LFM2.5-8B-A1B-NVFP4

Text Generation • 5B • Updated May 31 • 1.24k • 8

coolthor/Sulphur-2-distilled-NVFP4

Text-to-Video • Updated Jun 2 • 1.44k • 4

Reza2kn/Cosmos3-Nano-NVFP4-AWQ

Text-to-Image • Updated Jun 2 • 21 • 5

sakamakismile/Huihui-LFM2.5-8B-A1B-abliterated-NVFP4

Text Generation • 5B • Updated Jun 2 • 297 • 4

coolthor/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-W4A4

Image-Text-to-Text • 21B • Updated Jun 2 • 453

hoja-solutions/Llama-3.1-70B-LatamGPT-SFT-1.0-NVFP4

Text Generation • 41B • Updated Jun 2 • 168

TentaFlow/Bielik-PL-Minitron-7B-NVFP4

Text Generation • 4B • Updated Jun 2 • 224

TentaFlow/Bielik-1.5B-NVFP4

Text Generation • 0.9B • Updated Jun 2 • 30 • 1

TentaFlow/Bielik-4.5B-v3.0-Instruct-NVFP4

Text Generation • 3B • Updated Jun 2 • 10

TentaFlow/TentaGuard-NVFP4

Text Classification • 0.5B • Updated Jun 2 • 6

aastalll/Qwen3.5-35B-A3B-NVFP4-MTP

Image-Text-to-Text • 21B • Updated Jun 3 • 33

AxionML/Gemma-4-12B-NVFP4

Image-Text-to-Text • 8B • Updated Jun 4 • 5.35k • 8

Reza2kn/gemma-4-26B-A4B-it-assistant-NVFP4

Text Generation • Updated Jun 4 • 29 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-MLXFP4

Image-Text-to-Text • 4B • Updated Jun 21 • 723 • 3

melcheikh/gemma-4-31B-it-qat-NVFP4-Blackwell

Text Generation • 17B • Updated Jun 8 • 1.17k • 4

melcheikh/gemma-4-31B-it-qat-assistant-NVFP4-Blackwell

Text Generation • 0.4B • Updated Jun 8 • 91 • 4

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4

Text Generation • 8B • Updated Jul 15 • 219 • 1

sakamakismile/LFM2.5-1.2B-JP-202606-NVFP4

Text Generation • 0.8B • Updated Jun 6 • 12 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4-FP8

Text Generation • 8B • Updated Jul 15 • 1.89k

RazielXYZ/Nex-N2-Pro-NVFP4

Text Generation • Updated Jun 6 • 96 • 5

JongYeop/Qwen3-30B-A3B-NVFP4-W4A4

Text Generation • 17B • Updated Jun 7 • 32

hackerwasii/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Jun 7 • 9

Reza2kn/rf-detr-segmentation-NVFP4

Image Segmentation • Updated Jun 8 • 12

FreedomAISVR/Gemma-4-12B-it-NVFP4-GGUF

Text Generation • 12B • Updated 7 days ago • 1.61k • 2