Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

464

Base only

Active filters: fp4

AlekseyCalvin/QWEN_IMAGE_fp4_w_AbliteratedTE_Diffusers

Text-to-Image • 11B • Updated Aug 6, 2025 • 65 • 9

imgailab/flux1-trtx-dev-fp4-blackwell

Updated Aug 12, 2025 • 4 • 1

imgailab/flux1-trtx-schnell-fp4-blackwell

Updated Aug 12, 2025 • 2 • 1

llmat/Mistral-7B-Instruct-v0.3-NVFP4

Text Generation • 4B • Updated Aug 27, 2025 • 205

llmat/Mistral-Small-Instruct-2409-NVFP4

Text Generation • 13B • Updated Aug 27, 2025 • 10

2imi9/gpt-oss-20B-NVFP4A16-BF16

Text Generation • 21B • Updated Dec 19, 2025 • 55 • 5

nvidia/Phi-4-reasoning-plus-NVFP4

8B • Updated Sep 5, 2025 • 475k • 11

nvidia/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Sep 9, 2025 • 160k • 21

nvidia/Qwen3-14B-NVFP4

Text Generation • 8B • Updated Sep 9, 2025 • 124k • 12

nvidia/Qwen3-32B-NVFP4

Text Generation • 17B • Updated Sep 9, 2025 • 88.2k • 17

nvidia/Qwen2.5-VL-7B-Instruct-NVFP4

Text Generation • 5B • Updated Dec 6, 2025 • 25.3k • 15

xxrjun/DeepSeek-R1-0528-FP4

394B • Updated Sep 27, 2025 • 1

Sunbird/Sunflower-14B-4bit-fp4-bnb

Text Generation • 15B • Updated Oct 9, 2025

Sunbird/Sunflower-32B-4bit-fp4-bnb

Text Generation • 33B • Updated Oct 9, 2025

RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4

Text Generation • 133B • Updated Apr 28 • 5.76k • 15

RedHatAI/Llama-3.1-8B-Instruct-NVFP4

Text Generation • 5B • Updated Nov 21, 2025 • 20.3k • 2

RedHatAI/Qwen3-14B-NVFP4

Text Generation • 9B • Updated Nov 21, 2025 • 6.42k • 1

RedHatAI/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Nov 21, 2025 • 5.99k • 2

RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-NVFP4

Text Generation • 14B • Updated Dec 4, 2025 • 6.49k • 10

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-NVFP4

Text Generation • 229B • Updated Dec 9, 2025 • 205 • 6

RedHatAI/Qwen3-235B-A22B-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 622 • 1

RedHatAI/Qwen3-235B-A22B-Instruct-2507-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 3.65k • 4

prithivMLmods/Nanonets-OCR2-3B-AWQ-nvfp4

Image-Text-to-Text • 3B • Updated Nov 6, 2025 • 20

trithemius/Velvet-14B-nvfp4

8B • Updated Dec 11, 2025 • 5

RedHatAI/GLM-4.6-NVFP4

Text Generation • 199B • Updated Mar 12 • 47

josephdowling10/Mixtral-8x7B-Instruct-v0.1-NVFP4

Text Generation • 23B • Updated Dec 16, 2025 • 17

Shifusen/L3.3-70B-Magnum-v4-SE-NVFP4

Text Generation • 41B • Updated Dec 19, 2025 • 14

Firworks/Snowpiercer-15B-v4-nvfp4

9B • Updated Dec 18, 2025 • 3

cybermotaz/nemotron3-nano-nvfp4-w4a16

Text Generation • 18B • Updated Dec 18, 2025 • 3.04k • 13

Shifusen/Strawberrylemonade-L3-70B-v1.2-NVFP4

Text Generation • 41B • Updated Dec 19, 2025 • 44