Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,826

Base only

Active filters: 2-bit

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 6 days ago • 112k • 103

EschaLabs/Qwen3.6-35B-A3B-Escha-W2

Text Generation • 7B • Updated 2 days ago • 3.87k • 237

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 22 days ago • 796k • • 1.18k

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 5 days ago • 986k • 431

deepgrove/maple-preview-2bit-mlx

1B • Updated 4 days ago • 473 • 27

AtomicChat/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 284B • Updated 4 days ago • 14.3k • 19

ox-ox/DeepSeek-V4-Flash-0731-gguf-ds4

Text Generation • 284B • Updated 7 days ago • 8.01k • 23

stamsam/maple-preview-gguf

Text Generation • 20B • Updated 3 days ago • 7.83k • 11

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 325k • 123

anoane/DeepSeek-V4-Flash-0731-vllm-moet-sm120-cache

Updated 3 days ago • 10

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 25 days ago • 737k • 168

Rednalreden/DeepSeek-V4-Flash-0731-dwarfstar-q2-gguf

Text Generation • 284B • Updated 8 days ago • 13.5k • 11

Jundot/DeepSeek-V4-Flash-0731-oQ2e-mtp

31B • Updated 6 days ago • 1.68k • 4

mlx-community/DeepSeek-V4-Flash-0731-2.4bit-mixed

Text Generation • 26B • Updated 4 days ago • 909 • 5

MaziyarPanahi/MixTAO-7Bx2-MoE-v8.1-GGUF

Text Generation • 13B • Updated Mar 11, 2024 • 602 • 12

twaggs88/DeepSeek-V4-Flash-REAP25-DSpark-ds4-GGUF

Text Generation • 240B • Updated 6 days ago • 11.7k • 10

FINAL-Bench/POCKET-KR-MLX

Text Generation • 15B • Updated 10 days ago • 743 • 28

schlaflos/DeepSeek-V4-Flash-0731-antirez-ds4-GGUF

Text Generation • 20B • Updated 8 days ago • 5k • 10

Jundot/DeepSeek-V4-Flash-0731-oQ2.5e

32B • Updated 7 days ago • 1.19k • 2

Jundot/DeepSeek-V4-Flash-0731-oQ2e

28B • Updated 6 days ago • 928 • 2

ProCreations/maple-preview-webgpu-v2

Text Generation • Updated 4 days ago • 35 • 2

mlx-community/DeepSeek-V4-Flash-0731-OptiQ-2bit

Text Generation • 26B • Updated 3 days ago • 436 • 2

MaziyarPanahi/Rabbit-7B-DPO-Chat-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 28, 2024 • 245 • 1

MaziyarPanahi/MixTAO-7Bx2-MoE-Instruct-v7.0-GGUF

Text Generation • 13B • Updated Feb 4, 2024 • 459 • 10

MaziyarPanahi/Calme-4x7B-MoE-v0.2-GGUF

Text Generation • 24B • Updated Mar 18, 2024 • 679 • 5

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • 9B • Updated Mar 18, 2024 • 559 • 6

MaziyarPanahi/TowerInstruct-7B-v0.2-EN2ES-GGUF

Text Generation • 7B • Updated Apr 2, 2024 • 930 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • 71B • Updated Jun 20, 2024 • 106k • 19

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 847 • 8

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • 141B • Updated Sep 6, 2024 • 1.59k • 2