Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

227

Base only

Active filters: cpu-inference

StentorLabs/Stentor-30M

Text Generation • 30.4M • Updated Feb 21 • 63 • 3

mradermacher/Stentor-30M-GGUF

Text Generation • 30.4M • Updated Feb 21 • 311 • 3

changcheng967/flashlm-v5.2-nova-ignition

Updated Feb 21 • 7 • 1

mradermacher/Stentor-30M-i1-GGUF

Text Generation • 30.4M • Updated Feb 21 • 320 • 2

StentorLabs/Stentor2-12M-Preview

Text Generation • 12.3M • Updated Feb 25 • 71 • 1

antonisbast/Llama-3.2-3B-Gordon-Ramsay-DPO-GGUF

Text Generation • 3B • Updated Feb 25 • 21

qoranet/QORA-Vision-Image

Zero-Shot Image Classification • Updated Mar 1 • 10 • 1

qoranet/QORA-Vision-Video

Video Classification • Updated Mar 1 • 17

Trillim/BitNet-Search-LoRA-TRNQ

qoranet/QORA-TTS-12Hz-0.6B

Text-to-Speech • Updated Apr 6 • 16 • 1

StentorLabs/Stentor2-12M

Text Generation • 12.3M • Updated Mar 8 • 18 • 2

romara-labs/Qwen3-TTS-12Hz-0.6B-Base-ONNX

Text-to-Speech • Updated Mar 9 • 1

romara-labs/Qwen3-TTS-12Hz-1.7B-Base-ONNX

Text-to-Speech • Updated Mar 15 • 2

temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1-q8

Token Classification • Updated Mar 16 • 11

StentorLabs/Stentor2-30M

Text Generation • 30.4M • Updated Mar 21 • 17 • 2

romara-labs/MOSS-TTS-Local-Transformer-ONNX

Text-to-Speech • Updated Mar 14 • 1

Daumee/Qwen3-ASR-0.6B-ONNX-CPU

Automatic Speech Recognition • Updated Mar 17 • 80 • 13

ansh0x/ace-0.5b-gguf

Text Generation • 0.5B • Updated Mar 24 • 21 • 1

diffuse-cpp/LLaDA-8B-Instruct-GGUF

Text Generation • 8B • Updated Mar 31 • 307 • 7

wolfofbackstreet/Qwen3-ASR-0.6B-ONNX-CPU

Automatic Speech Recognition • Updated Mar 22 • 9 • 3

diffuse-cpp/Dream-v0-Instruct-7B-GGUF

Text Generation • 8B • Updated Mar 31 • 201 • 1

rasatavohary/BitMamba-2-0.25B

Text Generation • Updated Mar 23 • 8

rasatavohary/BitMamba-2-1B

Text Generation • Updated Mar 23 • 12

aios-framework/aios-paper

patlegu/opnsense-qwen25-onnx-int4

Text Generation • Updated Mar 30

patlegu/wireguard-qwen25-onnx-int4

Text Generation • Updated Mar 30

patlegu/crowdsec-qwen25-onnx-int4

Text Generation • Updated Mar 30

pnnbao-ump/VieNeu-TTS-v2-Turbo-GGUF

Text-to-Speech • 0.1B • Updated Apr 1 • 4.76k • 4

phucpx247/vieneu-tts-v2-turbo-gguf

Text-to-Speech • 0.1B • Updated Apr 1 • 5

sunil-pathak/gemma-4-E4B-it-GGUF

Text Generation • 8B • Updated Apr 10 • 13