Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

912

Base only

Active filters: ggml

rustformers/redpajama-3b-ggml

Text Generation • Updated Jun 9, 2023 • 66 • 7

rustformers/pythia-ggml

Text Generation • Updated Jun 9, 2023 • 30 • 5

rustformers/bloom-ggml

Text Generation • Updated Jun 9, 2023 • 24 • 8

CalderaAI/30B-Lazarus-GGMLv5_1

Updated May 27, 2023 • 7

rustformers/bloomz-ggml

Text Generation • Updated Jun 9, 2023 • 13 • 6

rustformers/gpt-j-ggml

Text Generation • Updated Jun 9, 2023 • 14 • 2

rustformers/stablelm-ggml

Text Generation • Updated Jun 9, 2023 • 19 • 3

rustformers/dolly-v2-ggml

Text Generation • Updated Oct 19, 2023 • 16 • 2

rustformers/gpt4all-j-ggml

Text Generation • Updated Jun 9, 2023 • 15 • 11

rustformers/redpajama-7b-ggml

Text Generation • Updated Jun 9, 2023 • 17 • 3

rustformers/open-llama-ggml

Text Generation • Updated Jun 11, 2023 • 12 • 9

phi0112358/Zicklein-7B-german_Alpaca-ggml

Updated Jun 19, 2023 • 4

phi0112358/PMC_LLaMA-7B-ggml

Updated Jun 19, 2023 • 3

mukowaty/ggml-whisper

Updated Jul 15, 2024 • 5

Green-Sky/ggml_openai_clip-vit-base-patch32

Updated Jun 25, 2023

Araki/airoboros-33b-gpt4-1.4.1-PI-8192-GGML

Text Generation • Updated Jul 16, 2023 • 2

Araki/Luna-AI-Llama2-Uncensored-GGML

Text Generation • Updated Jul 23, 2023 • 3

richardr1126/spider-skeleton-wizard-coder-ggml

Updated Aug 20, 2023 • 4

jphme/Llama-2-13b-chat-german-GGML

Text Generation • Updated Jul 22, 2023 • 13

Araki/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged-GGML

Text Generation • Updated Jul 22, 2023 • 1

Trelis/Llama-2-7b-chat-hf-function-calling

Text Generation • Updated Aug 22, 2023 • 46 • 48

Trelis/Llama-2-13b-chat-hf-function-calling

Text Generation • Updated Aug 23, 2023 • 4

bornjre/btlm-3b-ggml

Updated Aug 21, 2023 • 8

gorkemgoknar/llama2-7f-moviechatbot-ggml-q4

Text Generation • Updated Oct 11, 2023

Trelis/Llama-2-7b-chat-hf-function-calling-GGML

Text Generation • Updated Aug 11, 2023 • 6

Trelis/Llama-2-7b-chat-hf-function-calling-GPTQ

Text Generation • Updated Aug 12, 2023 • 15 • 4

Trelis/Llama-2-13b-chat-hf-function-calling-GPTQ

Text Generation • Updated Aug 14, 2023

Bluckr/llama-7B-ggml-q4_0-Pofi-Assistant

Text Generation • Updated Aug 13, 2023 • 2

Araki/Bacchus-22B-GGML

Text Generation • Updated Aug 14, 2023

Trelis/Llama-2-7b-chat-hf-function-calling-GPTQ-trained-adapters

Text Generation • Updated Aug 14, 2023