Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

186

Base only

Active filters: cpo, trl

NBA55/Experiment_with_trained_model_Final_CPO_for_all_3_issues-epoch-2

Updated May 12, 2024

smohammadi/llama2-lora-aligned-cpo

Updated Jul 20, 2024 • 1

NBA55/Final_Experiment_with_trained_model_Final_CPO_for_all_3_issues-epoch-2

Updated Aug 24, 2024

Siddartha10/outputs_cpo

Text Generation • 0.1B • Updated Sep 14, 2024 • 3

ravithejads/test_model_sft

Text Generation • 0.1B • Updated Sep 15, 2024

maxmyn/c4ai-takehome-model-simpo

Text Generation • 0.1B • Updated Sep 15, 2024 • 5

twigs/smolm-cposimpo

Text Generation • 0.1B • Updated Sep 16, 2024 • 3

sarthakrw/cpo_model

Text Generation • 0.1B • Updated Sep 16, 2024 • 2

CharlesLi/OpenELM-1_1B-SimPO

Text Generation • 1B • Updated Sep 20, 2024 • 4

CharlesLi/OpenELM-1_1B-CPO

Text Generation • 1B • Updated Sep 20, 2024 • 2

NBA55/CPO_with_baseline_modalh

Text Generation • 7B • Updated Oct 1, 2024 • 4

NBA55/CPO_with_trained_model_for_all_3_issues-epoch-2

Updated Oct 1, 2024

rawsh/mirrorqwen2.5-0.5b-SimPO

Text Generation • 0.5B • Updated Nov 10, 2024 • 5

rawsh/simpo-math-model

Text Generation • 0.5B • Updated Nov 10, 2024 • 3

rawsh/mirrorqwen2.5-0.5b-SimPO-0

Text Generation • 0.5B • Updated Nov 10, 2024 • 6

mradermacher/mirrorqwen2.5-0.5b-SimPO-GGUF

0.5B • Updated Nov 10, 2024 • 24

mradermacher/mirrorqwen2.5-0.5b-SimPO-0-GGUF

0.5B • Updated Nov 10, 2024 • 13

rawsh/mirrorqwen2.5-0.5b-SimPO-1

Text Generation • 0.5B • Updated Nov 11, 2024 • 6

rawsh/mirrorqwen2.5-0.5b-SimPO-2

Text Generation • 0.5B • Updated Nov 11, 2024 • 6

rawsh/mirrorqwen2.5-0.5b-SimPO-3

Text Generation • 0.5B • Updated Nov 11, 2024 • 6

mradermacher/mirrorqwen2.5-0.5b-SimPO-1-GGUF

0.5B • Updated Nov 12, 2024 • 364

mradermacher/mirrorqwen2.5-0.5b-SimPO-2-GGUF

0.5B • Updated Nov 12, 2024 • 133

mradermacher/mirrorqwen2.5-0.5b-SimPO-3-GGUF

0.5B • Updated Nov 12, 2024 • 168

botways/llama-CPO

Updated Nov 26, 2024

Aratako/Llama-Gemma-2-27b-CPO_SimPO-iter1

Text Generation • 27B • Updated Dec 15, 2024 • 3 • 1

Aratako/Llama-Gemma-2-27b-CPO_SimPO-iter2

Text Generation • 27B • Updated Dec 16, 2024 • 2 • 1

Aratako/gemma-2-2b-axolotl-simpo-v1.0

Text Generation • Updated Dec 10, 2024 • 6

Aratako/gemma-2-2b-axolotl-simpo-v1.0-merged

Text Generation • Updated Dec 10, 2024 • 1 • 1

mradermacher/gemma-2-2b-axolotl-simpo-v1.0-merged-GGUF

3B • Updated Dec 11, 2024 • 104

mjhamar/Meta-Llama-3.1-8B-Instruct-cpo-beir

Text Generation • 8B • Updated Dec 12, 2024 • 4