Elfrino/CrimsonSynapse_V1-20B

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using Undi95/PsyMedRP-v1-20B as a base.

Models Merged

The following models were included in the merge:

• Elfrino/PsyMedRose-20B
• Undi95/MXLewd-L2-20B

Configuration

The following YAML configuration was used to produce this model:

# Testing random seeding on a 3 solid models.

models:
  - model: Undi95/PsyMedRP-v1-20B
    parameters:
      weight: 0.6
      density: 0.8
  - model: Undi95/MXLewd-L2-20B
    parameters:
      weight: 0.6
      density: 0.8
  - model: Elfrino/PsyMedRose-20B
    parameters:
      weight: 0.38
      density: 0.6

merge_method: dare_ties
base_model: Undi95/PsyMedRP-v1-20B
random_seed: 123
dtype: bfloat16