here be dragons
Collection
8 items • Updated • 1
How to use DreadPoor/ASPIRE-8B-r128-LORA with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("DreadPoor/ASPIRE-8B-r128-LORA", dtype="auto")How to use DreadPoor/ASPIRE-8B-r128-LORA with PEFT:
Task type is invalid.
This is a LoRA extracted from a language model. It was extracted using mergekit.
This LoRA adapter was extracted from DreadPoor/Aspire-8B-model_stock and uses NousResearch/Meta-Llama-3.1-8B-Instruct as a base.
The following command was used to extract this LoRA adapter:
mergekit-extract-lora DreadPoor/Aspire-8B-model_stock NousResearch/Meta-Llama-3.1-8B-Instruct OUTPUT_PATH --no-lazy-unpickle --skip-undecomposable --rank=128 --verbose