AlpaGasus-13B Model Card

Model Details

This is an unofficial implementation of AlpaGasus-13B, which is a chat assistant trained by fine-tuning LLaMA on a Claud-filtered Alpaca dataset with around 5K triplets.

• Developed by: gpt4life
• Model type: An auto-regressive language model based on the transformer architecture.
• License: Non-commercial license
• Finetuned from model: LLaMA-13B.

Please see the original LLaMA license before using this model.

Model Sources

• Repository: https://github.com/gpt4life/alpagasus
• Paper: https://arxiv.org/pdf/2307.08701.pdf

Training Details

AlpaGasus-13B is fine-tuned from LLaMA-13B with supervised instruction fine-tuning on the filtered Alpaca dataset.