An Emulator for Fine-Tuning Large Language Models using Small Language Models
Paper
• 2310.12962 • Published
• 13
Fine-tuning
Note Our experiments with EFT show that scaling up fine-tuning tends to improve helpfulness, while scaling up pre-training tends to improve factuality.