Instruct Checkpoints OctoLong Merged Base checkpoints instruction tuned to 128k using the OctoLong recipe OctoLong/OctoLong-0.6B-Instruct Text Generation • 0.6B • Updated Jun 15 OctoLong/OctoLong-1.7B-Instruct Text Generation • 2B • Updated Jun 15 OctoLong/OctoLong-4B-Instruct Text Generation • 4B • Updated Jun 15 OctoLong/OctoLong-8B-Instruct Text Generation • 8B • Updated Jun 15
Extended Base Checkpoints Qwen3 checkpoints long-context fine-tuned to 128k using the OctoLong recipe OctoLong/OctoLong-0.6B-Base-Extended Text Generation • 0.6B • Updated Jun 15 • 24 OctoLong/OctoLong-1.7B-Base-Extended Text Generation • 2B • Updated Jun 15 • 21 OctoLong/OctoLong-4B-Base-Extended Text Generation • 4B • Updated Jun 15 • 20 OctoLong/OctoLong-8B-Base-Extended Text Generation • 8B • Updated Jun 15
Merged Base Checkpoints 9:1 Merged checkpoints between the OctoLong Extended Base and Qwen3 Original Base models OctoLong/OctoLong-0.6B-Base-Merged Text Generation • 0.6B • Updated Jun 15 • 36 OctoLong/OctoLong-1.7B-Base-Merged Text Generation • 2B • Updated Jun 15 • 26 OctoLong/OctoLong-4B-Base-Merged Text Generation • 4B • Updated Jun 15 • 52 OctoLong/OctoLong-8B-Base-Merged Text Generation • 8B • Updated Jun 15 • 2
Instruct Checkpoints OctoLong Merged Base checkpoints instruction tuned to 128k using the OctoLong recipe OctoLong/OctoLong-0.6B-Instruct Text Generation • 0.6B • Updated Jun 15 OctoLong/OctoLong-1.7B-Instruct Text Generation • 2B • Updated Jun 15 OctoLong/OctoLong-4B-Instruct Text Generation • 4B • Updated Jun 15 OctoLong/OctoLong-8B-Instruct Text Generation • 8B • Updated Jun 15
Merged Base Checkpoints 9:1 Merged checkpoints between the OctoLong Extended Base and Qwen3 Original Base models OctoLong/OctoLong-0.6B-Base-Merged Text Generation • 0.6B • Updated Jun 15 • 36 OctoLong/OctoLong-1.7B-Base-Merged Text Generation • 2B • Updated Jun 15 • 26 OctoLong/OctoLong-4B-Base-Merged Text Generation • 4B • Updated Jun 15 • 52 OctoLong/OctoLong-8B-Base-Merged Text Generation • 8B • Updated Jun 15 • 2
Extended Base Checkpoints Qwen3 checkpoints long-context fine-tuned to 128k using the OctoLong recipe OctoLong/OctoLong-0.6B-Base-Extended Text Generation • 0.6B • Updated Jun 15 • 24 OctoLong/OctoLong-1.7B-Base-Extended Text Generation • 2B • Updated Jun 15 • 21 OctoLong/OctoLong-4B-Base-Extended Text Generation • 4B • Updated Jun 15 • 20 OctoLong/OctoLong-8B-Base-Extended Text Generation • 8B • Updated Jun 15
