Technical support for the SmallDoges series models.
AI & ML interests
A Family of Dynamic UltraFast Small Language Models Ready for Embodied Artificial General Intelligence!
Recent Activity
View all activity
A series of checkPoint weights that can continue training on new datasets without spikes of the training.
Doge family of small language models!
-
SmallDoge/Doge-320M-Instruct
Question Answering • 0.3B • Updated • 11 • 4 -
SmallDoge/Doge-160M-Instruct
Question Answering • 0.2B • Updated • 204 • 12 -
SmallDoge/Doge-120M-MoE-Instruct
Question Answering • 0.1B • Updated • 13 • 1 -
SmallDoge/Doge-60M-Instruct
Question Answering • 54.6M • Updated • 86 • 6
Multi-stage high-quality datasets makes the model more helpful!
Technical support for the SmallDoges series models.
Doge family of small language models!
-
SmallDoge/Doge-320M-Instruct
Question Answering • 0.3B • Updated • 11 • 4 -
SmallDoge/Doge-160M-Instruct
Question Answering • 0.2B • Updated • 204 • 12 -
SmallDoge/Doge-120M-MoE-Instruct
Question Answering • 0.1B • Updated • 13 • 1 -
SmallDoge/Doge-60M-Instruct
Question Answering • 54.6M • Updated • 86 • 6
A series of checkPoint weights that can continue training on new datasets without spikes of the training.
Multi-stage high-quality datasets makes the model more helpful!