Scaling Embeddings Outperforms Scaling Experts in Language Models Paper • 2601.21204 • Published 3 days ago • 90
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models Paper • 2601.14004 • Published 12 days ago • 46
SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving Paper • 2601.01426 • Published 28 days ago • 22
Unveiling Super Experts in Mixture-of-Experts Large Language Models Paper • 2507.23279 • Published Jul 31, 2025 • 1
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free Paper • 2505.06708 • Published May 10, 2025 • 10