This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
mr. TIM
timkellogg.me
did:plc:ckaz32jwl6t2cno6fmuw2nhn
Muon optimizer learns more from rare data than Adam
i need to dig deeper. i think the industry is coalescing on:
- Adam is faster
- Muon is more stable
- now, Muon learns rare data better
i wonder if that’s why K2 has that vibe that it has
arxiv.org/abs/2509.26030
https://arxiv.org/abs/2509.26030
2025-10-03T16:04:07.862Z