This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Glenn K. Lockwood
glennklockwood.com
did:plc:3fi74j5ui7v6kcso64mjdexk
Since I no longer work directly w/ model trainers, I rely on public info to understand the infrastructure reqs of newer model architectures. This paper is a great explainer of how MOE taxes compute/memory/network: https://arxiv.org/abs/2603.07685v1
My notes here: https://glennklockwood.com/garden/expert-parallelism
#AI
2026-03-10T19:01:40.695Z