This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Tim Kellogg
timkellogg.me
did:plc:ckaz32jwl6t2cno6fmuw2nhn
the "shortcut-connected MoE" part is solving a more complex problem than it seems on the surface
the problem is the hand-off between attention & MoE causes communication overhead (e.g. expert is located on a different GPU)
ScMoE re-orders the pipeline, better utilizing compute
2025-08-31T13:20:33.402Z