This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Mat Kelcey
matpalm.com
did:plc:3zbmmug3amulyg5v6vsef3yl
keep coming back to "Scalable MatMul-free Language Modeling" arxiv.org/abs/2406.02528
full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention.
slowly getting there!
2025-02-02T22:13:10.456Z