Post
aly
aly.codes
did:plc:zntngpowgd6rorjt3haywj36
not really, small models are still more efficient (and yes, environmentally friendly) to serve from a datacenter rather than on anything a consumer would have.
even on the very low end it does not make sense for everyone to dedicate 64-128GB VRAM for this.
2026-09-04T05:33:15.757Z