This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Phillip Carter
phillipcarter.dev
did:plc:nevxkulynwc5m2sk4jalv4c7
I hadn't realized how easy it is to get started with base llama.cpp these days. I gave up on ollama a while ago since they started getting weird. Anyways:
brew install llama
brew install pi
pi install git:github.com/huggingface/pi-llama
llama serve <model>
pi
Got muh gemma4 on muh macbook
2026-06-16T16:45:49.572Z