This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
John Calhoun
engineersneedart.com
did:plc:oxjqlammq27la2ojzsaev7vy
Finally (took 3 days of failed attempts) got Rocky Linux 9 installed with NVIDIA driver + CUDA toolkit so I can run Ollama on my an inexpensive 24GB NVIDIA TESLA M40 (seen on right — had to 3D print a shroud + add fans to the card).
Just tried phi4. Tokens are smokin'.
#localllama
2025-04-09T23:14:21.177Z