Post
Guillaume Laforge
glaforge.dev
did:plc:5vopmuvqyxdshfhizbnr3rjq
Step 1: LiteRT-LM setup
Install the on-device runtime:
pip install litert-lm
Download a Gemma model:
litert-lm import --model-id litert-community/gemma-4-E2B-it-litert-lm --output-dir ~/.litert-lm/models/gemma4-e2b/
Serve locally:
litert-lm serve --port 9379
2026-09-23T22:15:53.662Z