15 · The Workbench
Local Model
On-device inference
Running open-weight weights on your own hardware via Ollama, LM Studio, llama.cpp, or similar — private, offline-capable, and limited by your GPU or CPU.
Concrete example
A 7B model answering prompts with no data leaving your machine.
Why it matters
Privacy and control tradeoff vs cloud APIs.