Command line#
lllm3090 <command> [options]
command |
what it does |
|---|---|
|
Check the machine can run the stack; exits non-zero on any failure |
|
Fetch and checksum-verify the pinned llama.cpp build |
|
The catalogue: size, kind, achievable context, state, expected speed |
|
Stop any running engine and start this model |
|
Terminate the engine and wait for the VRAM to be released |
|
Benchmark a model and print a profile block to contribute |
|
Whether the engine is running, on what, and whether it answers yet |
|
Run the control panel in the foreground |
|
The panel drawn in the terminal, for a console with no browser |
|
Launch Claude Code against the local engine |
|
Print that environment instead of launching it |
See Choose a context window and slot count for choosing between them.
start computes the KV pool from what fits, splits it into --parallel slots
(default 2, so an agent’s subagents have somewhere to go), and gives each slot
as much as it can up to the model’s RoPE ceiling. --ctx overrides the whole
pool; an unknown GGUF gets a conservative 32768 per slot. Anything after claude is passed
through to Claude Code unchanged.
claude --print-env writes the environment as export lines and nothing else
to stdout, so eval "$(lllm3090 claude --print-env)" sets up a shell for a
harness this project does not know about. Everything else it has to say —
warnings, refusals — goes to stderr.
Environment#
variable |
default |
meaning |
|---|---|---|
|
|
Where GGUF checkpoints live |
|
|
Pidfile and engine log |
|
|
The engine build |
|
|
Engine port |
|
|
Panel port |
|
|
Install prefix (installer only) |