Paths and ports#
Set environment variables before starting the workbench or a client wrapper.
Variable |
Default |
Contents |
|---|---|---|
|
|
GGUF checkpoints and downloads. |
|
|
|
|
|
Newly compiled engines. |
|
|
Colon-separated engine search roots; setting it replaces the defaults. |
|
|
Model server port on loopback. A remote backend’s local proxy uses the same port. |
|
|
Default idle stop for a remote backend, in whole minutes from 0 to 1440; |
The panel defaults to 127.0.0.1:8082. Its controls use /api/*; model
clients connect to the separate llama.cpp server on port 1920. Protocol
support depends on the selected engine build.