Reach the panel from another machine#

The panel and the engine both bind 127.0.0.1 and neither has any authentication. The panel starts processes and writes files; the engine accepts any bearer token. Do not bind either to a LAN address.

Use an SSH tunnel:

ssh -L 8080:127.0.0.1:8080 -L 1919:127.0.0.1:1919 you@your-box

Then http://127.0.0.1:8080 on your laptop reaches the panel, and anything pointed at http://127.0.0.1:1919 reaches the engine.

Serving other machines on purpose#

If you genuinely want other hosts to use the engine — a second workstation, a home-lab service — put a reverse proxy in front of it that terminates TLS and checks a token, and keep llama-server itself on loopback. The Authorization header the engine receives is ignored, so anything that can reach port 1919 can use your GPU and read every prompt sent through it.