Skip to content

model runner: update docs #25377

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mickael-docker wants to merge 2 commits into
base: main
Choose a base branch
from
+17 −0
Open

model runner: update docs #25377

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
acd9c51
model runner: update docs
mickael-docker Jun 17, 2026
a2a50e7
fix: address review feedback
mickael-docker Jun 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions content/manuals/ai/model-runner/_index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -120,6 +120,23 @@ See [Configuration options](configuration.md) for details on context size and ot
> [Docker Compose](/manuals/ai/compose/models-and-compose.md) support Docker
> Model Runner.

## Security and isolation

### Execution environment

Docker Model Runner isolates inference engines from your host:

- On Linux, Docker Model Runner and its inference engines, such as Diffusers,
run inside a container, which provides the isolation boundary.
- On macOS and Windows, the engines don't run inside a container, so Docker
Model Runner runs them in a sandboxed environment (seatbelt/sandbox-exec and Job Objects respectively)

### Networking

The Model Runner API is not authenticated. Any client that can reach it,
including other containers on the same Docker network, can pull, load, and
run models, and send inference requests.

## Known issues

### `docker model` is not recognised
Expand Down