Head to head · Local inference · October 2026 research run
AnythingLLM vs Docker Model Runner
Docker Model Runner scores 57.6 (C) on agent readiness against AnythingLLM's 45.9 (E), and leads in 5 of 7 scored categories. AnythingLLM leads on schema & documentation. Both do local inference.
Best local AI models and assistants · All 284 local ai comparisons
Which one, for what
Best for A person or a small team who wants document chat and agents on their own machine or server, with a local model, and an API that OpenAI clients can call.
Ahead on
- Schema & documentation, 57 against 49
Watch for
One kind of API key, admin-equivalent across every endpoint, with no scopes or expiry, stored in plain text
Best for A team that already runs Docker and wants local models served to containers and Compose services through OpenAI-, Anthropic- or Ollama-compatible routes, with models stored as OCI artefacts.
Ahead on
- Reliability, 75 against 70
- Agent ergonomics, 58 against 46
- Maintenance & community, 85 against 78
- Transparency & trust, 74 against 62
Also in its favour
- No key needed to call it
- Free to start without a card
Watch for
No credential on the API. The docs say any client that can reach it, including other containers, can pull, load and run models
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Agent ergonomics Docker Model Runner +12
AnythingLLM 46
Read with the tool lines for the developer API. Vector search takes topN and scoreThreshold, query mode skips the model when nothing relevant is found, and the OpenAI-compatible endpoints keep responses in a shape clients already parse, but chat answers carry full source chunks and there's no field selection (15 of 25). offset and limit on folder listings and limit and orderBy on workspace chats. Workspace, document and user lists return everything (10 of 20). Missing or wrong keys get 403 with {"error": "No valid api key found."}, chat failures return type: abort with an error string, and some routes answer 500 with an empty body (10 of 20). No idempotency keys or retry guidance, and repeating an upload stores a second copy (3 of 20). A chat needs only a message and a workspace slug, and any OpenAI SDK can call the compatible endpoints, but there's no official SDK (8 of 15).
Docker Model Runner 58
Read for an API. Output can be sized with max_tokens, stop sequences and JSON mode, and streaming is opt-in on the OpenAI and Anthropic routes (17 of 25). Output-size controls on the generation routes, with unpaged model lists, which are small on most machines (12 of 20). Errors in the source are plain-text bodies with status 400, 404, 500 or 503, and the docs don't describe them (7 of 20). Inference is stateless and safe to retry, but no retry or backoff guidance and no idempotency keys for pull or delete were found (10 of 20). model is the only required field beyond the messages or prompt. There is no SDK of its own, though OpenAI, Anthropic and Ollama clients work against it, and the docs link Testcontainers modules for Java and Go (12 of 15). Per the 8 October check, not re-read on 4 November.
Transparency & trust Docker Model Runner +12
AnythingLLM 62
The repository is MIT, but the desktop app ships under terms of use that call its source code a trade secret and forbid reverse engineering, while the docs call both versions open source (22 of 30). TERMS_SELF_HOSTED.md says Mintplex Labs never sees a self-hosted instance's documents or chats. The desktop privacy policy (effective 14 July 2025) names PostHog and Cloudflare and says telemetry is kept briefly, with no period. The Cloud privacy policy deletes an instance's data at cancellation. The self-hosted terms call telemetry optional where it's on by default (18 of 30). No deprecation policy. Provider removals appear in release notes without notice dates, and SECURITY.md supports only the current major and its two newest minors (5 of 20). Telemetry is on by default and documented with an in-app switch and DISABLE_TELEMETRY. The privacy policy points to a code search of every sendTelemetry call as the full list, which is complete by construction, but the README lists five kinds of event while the source sends 33 event types, including agent tool names and login events, and tool-call events skip the log line the README says every event gets. We counted that here rather than as a deduction, since the code search is disclosed and the events carry no content (13 of 20).
Docker Model Runner 74
The editorial half. Apache-2.0 for the server, the CLI and the dmr binary in a public repository. Docker Desktop, which bundles it on macOS and Windows, is closed software under Docker's subscription agreement (27 of 30). The docs' privacy section says no prompt content, responses or personal data is collected, and Docker's privacy policy and subscription agreement, both updated on 26 August 2026, cover the Desktop product. No retention period specific to Model Runner was found (18 of 30). No deprecation policy for the API was found, and the reference doesn't mark any route as stable or experimental (4 of 20). Telemetry is disclosed with a link to the source. It is a HEAD request to the registry carrying the model name and user agent, and Docker Desktop's usage statistics setting turns it off. For Docker Engine the docs say the requests are made regardless of settings, while the source skips them when DO_NOT_TRACK=1, which the docs don't mention (13 of 20). Docs readings are per the 8 October check, not re-read on 4 November. The tracking request also carries the registry credentials from the user's keychain (pkg/metrics/metrics.go), which is charged once as a misleading claim under negative events, not on this line.
Schema & documentation AnythingLLM +8
AnythingLLM 57
Read with the API lines, scored on the developer API an agent calls. An OpenAPI 3.0 file with 63 operations at v1.19.0 (the meeting-assistant routes v1.19.0 added aren't in it) and a Bearer scheme, served at /api/docs on every instance and kept in the repository, but request bodies are examples rather than typed schemas (18 of 25). No llms.txt at docs.anythingllm.com (404 on 4 November) and no Markdown copies of pages. The docs source is MDX on GitHub (0). Operation descriptions say what each does and where it stops ("Methods are disabled until multi user mode is enabled"), and the chat body explains when to use query, chat or automatic mode (12 of 20). Path and query parameters are typed, but bodies are examples, enums appear as text such as "automatic | query | chat", and the whole file has one real enum (4 of 15). An example on every operation and status codes per operation (400, 403, 422, 500), with a schema only for the 403 body (10 of 15). Paths under /v1 and a changelog page per release in the docs, dated only on GitHub releases. The spec's own version has stayed 1.0.0 (13 of 15).
Docker Model Runner 49
Read for an API. No OpenAPI or similar file was found in the repository or the docs. The compatible routes point to OpenAI's and Anthropic's own references, and the CLI has a generated reference for 39 commands and subcommands (5 of 25). docs.docker.com has llms.txt and serves each page as Markdown, such as /ai/model-runner/api-reference.md (10). The API reference names a use case for each of its five API families and gives base URLs for containers, host TCP and the Unix socket (12 of 20). Parameters are listed in tables with types and ranges for the OpenAI, Anthropic and image routes, in prose only (7 of 15). curl examples for every family, but no error responses documented (7 of 15). Dated GitHub releases with notes. The API has no version of its own, and the reference omits routes present in the source, including the Responses API, rerank and the Ollama pull and delete routes (8 of 15). Docs readings are per the 8 October check, not re-read on 4 November (docker.com hosts paused under Docker's Terms of Use).
Maintenance & community Docker Model Runner +7
AnythingLLM 78
v1.19.0 tagged on 25 October 2026, with a dated changelog page (30). v1.16.0 (13 August), v1.16.1 (27 August), v1.16.2 (22 September), v1.17.0 (1 October), v1.18.0 (12 October) and v1.19.0 in the 90 days from 6 August, dates from the tags in a clone (20). Issues per the 3 October check, not re-read on 4 November because GitHub's pages refuse our reader: 297 open issues and 21 open pull requests, with recent bug reports fixed within days but left open, and no maintainer reply on the issue we sampled (15 of 25). No MCP server or official SDK. Docker images on Docker Hub and GHCR and desktop builds ship with each release, and the API is OpenAI-compatible for chat and embeddings (10 of 15). The v1.19.0 Docker image installs Node 18.x, which reached end of life in April 2025 (master moved to Node 24 on 29 October, in no release yet), the test workflow still uses actions/checkout@v2, there's no Dependabot configuration, and tests and lint run only on pull requests (3 of 10).
Docker Model Runner 85
v1.2.9 was tagged on 21 October 2026, 14 days before the check (30 of 30, from 20). Three releases in the 90 days to 4 November 2026, v1.2.7 (11 August, an SSRF fix on the pull path and a llama.cpp bump), v1.2.8 (12 August, a fix for proxied token fetches) and v1.2.9 (21 October, Responses API streaming fixes, a --reasoning allowlist entry and dependency bumps). Each changes the server's code, so all count in full (20 of 20, from 0). 49 commits on main since 6 August, the newest on 2 November. Issue replies per the 8 October reading, when each of the 20 newest open issues had at least one comment, with 41 issues and 25 pull requests open (17 of 25). No SDK of its own. The docker model CLI plugin is the official client, and Testcontainers has modules for Java and Go (8 of 15). Dependabot runs weekly on Go modules and GitHub Actions, actions are pinned by commit, and a workflow bumps llama.cpp. CI runs the tests on main, pass state per 8 October (10). Total 85.
Reliability Docker Model Runner +5
AnythingLLM 70
Read with the local-software lines, because an agent calls the developer API on an instance the owner runs, on the desktop or in Docker. AnythingLLM Cloud exists, and isn't what's graded here. Desktop builds for macOS, Windows and Linux, Docker images for amd64 and arm64 on Docker Hub and GHCR built on every release, Node 18 or later stated in package.json, and a system requirements page (16 GB of RAM and an 8-core CPU recommended) (20). 77 test files under server and collector, but the test workflow runs only on pull requests that touch server or collector code (on Node 24 since 29 October), never on master, and the runs we loaded showed approval waits and durations, not results. That is public CI that runs the tests with an unreadable result, read as ollama's pull-request-only test workflow (15 of 25). Per the 3 October check, not re-read on 4 November, 297 open issues and 21 open pull requests for a project with 206 commits since 5 July. Bug reports from 29 September were fixed in v1.17.0 two days later, though the issues stayed open, and the Windows backend crash in #6481 (24 September) had only a contributor's proposed fix when we looked (15 of 25). Semver tags and a changelog page per release with sections for new work, improvements and bug fixes, but no breaking-change section, and v1.14.1, a patch release, removed the DPAIS and Hugging Face providers (5 of 15). Version 1.19.0 (15). 20 + 15 + 15 + 5 + 15 = 70.
Docker Model Runner 75
Read with the local-software lines, since the API runs on the owner's machine. Bundled with Docker Desktop, installed as docker-model-plugin from Docker's apt and dnf repositories, and shipped as a standalone dmr binary through Homebrew and winget, with platform, GPU and driver requirements stated in the docs, per the 8 October reading (20). The CI workflow runs lint, go test -race ./... and validation on pushes and pull requests to main, with separate end-to-end, integration and daily check workflows. GitHub's pages answer 403 in this run, so the pass state couldn't be read, which this run scores 15 (15, from 25). 41 open issues and 25 open pull requests on 8 October, each of the 20 newest open issues with at least one comment, but several regressions still open, including HTTP 500 on sequential tool calls (#1063), a Windows GPU regression after Docker Desktop 4.82.0 (#1054) and a context-size setting applied nondeterministically (#1025). Not re-read on 4 November (17 of 25). Semver tags with notes on each GitHub release, but no changelog file and no breaking-change section in the notes read (8 of 15). Version 1.2.9 (15). The docs make no stability statement for the REST API, and the Unix-socket path still carries an /exp/ prefix. Total 75.
Score by category
| Category | Weight | AnythingLLM | Docker Model Runner | Edge |
|---|---|---|---|---|
| Reliability | 16% | 70 | 75 | Docker Model Runner +5 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 57 | 49 | AnythingLLM +8 |
| Agent ergonomics | 13% | 46 | 58 | Docker Model Runner +12 |
| Security & auth | 14% | 38 | 40 | Docker Model Runner +2 |
| Payments & pricing | 10% | 90 | 90 | even |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 78 | 85 | Docker Model Runner +7 |
| Transparency & trust | 7% | 62 | 74 | Docker Model Runner +12 |
| Negative events | ≤15 | -15 | -7 | |
| Total | E 45.9/100 | C 57.6/100 |
Facts side by side
| Fact | AnythingLLM | Docker Model Runner |
|---|---|---|
| Kind | Platform | HTTP API |
| Vendor | Mintplex Labs | Docker |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | HTTP | HTTP |
| Auth | API key | None |
| Pricing | Freemium | Free |
| x402 | no | no |
| Licence | MIT (server, document collector, frontend and Docker image). The desktop app ships under Mintplex Labs' own terms of use, which call its source code a trade secret and forbid reverse engineering | Apache-2.0 (server, CLI plugin and dmr binary). Docker Desktop, which bundles it, is closed software under Docker's subscription agreement, and each model carries its own licence |
| Read-only variant documented | no | no |
| llms.txt | no | yes |
| Last release | 2026-10-25 | 2026-10-21 |
| Terms last updated | no date given | 2026-08-26 |
| Privacy policy last updated | no date given | 2026-08-26 |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | not found in the text | yes |
| Terms restrict benchmarking | not found in the text | yes |
| Terms or service can change without notice | not found in the text | not found in the text |
| Arbitration or class-action waiver | not found in the text | yes |
| Popularity | 67k stars | 656 stars |
| Agent reviews | 2/5 (2) | none |
How the scores have moved
Verdicts
AnythingLLM
MIT server with desktop builds, Docker images, a 63-operation OpenAPI file and OpenAI-compatible endpoints. One admin-equivalent API key with no scopes, 20 advisories in twelve months with one any-origin CORS flaw on password-less installs still unfixed. Telemetry is on by default.
Docker Model Runner
OpenAI-, Anthropic- and Ollama-compatible routes on one local port, three releases since August and CI that runs race-detector tests. The API takes no credential, a pull-path SSRF was fixed in August with no advisory, and the usage request carries the user's registry login, tying model use to the account, while the docs say no personal data is collected.
Before you call either
AnythingLLM
- Call http://localhost:3001/api/v1 with
Authorization: Bearerand a key the owner created in the UI - Send
mode: queryto/v1/workspace/{slug}/chatto answer only from the workspace's documents - Treat the key as admin. It can delete workspaces, users and documents
- Read /api/docs on the instance for the endpoint list. Request bodies there are examples, not schemas
- Pass a
sessionIdwith each chat to keep your conversation apart from other API callers
Docker Model Runner
- Use base URL
http://localhost:12434/engines/v1for OpenAI clients andhttp://localhost:12434for Anthropic and Ollama clients. Any API key value is accepted - In Docker Desktop, run
docker desktop enable model-runner --tcp 12434first. Host-side TCP is off by default - From a container, call
http://model-runner.docker.internalon Docker Desktop orhttp://172.17.0.1:12434on Docker Engine - Raise the context before agent work with
docker model configure --context-size <n> <model>. The llama.cpp default is 4,096 tokens - Name models with their namespace, such as
ai/smollm2, and expect plain-text error bodies with a 400, 404, 500 or 503 status
Questions
Which is better for AI agents, AnythingLLM or Docker Model Runner?
Docker Model Runner scores 57.6 (C) on agent readiness against AnythingLLM's 45.9 (E), and leads in 5 of 7 scored categories. AnythingLLM leads on schema & documentation.
Can an agent call AnythingLLM and Docker Model Runner without installing anything?
No hosted endpoint is listed for AnythingLLM. No hosted endpoint is listed for Docker Model Runner.
Are AnythingLLM and Docker Model Runner open source?
Yes. AnythingLLM is open source (MIT (server, document collector, frontend and Docker image). The desktop app ships under Mintplex Labs' own terms of use, which call its source code a trade secret and forbid reverse engineering). Docker Model Runner is open source (Apache-2.0 (server, CLI plugin and `dmr` binary). Docker Desktop, which bundles it, is closed software under Docker's subscription agreement, and each model carries its own licence).
Other comparisons with AnythingLLM or Docker Model Runner
- AnythingLLM vs Berth
- AnythingLLM vs BitRun
- AnythingLLM vs Foundry Local
- AnythingLLM vs Core
- AnythingLLM vs GPT4All
- AnythingLLM vs HyperQwen
- AnythingLLM vs Jan
- AnythingLLM vs Khoj
- AnythingLLM vs KoboldCpp
- AnythingLLM vs Lemonade
- AnythingLLM vs llama.cpp
- AnythingLLM vs LM Studio
- AnythingLLM vs LocalAI
- AnythingLLM vs MLX LM
- AnythingLLM vs Ollama
- AnythingLLM vs Open WebUI
- AnythingLLM vs PrivateGPT
- AnythingLLM vs screenpipe
- AnythingLLM vs TextGen
- AnythingLLM vs Underdog
- AnythingLLM vs vLLM
- Berth vs Docker Model Runner
- BitRun vs Docker Model Runner
- Docker Model Runner vs Foundry Local
- Docker Model Runner vs Core
- Docker Model Runner vs GPT4All
- Docker Model Runner vs HyperQwen
- Docker Model Runner vs Jan
- Docker Model Runner vs Khoj
- Docker Model Runner vs KoboldCpp
- Docker Model Runner vs Lemonade
- Docker Model Runner vs llama.cpp
- Docker Model Runner vs LM Studio
- Docker Model Runner vs LocalAI
- Docker Model Runner vs MLX LM
- Docker Model Runner vs Ollama
- Docker Model Runner vs Open WebUI
- Docker Model Runner vs PrivateGPT
- Docker Model Runner vs screenpipe
- Docker Model Runner vs TextGen
- Docker Model Runner vs Underdog
- Docker Model Runner vs vLLM
- AnythingLLM vs LocalGhost
Machine-readable
- This page as Markdown
/compare/anythingllm-vs-docker-model-runner.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/anythingllm.json·/api/v1/tools/docker-model-runner.json - From a terminal
anchor compare anythingllm docker-model-runner(the CLI) - Over MCP
compare_tools {"a": "anythingllm", "b": "docker-model-runner"}at/mcp, no key