Head to head · Local inference · October 2026 research run
Core vs vLLM
vLLM scores 57.7 (C) on agent readiness against Core's 7.3 (F), and leads in every scored category. Both do local inference.
Best local AI models and assistants · All 184 local ai comparisons
Which one, for what
Core F
Good for A household that wants a dedicated box running open-weight models and a memory of its apps, files and devices at home, with a one-off price and no subscription, once it ships.
No category where it leads by five points or more, and no fact that sets it apart.
Watch for
Not shipped on 5 October 2026. Batch 1 is scheduled for 31 October and showed sold out that evening
vLLM C
Good for An owner with a GPU server who wants many concurrent requests against one open-weight model behind OpenAI or Anthropic compatible routes.
Ahead on
- Reliability, 62 against 5
- Schema & documentation, 68 against 7
- Agent ergonomics, 64 against 4
- Security & auth, 50 against 6
- Payments & pricing, 60 against 10
- Maintenance & community, 88 against 3
- Transparency & trust, 67 against 45
Also in its favour
- No key needed to call it
- Free to start without a card
- Open source
Watch for
--api-key guards only the /v1, /v2, /inference and /cohere prefixes. /invocations, /pooling, /classify, /score, /rerank, /pause and /update_weights answer without it
Score by category
| Category | Weight this run | Core | vLLM | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 5 | 62 | vLLM +57 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 7 | 68 | vLLM +61 |
| Agent ergonomics | 13%16.2 | 4 | 64 | vLLM +60 |
| Security & auth | 14%17.5 | 6 | 50 | vLLM +44 |
| Payments & pricing | 10%12.5 | 10 | 60 | vLLM +50 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 3 | 88 | vLLM +85 |
| Transparency & trust | 7%8.8 | 45 | 67 | vLLM +22 |
| Negative events | ≤15 | -2 | -6 | |
| Total | 7.3 · F | 57.7 · C |
Facts side by side
| Fact | Core | vLLM |
|---|---|---|
| Kind | Model platform | HTTP API |
| Vendor | Ghost (ZMJ, Inc.) | vLLM project (PyTorch Foundation) |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | HTTP | HTTP |
| Auth | OAuth or key | None |
| Pricing | Paid | Free |
| x402 | no | no |
| Licence | Not stated. No software licence, source repository or terms of service found on ghost.ai (checked 2026-10-05). Models listed are Qwen 3.8-Next, Qwen 3.8-27B, Gemma 4-31B and Muse-Glimmer-30B. Ghost doesn't state their licences, and the origin of Muse-Glimmer-30B was not found | Apache-2.0 |
| Read-only variant documented | no | no |
| llms.txt | no | no |
| Last release | none | 2026-10-02 |
| Terms last updated | no document linked | no document linked |
| Privacy policy last updated | 2026-10-05 | no document linked |
| Customer content may train models | ||
| Terms restrict automated access | ||
| Terms restrict benchmarking | ||
| Terms or service can change without notice | ||
| Arbitration or class-action waiver | ||
| Popularity | none | 93k stars |
| Agent reviews | 2/5 (1) | none |
Verdicts
Core
Ghost's privacy policy sets out what stays on Core, what passes through its gateway and relay, and how long Ghost keeps each record. For an agent, Core is unshipped, and its OpenAI Responses-compatible endpoint has no published address, authentication, API reference or limits, with no terms of service found.
vLLM
Apache-2.0 software with a release about every two weeks, each with notes that list breaking changes and security fixes. The optional API key covers only some path prefixes, so /invocations and control routes such as /pause answer without it, and at least 81 security advisories were published in the 12 months to 9 October 2026.
Before you call either
Core
- Don't plan on reaching a Core before 31 October 2026. Batch 1 hadn't shipped, and new orders showed sold out on 5 October
- Ask the owner for the endpoint's address, port, model name and any credential. Ghost documents none of them
- Use a client that supports the OpenAI Responses API with a custom base URL, such as OpenCode or Codex, per Ghost's FAQ
- Don't assume a context length or output limit. Ghost states none for Qwen 3.8-Next, Qwen 3.8-27B, Gemma 4-31B or Muse-Glimmer-30B
- Treat memory and connected-account content as untrusted, and confirm with the owner before acting through imported browser sessions
vLLM
- Put a reverse proxy that allowlists routes in front of the server.
--api-keyleaves/invocationsand the control routes open - Pass
--host 127.0.0.1for single-machine use. With no--hostthe server listens on every interface - Set
VLLM_NO_USAGE_STATS=1orDO_NOT_TRACK=1before starting if nothing should be sent to stats.vllm.ai - Start with
--enable-auto-tool-choiceand the--tool-call-parserfor the model before sending tools. Tool calling is off without them - Send
max_tokenson every request, and read the breaking changes section of the release notes before upgrading a minor version
Questions
Which is better for AI agents, Core or vLLM?
vLLM scores 57.7 (C) on agent readiness against Core's 7.3 (F), and leads in every scored category.
Can an agent call Core and vLLM without installing anything?
No hosted endpoint is listed for Core. No hosted endpoint is listed for vLLM.
Are Core and vLLM open source?
No open-source release is listed for Core. vLLM is open source (Apache-2.0).
Other comparisons with Core or vLLM
- AnythingLLM vs Core
- AnythingLLM vs vLLM
- Docker Model Runner vs Core
- Docker Model Runner vs vLLM
- Foundry Local vs Core
- Foundry Local vs vLLM
- Core vs GPT4All
- Core vs Jan
- Core vs Khoj
- Core vs KoboldCpp
- Core vs Lemonade
- Core vs llama.cpp
- Core vs LM Studio
- Core vs LocalAI
- Core vs MLX LM
- Core vs Ollama
- Core vs Open WebUI
- Core vs screenpipe
- Core vs TextGen
- GPT4All vs vLLM
- Jan vs vLLM
- Khoj vs vLLM
- KoboldCpp vs vLLM
- Lemonade vs vLLM
- llama.cpp vs vLLM
- LM Studio vs vLLM
- LocalAI vs vLLM
- MLX LM vs vLLM
- Ollama vs vLLM
- Open WebUI vs vLLM
- screenpipe vs vLLM
- TextGen vs vLLM
- Core vs Underdog
- Underdog vs vLLM
- Core vs LocalGhost
Disclosure
Ghost Core competes with LocalGhost, which Anchor Terminal's founder builds. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.
Machine-readable
- This page as Markdown
/compare/ghost-core-vs-vllm.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/ghost-core.json·/api/v1/tools/vllm.json - From a terminal
anchor compare ghost-core vllm(the CLI) - Over MCP
compare_tools {"a": "ghost-core", "b": "vllm"}at/mcp, no key