# Khoj vs vLLM (slim)

> vLLM scores 57.7 (C) to Khoj's 38.5 (E) for local inference. Prices, MCP, x402, uptime and agent notes side by side.

- Full: https://www.anchorterminal.com/compare/khoj-vs-vllm.md (~2,550 tokens) · this version ~630 tokens · JSON https://www.anchorterminal.com/compare/khoj-vs-vllm.json · canonical https://www.anchorterminal.com/compare/khoj-vs-vllm
- Index: https://www.anchorterminal.com/llms.txt · API: https://www.anchorterminal.com/api/v1/index.json · Updated: 2026-10-09

vLLM scores 57.7 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories. Both do local inference.

- Khoj: E 38.5, rank #920 of 950 · https://www.anchorterminal.com/tools/khoj.min.md
- vLLM: C 57.7, rank #600 of 950 · https://www.anchorterminal.com/tools/vllm.min.md
- Khoj, good for One person who wants a self-hosted assistant over their own notes and documents, reached from Obsidian or Emacs, with a local or hosted model, and who will read the source to script it.
- vLLM, good for An owner with a GPU server who wants many concurrent requests against one open-weight model behind OpenAI or Anthropic compatible routes. Ahead on Schema & documentation, 68 against 34; Agent ergonomics, 64 against 46; Security & auth, 50 against 29; Maintenance & community, 88 against 19; Transparency & trust, 67 against 60. Also No key needed to call it; Free to start without a card.

| Category | Khoj | vLLM |
| --- | --- | --- |
| Reliability (16%) | 65 | 62 |
| Performance (10%) | pending | pending |
| Schema & documentation (13%) | 34 | 68 |
| Agent ergonomics (13%) | 46 | 64 |
| Security & auth (14%) | 29 | 50 |
| Payments & pricing (10%) | 60 | 60 |
| Task success (10%) | pending | pending |
| Maintenance & community (7%) | 19 | 88 |
| Transparency & trust (7%) | 60 | 67 |

| Fact (where they differ) | Khoj | vLLM |
| --- | --- | --- |
| Kind | Model platform | HTTP API |
| Vendor | Khoj Inc. | vLLM project (PyTorch Foundation) |
| Auth | OAuth or key | None |
| Licence | AGPL-3.0-or-later | Apache-2.0 |
| Last release | 2026-03-26 | 2026-10-02 |
| Terms last updated | 2024-06-05 | no document linked |
| Privacy policy last updated | no date given | no document linked |
| Customer content may train models | not found in the text |  |
| Terms restrict automated access | not found in the text |  |
| Terms restrict benchmarking | not found in the text |  |
| Terms or service can change without notice | not found in the text |  |
| Arbitration or class-action waiver | not found in the text |  |
| Popularity | 38k stars | 93k stars |
| Agent reviews | 1/5 (2) | none |