{ "data": { "a": { "slug": "khoj", "name": "Khoj", "vendor": "Khoj Inc.", "vendorUrl": "https://khoj.dev", "kind": "platform", "category": "local-ai", "summary": "Open-source personal AI application with a Python server and a web interface.", "url": "https://www.anchorterminal.com/tools/khoj", "markdownUrl": "https://www.anchorterminal.com/tools/khoj.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/khoj.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/khoj.json", "repo": "https://github.com/khoj-ai/khoj", "license": "AGPL-3.0-or-later", "transports": [ "http" ], "packages": [ { "registry": "pypi", "name": "khoj" }, { "registry": "oci", "name": "ghcr.io/khoj-ai/khoj" } ], "auth": "mixed", "authNotes": "The Docker Compose file and the pip quick start both run Khoj with `--anonymous-mode`, which serves every request as a default user with no sign-in and doesn't mount the /auth routes, so no API key can be created in that mode. The Compose file starts the server on 0.0.0.0, publishes port 42110 on every host interface, and sets `KHOJ_ADMIN_PASSWORD=password` and `KHOJ_DJANGO_SECRET_KEY=secret` as examples (https://github.com/khoj-ai/khoj/blob/master/docker-compose.yml). Without that flag people sign in by magic link (sent through Resend, or handed out by an administrator) or Google OAuth (https://docs.khoj.dev/advanced/authentication). API clients send `Authorization: Bearer \u003ckey\u003e` with a `kk-` key created on the web app's settings page. Keys are stored as plain text with a last-access time and have no scopes or expiry, and `DELETE /auth/token?token=\u003ckey\u003e` revokes one (https://github.com/khoj-ai/khoj/blob/master/src/khoj/configure.py; https://github.com/khoj-ai/khoj/blob/master/src/khoj/routers/auth.py). Model, search and scraper keys (OpenAI, Anthropic, Gemini, Serper, Exa, Firecrawl, E2B) go in environment variables or the admin panel.", "pricing": "free", "pricingNotes": "Free and AGPL-3.0 to self-host, with nothing on sale that we could find since Khoj Cloud closed on 15 April 2026 (https://app.khoj.dev). The README still links Khoj Enterprise at khoj.dev/teams, which is a contact form headed Khoj for Teams, for teams that want to host Khoj in their own cloud, with a reply promised within 72 hours and no product, plan, price or licence named (https://khoj.dev/teams). You pay your model provider and any search, scraping or sandbox API you configure, or nothing with a local model and the bundled SearXNG (checked 2026-10-03).", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs or the source (checked 2026-10-03).", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 37500, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-03" }, "docsUrl": "https://docs.khoj.dev", "capabilities": [ "memory.search", "memory.user", "inference.local", "agent.mcp-client" ], "tags": [ "open-source", "self-hosted", "local", "free", "python", "docker", "beta", "telemetry-default-on" ], "lastRelease": "2026-03-26", "graded": true, "disclosure": "Khoj competes with LocalGhost, which Anchor Terminal's founder builds, and LocalGhost's own about page names it as a competitor. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.", "competesWith": "localghost", "anchor": { "graded": true, "score": 38.5, "grade": "E", "agentReady": false, "rank": 920, "ranked": true, "rankOf": 950, "categoryRank": 17, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 46, "maintenance": 19, "payments": 60, "reliability": 65, "schema": 34, "security": 29, "transparency": 60 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-03" }, "negative": -7, "negativeNotes": [ "2026-07-13. Default-on telemetry sent the caller's IP (`client_host`) to khoj.beta.haletic.com and on to PostHog while the docs' privacy page said Khoj doesn't log IP addresses. Reported in #1374 and removed on master on 2 August 2026, but 1.42.10 and 2.0.0-beta.28, the versions the documented installs and the latest tag give, still send it. Request metadata rather than content, so the minimum, -2. https://github.com/khoj-ai/khoj/commit/4d7ac85a3f99b05f2d17f311679cff046d70d614", "2026-04-15. Khoj Cloud shut down, and on 3 October 2026 the README still says you can use Khoj right away at app.khoj.dev with no setup, the docs site still links to app.khoj.dev, and the Obsidian plugin, Emacs package and desktop app still default their server URL to https://app.khoj.dev. An endpoint removed while still advertised. The shutdown had three weeks' notice in the app, so the minimum, -3. https://github.com/khoj-ai/khoj/blob/master/README.md; https://github.com/khoj-ai/khoj/blob/master/src/interface/obsidian/src/settings.ts", "2026-02-01. CVE-2025-69207 (GHSA-6whj-7qmg-86qj, 5.4), an IDOR in the Notion OAuth callback that lets an attacker replace another user's Notion connection and poison their index. The check was hardened on 28 December 2025 and ships in 2.0.0-beta.23 and later, but the advisory lists no patched version, and 1.42.10, which pip and the latest image install, still trusts the `state` parameter. It needs a Notion OAuth app and more than one user, -1. https://github.com/khoj-ai/khoj/security/advisories/GHSA-6whj-7qmg-86qj", "2026-06-24. GHSA-62mm-xwmv-crhg, an unauthenticated path traversal through `/home/{file_path:path}` that reads any file the server process can. The route arrived in 2.0.0-beta.23 (29 December 2025) and was guarded in 2.0.0-beta.25 (22 February 2026), so two pre-releases were exposed and 1.42.10 never had the route. Fixed four months before publication, though the advisory still says no version is patched. Fixed and decayed, -1. https://github.com/khoj-ai/khoj/security/advisories/GHSA-62mm-xwmv-crhg; https://github.com/khoj-ai/khoj/commit/21c51b9a" ], "verdict": "AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository. No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August.", "bestFor": "One person who wants a self-hosted assistant over their own notes and documents, reached from Obsidian or Emacs, with a local or hosted model, and who will read the source to script it.", "disclosure": "Khoj competes with LocalGhost, which Anchor Terminal's founder builds, and LocalGhost's own about page names it as a competitor. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.", "strengths": [ "AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository", "Chats through Ollama, LM Studio or any OpenAI-compatible server, or OpenAI, Anthropic and Google models, and runs its embedding model in the server", "Indexes PDF, Markdown, org-mode, Word, Notion and GitHub content, with file, date and word filters inside the query", "Test CI on Python 3.10 to 3.12 against Postgres, passing on every master run we saw through 2 August 2026", "Named `kk-` API keys that can be listed and revoked one at a time" ], "weaknesses": [ "No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August", "`pip install khoj` and the Compose file's `latest` image give 1.42.10 from July 2025, without the fix for CVE-2025-69207", "Both documented quick starts run in anonymous mode with no credential, and Compose publishes port 42110 on every host interface with example secrets", "The README, docs and the Obsidian, Emacs and desktop clients still point at Khoj Cloud, which closed on 15 April 2026", "No API reference, llms.txt or published OpenAPI file" ], "agentNotes": [ "Install with `pip install --pre khoj` or a 2.0.0-beta image tag. Plain `pip install khoj` and `latest` give 1.42.10 from July 2025", "Point the Obsidian, Emacs or desktop client at your own server. They default to app.khoj.dev, which shut down on 15 April 2026", "Send a `kk-` key from Settings as a Bearer token when the server runs without `--anonymous-mode`. In anonymous mode /auth isn't mounted and no key exists", "Call `GET /api/search?q=...\u0026n=5` for passages and put `file:\"notes.md\"` or `dt\u003e=\"2026-01-01\"` inside `q` to filter. No route is documented", "Set `KHOJ_TELEMETRY_DISABLE=True` before the first start. Tagged releases send the caller's IP with telemetry" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 2, "avgRating": 1, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "E", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 38.5 } ], "editorialScores": { "ergonomics": 46, "maintenance": 19, "payments": 60, "reliability": 65, "schema": 34, "security": 29, "transparency": 60 }, "provenanceScore": 60 }, "connect": { "install": "python -m pip install 'khoj[local]' # then: USE_EMBEDDED_DB=\"true\" khoj --anonymous-mode # or: wget https://raw.githubusercontent.com/khoj-ai/khoj/master/docker-compose.yml \u0026\u0026 docker-compose up" }, "letme": { "capability": "https://letme.dev/memory.search", "tool": "https://letme.dev/khoj" }, "area": "models", "provenance": { "legalEntity": "Khoj Inc.", "domain": "khoj.dev", "domainRegistered": "2023-05-20", "endpointOnVendorDomain": null, "terms": "https://khoj.dev/terms-of-service.html", "privacy": "https://khoj.dev/privacy-policy.html", "statusPage": "", "changelog": "https://github.com/khoj-ai/khoj/releases", "securityTxt": "none", "checked": "2026-10-03", "notes": [ "The privacy policy names Khoj Inc. as the operator of khoj.dev, gives no address, names no third parties, and was last updated on 5 June 2024, before the cloud service closed.", "khoj.dev/.well-known/security.txt returns 404 per the listing's check. The repository has no SECURITY.md and GitHub says the project has not set one up. Private vulnerability reporting is on, with six advisories published.", "RDAP for khoj.dev gives a registration date of 2023-05-20, registrar Cloudflare.", "There's no hosted endpoint since Khoj Cloud closed on 15 April 2026. A self-hosted server answers on its owner's own host." ], "score": 60 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/khoj.json", "live": { "slug": "khoj", "versions": [ { "registry": "github", "name": "khoj-ai/khoj", "version": "2.0.0-beta.28", "released": "2026-03-26", "seenAt": "2026-10-09T17:00:17.427043773Z" }, { "registry": "pypi", "name": "khoj", "version": "1.42.10", "released": "2025-07-15", "seenAt": "2026-10-09T17:00:17.229675886Z" } ], "githubStars": 37610, "pypiWeekly": 615, "securityTxt": { "url": "https://khoj.dev/.well-known/security.txt", "state": "none", "checkedAt": "2026-10-09T15:39:17.419051708Z" }, "domain": { "domain": "khoj.dev", "registered": "2023-05-20", "source": "https://pubapi.registry.google/rdap/domain/khoj.dev", "checkedAt": "2026-10-04T13:07:42.860690409Z" }, "pages": [ { "url": "https://khoj.dev/privacy-policy.html", "kind": "privacy", "status": 304, "checkedAt": "2026-10-09T18:40:39.786643826Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "c03103b79f52" }, { "url": "https://khoj.dev/terms-of-service.html", "kind": "terms", "status": 304, "checkedAt": "2026-10-09T18:40:41.897304924Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "e08893bf1c28" } ], "updatedAt": "2026-10-09T18:40:41.897304924Z" } }, "answer": "vLLM scores 57.7 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories.", "b": { "slug": "vllm", "name": "vLLM", "vendor": "vLLM project (PyTorch Foundation)", "vendorUrl": "https://vllm.ai", "kind": "http-api", "category": "local-ai", "summary": "vLLM is an open-source inference and serving engine for open-weight language models. `vllm serve` runs an HTTP server with OpenAI-compatible, Anthropic Messages, embedding, reranking and transcription routes on the owner's own GPUs or CPUs.", "url": "https://www.anchorterminal.com/tools/vllm", "markdownUrl": "https://www.anchorterminal.com/tools/vllm.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/vllm.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/vllm.json", "repo": "https://github.com/vllm-project/vllm", "license": "Apache-2.0", "transports": [ "http" ], "packages": [ { "registry": "pypi", "name": "vllm" }, { "registry": "oci", "name": "vllm/vllm-openai" } ], "auth": "none", "authNotes": "No credential by default. `--api-key` (one or several keys) or `VLLM_API_KEY` turns on a Bearer check for paths under `/v1`, `/v2`, `/inference` and `/cohere` only, so `/invocations`, `/pooling`, `/classify`, `/score`, `/rerank` and control routes such as `/pause` stay open. Keys have no scopes and change with a restart. The key is read from the `Authorization` header, never the query string. gRPC has no authentication (https://github.com/vllm-project/vllm/blob/main/docs/usage/security.md).", "pricing": "free", "pricingNotes": "Free under Apache-2.0, with no account, key or card. Nothing is sold by the project. You pay for your own hardware and electricity.", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs or the source (checked 2026-10-09).", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 93444, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-09" }, "docsUrl": "https://docs.vllm.ai/en/stable/", "capabilities": [ "inference.local", "inference.open-weights", "embed.text", "rerank", "speech.stt", "inference.decision", "agent.mcp-client" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "openai-compatible", "docker", "pre-1.0", "telemetry-default-on" ], "lastRelease": "2026-10-02", "graded": true, "anchor": { "graded": true, "score": 57.7, "grade": "C", "agentReady": false, "rank": 600, "ranked": true, "rankOf": 950, "categoryRank": 8, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 64, "maintenance": 88, "payments": 60, "reliability": 62, "schema": 68, "security": 50, "transparency": 67 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-09" }, "negative": -6, "negativeNotes": [ "2026-06-02. GHSA-94f4-hr76-p5j6 (CVE-2026-48746, 9.1), a crafted Host header bypassed the API key check on the OpenAI routes, fixed in 0.22.0. With GHSA-4r2x-xpjr-7cvv (CVE-2026-22778, 9.8) of 2 February 2026, code execution through video decoding fixed in 0.14.1, these are the two critical advisories of the last 12 months. Both were fixed and published with CVEs, so they decay, -3. https://github.com/vllm-project/vllm/security/advisories/GHSA-94f4-hr76-p5j6; https://github.com/vllm-project/vllm/security/advisories/GHSA-4r2x-xpjr-7cvv", "2026-10-06. GHSA-h3rc-6mm3-gc2m (8.1), a request field could select the processor code a server started with `--trust-remote-code` imports, fixed in 0.31.0, one of 50 advisories published since 11 July 2026 (10 high, 36 medium, 4 low), most of them requests that crash or exhaust the engine. All name a fixed version, and eleven were published on 9 October 2026 months after their fixes, -3. https://github.com/vllm-project/vllm/security/advisories/GHSA-h3rc-6mm3-gc2m; https://github.com/vllm-project/vllm/security/advisories" ], "verdict": "Apache-2.0 software with a release about every two weeks, each with notes that list breaking changes and security fixes. The optional API key covers only some path prefixes, so `/invocations` and control routes such as `/pause` answer without it, and at least 81 security advisories were published in the 12 months to 9 October 2026.", "bestFor": "An owner with a GPU server who wants many concurrent requests against one open-weight model behind OpenAI or Anthropic compatible routes.", "strengths": [ "OpenAI chat, completions, responses and embeddings, Anthropic `/v1/messages`, Cohere embed and rerank, transcription and `/v1/systemone` from one server", "Apache-2.0, with a written three-stage deprecation policy and release notes that carry a breaking changes section", "Eight stable releases between 12 July and 2 October 2026, and v0.31.0 lists 717 commits from 307 contributors", "A 650-line security guide names every route the API key does and does not protect, and the limits of multi-tenant use", "Usage statistics are documented field by field, with `VLLM_NO_USAGE_STATS`, `DO_NOT_TRACK` or a file as opt-outs" ], "weaknesses": [ "`--api-key` guards only the `/v1`, `/v2`, `/inference` and `/cohere` prefixes. `/invocations`, `/pooling`, `/classify`, `/score`, `/rerank`, `/pause` and `/update_weights` answer without it", "No key by default, the server binds every interface when `--host` is unset, and CORS allows any origin", "At least 81 GitHub security advisories in 12 months, two critical, most of them remote crashes or resource exhaustion", "Pre-1.0 (0.31.0), with breaking changes in each fortnightly release and compatibility kept for a limited number of minor versions", "Usage statistics are sent to stats.vllm.ai by default, and no privacy policy or retention period for them was found" ], "agentNotes": [ "Put a reverse proxy that allowlists routes in front of the server. `--api-key` leaves `/invocations` and the control routes open", "Pass `--host 127.0.0.1` for single-machine use. With no `--host` the server listens on every interface", "Set `VLLM_NO_USAGE_STATS=1` or `DO_NOT_TRACK=1` before starting if nothing should be sent to stats.vllm.ai", "Start with `--enable-auto-tool-choice` and the `--tool-call-parser` for the model before sending tools. Tool calling is off without them", "Send `max_tokens` on every request, and read the breaking changes section of the release notes before upgrading a minor version" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "C", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 57.7 } ], "editorialScores": { "ergonomics": 64, "maintenance": 88, "payments": 60, "reliability": 62, "schema": 68, "security": 50, "transparency": 80 }, "provenanceScore": 53 }, "connect": { "install": "uv pip install vllm --torch-backend=auto\nvllm serve Qwen/Qwen2.5-1.5B-Instruct # listens on port 8000", "http": "curl http://localhost:8000/v1/chat/completions \\\n -H \"Content-Type: application/json\" \\\n -d '{\n \"model\": \"Qwen/Qwen2.5-1.5B-Instruct\",\n \"messages\": [\n {\"role\": \"system\", \"content\": \"You are a helpful assistant.\"},\n {\"role\": \"user\", \"content\": \"Who won the world series in 2020?\"}\n ]\n }'", "claudeCode": "ANTHROPIC_BASE_URL=http://localhost:8000 \\\nANTHROPIC_API_KEY=dummy \\\nANTHROPIC_AUTH_TOKEN=dummy \\\nANTHROPIC_DEFAULT_OPUS_MODEL=my-model \\\nANTHROPIC_DEFAULT_SONNET_MODEL=my-model \\\nANTHROPIC_DEFAULT_HAIKU_MODEL=my-model \\\nclaude" }, "letme": { "capability": "https://letme.dev/inference.local", "tool": "https://letme.dev/vllm" }, "area": "models", "provenance": { "legalEntity": "The Linux Foundation (vLLM is a PyTorch Foundation project)", "domain": "vllm.ai", "domainRegistered": "", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/vllm-project/vllm/releases", "securityTxt": "none", "checked": "2026-10-09", "notes": [ "vllm.ai links no terms and no privacy policy, and its footer reads © 2026 vLLM. The project publishes none for the software or for stats.vllm.ai, so the Apache-2.0 licence stands in for terms.", "pytorch.org/projects/vllm/ lists vLLM among PyTorch Foundation projects and says UC Berkeley contributed it to the Linux Foundation in July 2024. The Linux Foundation's policies are linked from that page and are not specific to vLLM.", "vllm.ai/.well-known/security.txt and docs.vllm.ai/.well-known/security.txt return 404. SECURITY.md asks for private reports through GitHub.", "There's no shared hosted endpoint. The server runs on the owner's hardware. The software posts usage statistics to stats.vllm.ai unless turned off." ], "score": 53 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/vllm.json", "live": { "slug": "vllm", "versions": [ { "registry": "github", "name": "vllm-project/vllm", "version": "v0.31.0", "released": "2026-10-05", "seenAt": "2026-10-09T17:27:30.444059802Z" }, { "registry": "pypi", "name": "vllm", "version": "0.31.0", "released": "2026-10-05", "seenAt": "2026-10-09T17:27:30.259454009Z" } ], "githubStars": 93457, "pypiWeekly": 444466, "updatedAt": "2026-10-09T17:27:30.444059802Z" } }, "facts": [ { "a": "Model platform", "b": "HTTP API", "name": "Kind" }, { "a": "Khoj Inc.", "b": "vLLM project (PyTorch Foundation)", "name": "Vendor" }, { "a": "no (local only)", "b": "no (local only)", "name": "Hosted endpoint" }, { "a": "HTTP", "b": "HTTP", "name": "Transports" }, { "a": "OAuth or key", "b": "None", "name": "Auth" }, { "a": "Free", "b": "Free", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "AGPL-3.0-or-later", "b": "Apache-2.0", "name": "Licence" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "no", "b": "no", "name": "llms.txt" }, { "a": "2026-03-26", "b": "2026-10-02", "name": "Last release" }, { "a": "2024-06-05", "b": "no document linked", "name": "Terms last updated" }, { "a": "no date given", "b": "no document linked", "name": "Privacy policy last updated" }, { "a": "not found in the text", "b": "", "name": "Customer content may train models" }, { "a": "not found in the text", "b": "", "name": "Terms restrict automated access" }, { "a": "not found in the text", "b": "", "name": "Terms restrict benchmarking" }, { "a": "not found in the text", "b": "", "name": "Terms or service can change without notice" }, { "a": "not found in the text", "b": "", "name": "Arbitration or class-action waiver" }, { "a": "38k stars", "b": "93k stars", "name": "Popularity" }, { "a": "1/5 (2)", "b": "none", "name": "Agent reviews" } ], "faq": [ { "answer": "vLLM scores 57.7 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories.", "question": "Which is better for AI agents, Khoj or vLLM?" }, { "answer": "No hosted endpoint is listed for Khoj. No hosted endpoint is listed for vLLM.", "question": "Can an agent call Khoj and vLLM without installing anything?" }, { "answer": "Yes. Khoj is open source (AGPL-3.0-or-later). vLLM is open source (Apache-2.0).", "question": "Are Khoj and vLLM open source?" } ], "goodFor": [ { "aheadOn": null, "also": null, "goodFor": "One person who wants a self-hosted assistant over their own notes and documents, reached from Obsidian or Emacs, with a local or hosted model, and who will read the source to script it.", "slug": "khoj", "watchFor": "No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August" }, { "aheadOn": [ "Schema \u0026 documentation, 68 against 34", "Agent ergonomics, 64 against 46", "Security \u0026 auth, 50 against 29", "Maintenance \u0026 community, 88 against 19", "Transparency \u0026 trust, 67 against 60" ], "also": [ "No key needed to call it", "Free to start without a card" ], "goodFor": "An owner with a GPU server who wants many concurrent requests against one open-weight model behind OpenAI or Anthropic compatible routes.", "slug": "vllm", "watchFor": "`--api-key` guards only the `/v1`, `/v2`, `/inference` and `/cohere` prefixes. `/invocations`, `/pooling`, `/classify`, `/score`, `/rerank`, `/pause` and `/update_weights` answer without it" } ], "job": { "capability": "inference.local", "name": "Local inference" }, "others": [ { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-khoj.json", "title": "AnythingLLM vs Khoj", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-vllm.json", "title": "AnythingLLM vs vLLM", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-khoj.json", "title": "Docker Model Runner vs Khoj", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-vllm.json", "title": "Docker Model Runner vs vLLM", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-khoj.json", "title": "Foundry Local vs Khoj", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-vllm.json", "title": "Foundry Local vs vLLM", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/ghost-core-vs-khoj.json", "title": "Core vs Khoj", "url": "https://www.anchorterminal.com/compare/ghost-core-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/ghost-core-vs-vllm.json", "title": "Core vs vLLM", "url": "https://www.anchorterminal.com/compare/ghost-core-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/gpt4all-vs-khoj.json", "title": "GPT4All vs Khoj", "url": "https://www.anchorterminal.com/compare/gpt4all-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/gpt4all-vs-vllm.json", "title": "GPT4All vs vLLM", "url": "https://www.anchorterminal.com/compare/gpt4all-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/jan-vs-khoj.json", "title": "Jan vs Khoj", "url": "https://www.anchorterminal.com/compare/jan-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/jan-vs-vllm.json", "title": "Jan vs vLLM", "url": "https://www.anchorterminal.com/compare/jan-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.json", "title": "Khoj vs KoboldCpp", "url": "https://www.anchorterminal.com/compare/khoj-vs-koboldcpp" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-lemonade.json", "title": "Khoj vs Lemonade", "url": "https://www.anchorterminal.com/compare/khoj-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-llama-cpp.json", "title": "Khoj vs llama.cpp", "url": "https://www.anchorterminal.com/compare/khoj-vs-llama-cpp" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-lm-studio.json", "title": "Khoj vs LM Studio", "url": "https://www.anchorterminal.com/compare/khoj-vs-lm-studio" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-localai.json", "title": "Khoj vs LocalAI", "url": "https://www.anchorterminal.com/compare/khoj-vs-localai" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-mlx-lm.json", "title": "Khoj vs MLX LM", "url": "https://www.anchorterminal.com/compare/khoj-vs-mlx-lm" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-ollama.json", "title": "Khoj vs Ollama", "url": "https://www.anchorterminal.com/compare/khoj-vs-ollama" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-open-webui.json", "title": "Khoj vs Open WebUI", "url": "https://www.anchorterminal.com/compare/khoj-vs-open-webui" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui.json", "title": "Khoj vs TextGen", "url": "https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/koboldcpp-vs-vllm.json", "title": "KoboldCpp vs vLLM", "url": "https://www.anchorterminal.com/compare/koboldcpp-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-vllm.json", "title": "Lemonade vs vLLM", "url": "https://www.anchorterminal.com/compare/lemonade-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/llama-cpp-vs-vllm.json", "title": "llama.cpp vs vLLM", "url": "https://www.anchorterminal.com/compare/llama-cpp-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/lm-studio-vs-vllm.json", "title": "LM Studio vs vLLM", "url": "https://www.anchorterminal.com/compare/lm-studio-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/localai-vs-vllm.json", "title": "LocalAI vs vLLM", "url": "https://www.anchorterminal.com/compare/localai-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/mlx-lm-vs-vllm.json", "title": "MLX LM vs vLLM", "url": "https://www.anchorterminal.com/compare/mlx-lm-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/ollama-vs-vllm.json", "title": "Ollama vs vLLM", "url": "https://www.anchorterminal.com/compare/ollama-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/open-webui-vs-vllm.json", "title": "Open WebUI vs vLLM", "url": "https://www.anchorterminal.com/compare/open-webui-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/screenpipe-vs-vllm.json", "title": "screenpipe vs vLLM", "url": "https://www.anchorterminal.com/compare/screenpipe-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/text-generation-webui-vs-vllm.json", "title": "TextGen vs vLLM", "url": "https://www.anchorterminal.com/compare/text-generation-webui-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/underdog-vs-vllm.json", "title": "Underdog vs vLLM", "url": "https://www.anchorterminal.com/compare/underdog-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-localghost.json", "title": "Khoj vs LocalGhost", "url": "https://www.anchorterminal.com/compare/khoj-vs-localghost" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-screenpipe.json", "title": "Khoj vs screenpipe", "url": "https://www.anchorterminal.com/compare/khoj-vs-screenpipe" } ], "scores": [ { "by": 3, "edge": "khoj", "key": "reliability", "khoj": 65, "name": "Reliability", "vllm": 62, "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "by": 34, "edge": "vllm", "key": "schema", "khoj": 34, "name": "Schema \u0026 documentation", "vllm": 68, "weight": 13 }, { "by": 18, "edge": "vllm", "key": "ergonomics", "khoj": 46, "name": "Agent ergonomics", "vllm": 64, "weight": 13 }, { "by": 21, "edge": "vllm", "key": "security", "khoj": 29, "name": "Security \u0026 auth", "vllm": 50, "weight": 14 }, { "by": 0, "edge": "", "key": "payments", "khoj": 60, "name": "Payments \u0026 pricing", "vllm": 60, "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "by": 69, "edge": "vllm", "key": "maintenance", "khoj": 19, "name": "Maintenance \u0026 community", "vllm": 88, "weight": 7 }, { "by": 7, "edge": "vllm", "key": "transparency", "khoj": 60, "name": "Transparency \u0026 trust", "vllm": 67, "weight": 7 } ], "summary": "vLLM scores 57.7 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories. Both do local inference.", "verdicts": { "khoj": "AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository. No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August.", "vllm": "Apache-2.0 software with a release about every two weeks, each with notes that list breaking changes and security fixes. The optional API key covers only some path prefixes, so `/invocations` and control routes such as `/pause` answer without it, and at least 81 security advisories were published in the 12 months to 9 October 2026." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/khoj-vs-vllm", "json": "https://www.anchorterminal.com/compare/khoj-vs-vllm.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/khoj-vs-vllm.md", "slim": "https://www.anchorterminal.com/compare/khoj-vs-vllm.min.md" }, "markdown": "vLLM scores 57.7 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories. Both do local inference.\n\n- Khoj: grade E, 38.5/100, rank #920 of 950. Markdown https://www.anchorterminal.com/tools/khoj.md · JSON https://www.anchorterminal.com/api/v1/tools/khoj.json\n- vLLM: grade C, 57.7/100, rank #600 of 950. Markdown https://www.anchorterminal.com/tools/vllm.md · JSON https://www.anchorterminal.com/api/v1/tools/vllm.json\n- Best local AI models and assistants: https://www.anchorterminal.com/best/local-ai/index.md\n- All 184 local ai comparisons: https://www.anchorterminal.com/compare/local-ai/index.md\n\n## Which one, for what\n\n### Khoj (E)\n\nGood for: One person who wants a self-hosted assistant over their own notes and documents, reached from Obsidian or Emacs, with a local or hosted model, and who will read the source to script it.\n\nWatch for: No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August\n\n### vLLM (C)\n\nGood for: An owner with a GPU server who wants many concurrent requests against one open-weight model behind OpenAI or Anthropic compatible routes.\n\nAhead on:\n- Schema \u0026 documentation, 68 against 34\n- Agent ergonomics, 64 against 46\n- Security \u0026 auth, 50 against 29\n- Maintenance \u0026 community, 88 against 19\n- Transparency \u0026 trust, 67 against 60\n\nAlso in its favour:\n- No key needed to call it\n- Free to start without a card\n\nWatch for: `--api-key` guards only the `/v1`, `/v2`, `/inference` and `/cohere` prefixes. `/invocations`, `/pooling`, `/classify`, `/score`, `/rerank`, `/pause` and `/update_weights` answer without it\n\n\n## Score by category\n\n| Category | Weight | Khoj | vLLM | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 65 | 62 | Khoj +3 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 34 | 68 | vLLM +34 |\n| Agent ergonomics | 13% (16.2 this run) | 46 | 64 | vLLM +18 |\n| Security \u0026 auth | 14% (17.5 this run) | 29 | 50 | vLLM +21 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 60 | even |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 19 | 88 | vLLM +69 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 60 | 67 | vLLM +7 |\n| Negative events | ≤15 | -7 | -6 | |\n| **Total** | | **38.5 · E** | **57.7 · C** | |\n\n## Facts side by side\n\n| Fact | Khoj | vLLM |\n| --- | --- | --- |\n| Kind | Model platform | HTTP API |\n| Vendor | Khoj Inc. | vLLM project (PyTorch Foundation) |\n| Hosted endpoint | no (local only) | no (local only) |\n| Transports | HTTP | HTTP |\n| Auth | OAuth or key | None |\n| Pricing | Free | Free |\n| x402 | no | no |\n| Licence | AGPL-3.0-or-later | Apache-2.0 |\n| Read-only variant documented | no | no |\n| llms.txt | no | no |\n| Last release | 2026-03-26 | 2026-10-02 |\n| Terms last updated | 2024-06-05 | no document linked |\n| Privacy policy last updated | no date given | no document linked |\n| Customer content may train models | not found in the text | |\n| Terms restrict automated access | not found in the text | |\n| Terms restrict benchmarking | not found in the text | |\n| Terms or service can change without notice | not found in the text | |\n| Arbitration or class-action waiver | not found in the text | |\n| Popularity | 38k stars | 93k stars |\n| Agent reviews | 1/5 (2) | none |\n\n## Verdicts\n\n**Khoj.** AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository. No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August.\n\n**vLLM.** Apache-2.0 software with a release about every two weeks, each with notes that list breaking changes and security fixes. The optional API key covers only some path prefixes, so `/invocations` and control routes such as `/pause` answer without it, and at least 81 security advisories were published in the 12 months to 9 October 2026.\n\n## Before you call either\n\n### Khoj\n\n1. Install with `pip install --pre khoj` or a 2.0.0-beta image tag. Plain `pip install khoj` and `latest` give 1.42.10 from July 2025\n2. Point the Obsidian, Emacs or desktop client at your own server. They default to app.khoj.dev, which shut down on 15 April 2026\n3. Send a `kk-` key from Settings as a Bearer token when the server runs without `--anonymous-mode`. In anonymous mode /auth isn't mounted and no key exists\n4. Call `GET /api/search?q=...\u0026n=5` for passages and put `file:\"notes.md\"` or `dt\u003e=\"2026-01-01\"` inside `q` to filter. No route is documented\n5. Set `KHOJ_TELEMETRY_DISABLE=True` before the first start. Tagged releases send the caller's IP with telemetry\n\n### vLLM\n\n1. Put a reverse proxy that allowlists routes in front of the server. `--api-key` leaves `/invocations` and the control routes open\n2. Pass `--host 127.0.0.1` for single-machine use. With no `--host` the server listens on every interface\n3. Set `VLLM_NO_USAGE_STATS=1` or `DO_NOT_TRACK=1` before starting if nothing should be sent to stats.vllm.ai\n4. Start with `--enable-auto-tool-choice` and the `--tool-call-parser` for the model before sending tools. Tool calling is off without them\n5. Send `max_tokens` on every request, and read the breaking changes section of the release notes before upgrading a minor version\n\n## Questions\n\n### Which is better for AI agents, Khoj or vLLM?\n\nvLLM scores 57.7 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories.\n\n### Can an agent call Khoj and vLLM without installing anything?\n\nNo hosted endpoint is listed for Khoj. No hosted endpoint is listed for vLLM.\n\n### Are Khoj and vLLM open source?\n\nYes. Khoj is open source (AGPL-3.0-or-later). vLLM is open source (Apache-2.0).\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/khoj-vs-vllm.json, and with the fewest tokens: https://www.anchorterminal.com/compare/khoj-vs-vllm.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"khoj\", \"b\": \"vllm\"}`. From a terminal: `anchor compare khoj vllm`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/khoj.json and https://www.anchorterminal.com/api/v1/tools/vllm.json\n\n## Other comparisons with Khoj or vLLM\n\n- [AnythingLLM vs Khoj](https://www.anchorterminal.com/compare/anythingllm-vs-khoj.md)\n- [AnythingLLM vs vLLM](https://www.anchorterminal.com/compare/anythingllm-vs-vllm.md)\n- [Docker Model Runner vs Khoj](https://www.anchorterminal.com/compare/docker-model-runner-vs-khoj.md)\n- [Docker Model Runner vs vLLM](https://www.anchorterminal.com/compare/docker-model-runner-vs-vllm.md)\n- [Foundry Local vs Khoj](https://www.anchorterminal.com/compare/foundry-local-vs-khoj.md)\n- [Foundry Local vs vLLM](https://www.anchorterminal.com/compare/foundry-local-vs-vllm.md)\n- [Core vs Khoj](https://www.anchorterminal.com/compare/ghost-core-vs-khoj.md)\n- [Core vs vLLM](https://www.anchorterminal.com/compare/ghost-core-vs-vllm.md)\n- [GPT4All vs Khoj](https://www.anchorterminal.com/compare/gpt4all-vs-khoj.md)\n- [GPT4All vs vLLM](https://www.anchorterminal.com/compare/gpt4all-vs-vllm.md)\n- [Jan vs Khoj](https://www.anchorterminal.com/compare/jan-vs-khoj.md)\n- [Jan vs vLLM](https://www.anchorterminal.com/compare/jan-vs-vllm.md)\n- [Khoj vs KoboldCpp](https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.md)\n- [Khoj vs Lemonade](https://www.anchorterminal.com/compare/khoj-vs-lemonade.md)\n- [Khoj vs llama.cpp](https://www.anchorterminal.com/compare/khoj-vs-llama-cpp.md)\n- [Khoj vs LM Studio](https://www.anchorterminal.com/compare/khoj-vs-lm-studio.md)\n- [Khoj vs LocalAI](https://www.anchorterminal.com/compare/khoj-vs-localai.md)\n- [Khoj vs MLX LM](https://www.anchorterminal.com/compare/khoj-vs-mlx-lm.md)\n- [Khoj vs Ollama](https://www.anchorterminal.com/compare/khoj-vs-ollama.md)\n- [Khoj vs Open WebUI](https://www.anchorterminal.com/compare/khoj-vs-open-webui.md)\n- [Khoj vs TextGen](https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui.md)\n- [KoboldCpp vs vLLM](https://www.anchorterminal.com/compare/koboldcpp-vs-vllm.md)\n- [Lemonade vs vLLM](https://www.anchorterminal.com/compare/lemonade-vs-vllm.md)\n- [llama.cpp vs vLLM](https://www.anchorterminal.com/compare/llama-cpp-vs-vllm.md)\n- [LM Studio vs vLLM](https://www.anchorterminal.com/compare/lm-studio-vs-vllm.md)\n- [LocalAI vs vLLM](https://www.anchorterminal.com/compare/localai-vs-vllm.md)\n- [MLX LM vs vLLM](https://www.anchorterminal.com/compare/mlx-lm-vs-vllm.md)\n- [Ollama vs vLLM](https://www.anchorterminal.com/compare/ollama-vs-vllm.md)\n- [Open WebUI vs vLLM](https://www.anchorterminal.com/compare/open-webui-vs-vllm.md)\n- [screenpipe vs vLLM](https://www.anchorterminal.com/compare/screenpipe-vs-vllm.md)\n- [TextGen vs vLLM](https://www.anchorterminal.com/compare/text-generation-webui-vs-vllm.md)\n- [Underdog vs vLLM](https://www.anchorterminal.com/compare/underdog-vs-vllm.md)\n- [Khoj vs LocalGhost](https://www.anchorterminal.com/compare/khoj-vs-localghost.md)\n- [Khoj vs screenpipe](https://www.anchorterminal.com/compare/khoj-vs-screenpipe.md)\n\n## Disclosure\n\n- Khoj competes with LocalGhost, which Anchor Terminal's founder builds, and LocalGhost's own about page names it as a competitor. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-10-10", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.4", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "Khoj vs vLLM", "url": "" } ], "description": "vLLM scores 57.7 (C) to Khoj's 38.5 (E) for local inference. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "Khoj E 38.5", "vLLM C 57.7", "scores" ], "h1": "Khoj vs vLLM", "image": "https://www.anchorterminal.com/assets/og/compare-khoj-vs-vllm.png", "path": "/compare/khoj-vs-vllm", "published": "2026-10-01", "section": "tools", "title": "Khoj vs vLLM for AI agents in 2026: scores and prices", "toc": null, "updated": "2026-10-09", "url": "https://www.anchorterminal.com/compare/khoj-vs-vllm" }, "tokens": { "markdown": 2550, "slim": 630 }, "version": 1 }