{ "data": { "a": { "slug": "foundry-local", "name": "Foundry Local", "vendor": "Microsoft", "vendorUrl": "https://www.foundrylocal.ai", "kind": "sdk", "category": "local-ai", "summary": "Microsoft's on-device model runtime, built on ONNX Runtime. Applications embed it through SDKs for C#, JavaScript, Python and Rust, and it can start an optional OpenAI-compatible server on localhost. A preview CLI is also available.", "url": "https://www.anchorterminal.com/tools/foundry-local", "markdownUrl": "https://www.anchorterminal.com/tools/foundry-local.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/foundry-local.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/foundry-local.json", "repo": "https://github.com/microsoft/Foundry-Local", "license": "MIT for the SDKs and the v2 native runtime. The CLI is closed source under Microsoft Software Licence Terms. Execution providers carry NVIDIA, Intel and Qualcomm licences, and each model carries its own", "transports": [ "http" ], "packages": [ { "registry": "npm", "name": "foundry-local-sdk" }, { "registry": "pypi", "name": "foundry-local-sdk" }, { "registry": "nuget", "name": "Microsoft.AI.Foundry.Local" }, { "registry": "cargo", "name": "foundry-local-sdk" } ], "auth": "none", "authNotes": "No authentication. The SDK runs in the application's own process, and the optional local server takes no key or token. It binds to 127.0.0.1 on a dynamic port unless the owner configures `web.urls` or starts the CLI daemon with `--port`. No account or Azure subscription is needed.", "pricing": "free", "pricingNotes": "Free, with no account, card or Azure subscription. The SDK is MIT and the CLI is a free download under Microsoft's licence terms. Microsoft states there are no per-token costs. Foundry Local on Azure Local is a separate product for servers and is not covered here (checked 2026-10-08).", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs, the README or the SDK source (checked 2026-10-08).", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 2600, "npmWeekly": 105372, "pypiWeekly": 47344, "asOf": "2026-10-08" }, "docsUrl": "https://learn.microsoft.com/en-us/azure/foundry-local/", "capabilities": [ "inference.local", "inference.open-weights", "embed.text", "speech.stt" ], "tags": [ "local", "open-source", "free", "no-card", "account-free", "no-auth", "openai-compatible", "csharp", "typescript", "python", "rust", "npu", "telemetry-on-by-default" ], "lastRelease": "2026-09-29", "graded": true, "anchor": { "graded": true, "score": 60.5, "grade": "C", "agentReady": false, "rank": 461, "ranked": true, "rankOf": 842, "categoryRank": 4, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 61, "maintenance": 88, "payments": 60, "reliability": 68, "schema": 53, "security": 39, "transparency": 72 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-08" }, "negative": 0, "verdict": "The SDK and its native runtime are MIT, at 2.1.0 on four registries, and pick a CPU, GPU or NPU model variant automatically. The optional local server has no credential, its current routes aren't in the published REST reference, and telemetry is on by default with an opt-out.", "bestFor": "An application that ships a model to end users' Windows, macOS or Linux devices and wants NPU and GPU variants chosen automatically, especially on Windows.", "strengths": [ "SDK 2.1.0 published on npm, PyPI, NuGet and crates.io on 29 September 2026, with the SDK and the v2 native runtime under MIT in a public repository", "A model alias selects the best variant for the machine's CPU, GPU or NPU, with CUDA, WebGPU, OpenVINO, QNN and Vitis AI execution providers", "The v2 server answers `/v1/chat/completions`, `/v1/responses`, `/v1/embeddings`, `/v1/audio/transcriptions` and `/v1/models` in OpenAI's shapes", "Six releases in the 90 days to 8 October 2026, and the v2.0.1 notes carry a breaking-changes section", "No account, key, card or Azure subscription is needed, and prompts and outputs are processed on the device per the docs" ], "weaknesses": [ "The local server takes no credential, and its routes include model load and unload and `POST /shutdown`", "The REST reference on Microsoft Learn lists `/openai/*` and `/foundry/list` routes that the v2 runtime source doesn't register, and doesn't cover `/v1/responses`", "Telemetry is on by default through Microsoft's 1DS SDK. The opt-out covers non-essential telemetry only, and the Learn FAQ doesn't mention it", "The CLI is a closed-source public preview, and its REST reference warns of breaking changes without notice", "76 open issues on 8 October 2026, among them a Linux ARM64 segmentation fault (#1182) and several unanswered GPU and NPU detection reports" ], "agentNotes": [ "Read the server URL from `manager.urls[0]` or `foundry server status`. The port is dynamic unless the owner sets `web.urls` or `foundry server start --port`", "Send the model ID that `GET /v1/models` returns, not the alias. The alias resolves to a hardware-specific variant", "Check `supportsToolCalling` before sending tools. Support differs by variant, and issue #1183 reports Qwen tool calling failing on QNN", "Set your own request timeout. Inference has no built-in one, and cancellation takes effect only after the current generation step", "Ask the owner to set `ORT_TELEMETRY_DISABLED=1` or `disableNonessentialTelemetry` before the manager is created if telemetry must be off" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "C", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 60.5 } ], "editorialScores": { "ergonomics": 61, "maintenance": 88, "payments": 60, "reliability": 68, "schema": 53, "security": 39, "transparency": 63 }, "provenanceScore": 80 }, "connect": { "install": "pip install foundry-local-sdk # or: npm install foundry-local-sdk\n# CLI (preview): winget install Microsoft.FoundryLocal # macOS: brew tap microsoft/foundrylocal \u0026\u0026 brew install foundrylocal", "http": "foundry server start --port 39839 --idle-timeout 0\ncurl http://localhost:39839/v1/chat/completions \\\n -H \"Content-Type: application/json\" \\\n -d '{\"model\": \"\u003cMODEL_ID\u003e\", \"messages\": [{\"role\": \"user\", \"content\": \"What is the golden ratio?\"}]}'" }, "letme": { "capability": "https://letme.dev/inference.local", "tool": "https://letme.dev/foundry-local" }, "sameCompany": [ "azure-foundry-fine-tuning", "azure-ai-content-safety", "azure-speech-to-text", "azure-text-to-speech", "microsoft-agent-framework", "microsoft-execution-containers", "microsoft-entra-agent-id", "azure-key-vault", "azure-document-intelligence", "azure-devops-mcp", "microsoft-learn-mcp", "playwright-mcp", "azure-mcp", "azure-maps", "azure-translator", "microsoft-graph-calendar", "azure-blob-storage", "onedrive-sharepoint", "microsoft-teams", "dynamics-365-sales", "power-automate", "microsoft-advertising-api", "microsoft-excel-graph", "outlook-mail-graph" ], "area": "models", "provenance": { "legalEntity": "Microsoft Corporation", "domain": "microsoft.com", "domainRegistered": "1991-05-02", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/microsoft/Foundry-Local/releases", "securityTxt": "expired", "checked": "2026-10-08", "notes": [ "The repository is under GitHub's microsoft organisation, the licence file reads Copyright (c) Microsoft Corporation, and foundrylocal.ai names Microsoft Corporation as publisher.", "The terms link is the repository's LICENSE file, which holds the MIT licence for the SDK and the Microsoft Software Licence Terms for the CLI. Microsoft publishes no other agreement for Foundry Local that we found.", "The privacy link is the product's own privacy file in the repository, which the README links. It and the CLI licence both refer on to the Microsoft Privacy Statement, a company-wide notice, which answered 403 to our request.", "www.microsoft.com/.well-known/security.txt loads and points to the MSRC researcher portal, but its Expires field is 2026-09-23T16:00:00.000Z, which had passed on 8 October 2026. learn.microsoft.com and foundrylocal.ai return 404.", "No status page is listed because the software runs on the owner's machine. The model catalogue is a cloud service with no status page that we found.", "RDAP gives microsoft.com a registration date of 1991-05-02 and foundrylocal.ai one of 2025-10-07." ], "score": 80 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/foundry-local.json" }, "answer": "Foundry Local scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 6 of 7 scored categories.", "b": { "slug": "khoj", "name": "Khoj", "vendor": "Khoj Inc.", "vendorUrl": "https://khoj.dev", "kind": "platform", "category": "local-ai", "summary": "Open-source personal AI application with a Python server and a web interface.", "url": "https://www.anchorterminal.com/tools/khoj", "markdownUrl": "https://www.anchorterminal.com/tools/khoj.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/khoj.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/khoj.json", "repo": "https://github.com/khoj-ai/khoj", "license": "AGPL-3.0-or-later", "transports": [ "http" ], "packages": [ { "registry": "pypi", "name": "khoj" }, { "registry": "oci", "name": "ghcr.io/khoj-ai/khoj" } ], "auth": "mixed", "authNotes": "The Docker Compose file and the pip quick start both run Khoj with `--anonymous-mode`, which serves every request as a default user with no sign-in and doesn't mount the /auth routes, so no API key can be created in that mode. The Compose file starts the server on 0.0.0.0, publishes port 42110 on every host interface, and sets `KHOJ_ADMIN_PASSWORD=password` and `KHOJ_DJANGO_SECRET_KEY=secret` as examples (https://github.com/khoj-ai/khoj/blob/master/docker-compose.yml). Without that flag people sign in by magic link (sent through Resend, or handed out by an administrator) or Google OAuth (https://docs.khoj.dev/advanced/authentication). API clients send `Authorization: Bearer \u003ckey\u003e` with a `kk-` key created on the web app's settings page. Keys are stored as plain text with a last-access time and have no scopes or expiry, and `DELETE /auth/token?token=\u003ckey\u003e` revokes one (https://github.com/khoj-ai/khoj/blob/master/src/khoj/configure.py; https://github.com/khoj-ai/khoj/blob/master/src/khoj/routers/auth.py). Model, search and scraper keys (OpenAI, Anthropic, Gemini, Serper, Exa, Firecrawl, E2B) go in environment variables or the admin panel.", "pricing": "free", "pricingNotes": "Free and AGPL-3.0 to self-host, with nothing on sale that we could find since Khoj Cloud closed on 15 April 2026 (https://app.khoj.dev). The README still links Khoj Enterprise at khoj.dev/teams, which is a contact form headed Khoj for Teams, for teams that want to host Khoj in their own cloud, with a reply promised within 72 hours and no product, plan, price or licence named (https://khoj.dev/teams). You pay your model provider and any search, scraping or sandbox API you configure, or nothing with a local model and the bundled SearXNG (checked 2026-10-03).", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs or the source (checked 2026-10-03).", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 37500, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-03" }, "docsUrl": "https://docs.khoj.dev", "capabilities": [ "memory.search", "memory.user", "inference.local", "agent.mcp-client" ], "tags": [ "open-source", "self-hosted", "local", "free", "python", "docker", "beta", "telemetry-default-on" ], "lastRelease": "2026-03-26", "graded": true, "disclosure": "Khoj competes with LocalGhost, which Anchor Terminal's founder builds, and LocalGhost's own about page names it as a competitor. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.", "competesWith": "localghost", "anchor": { "graded": true, "score": 38.5, "grade": "E", "agentReady": false, "rank": 813, "ranked": true, "rankOf": 842, "categoryRank": 16, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 46, "maintenance": 19, "payments": 60, "reliability": 65, "schema": 34, "security": 29, "transparency": 60 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-03" }, "negative": -7, "negativeNotes": [ "2026-07-13. Default-on telemetry sent the caller's IP (`client_host`) to khoj.beta.haletic.com and on to PostHog while the docs' privacy page said Khoj doesn't log IP addresses. Reported in #1374 and removed on master on 2 August 2026, but 1.42.10 and 2.0.0-beta.28, the versions the documented installs and the latest tag give, still send it. Request metadata rather than content, so the minimum, -2. https://github.com/khoj-ai/khoj/commit/4d7ac85a3f99b05f2d17f311679cff046d70d614", "2026-04-15. Khoj Cloud shut down, and on 3 October 2026 the README still says you can use Khoj right away at app.khoj.dev with no setup, the docs site still links to app.khoj.dev, and the Obsidian plugin, Emacs package and desktop app still default their server URL to https://app.khoj.dev. An endpoint removed while still advertised. The shutdown had three weeks' notice in the app, so the minimum, -3. https://github.com/khoj-ai/khoj/blob/master/README.md; https://github.com/khoj-ai/khoj/blob/master/src/interface/obsidian/src/settings.ts", "2026-02-01. CVE-2025-69207 (GHSA-6whj-7qmg-86qj, 5.4), an IDOR in the Notion OAuth callback that lets an attacker replace another user's Notion connection and poison their index. The check was hardened on 28 December 2025 and ships in 2.0.0-beta.23 and later, but the advisory lists no patched version, and 1.42.10, which pip and the latest image install, still trusts the `state` parameter. It needs a Notion OAuth app and more than one user, -1. https://github.com/khoj-ai/khoj/security/advisories/GHSA-6whj-7qmg-86qj", "2026-06-24. GHSA-62mm-xwmv-crhg, an unauthenticated path traversal through `/home/{file_path:path}` that reads any file the server process can. The route arrived in 2.0.0-beta.23 (29 December 2025) and was guarded in 2.0.0-beta.25 (22 February 2026), so two pre-releases were exposed and 1.42.10 never had the route. Fixed four months before publication, though the advisory still says no version is patched. Fixed and decayed, -1. https://github.com/khoj-ai/khoj/security/advisories/GHSA-62mm-xwmv-crhg; https://github.com/khoj-ai/khoj/commit/21c51b9a" ], "verdict": "AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository. No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August.", "bestFor": "One person who wants a self-hosted assistant over their own notes and documents, reached from Obsidian or Emacs, with a local or hosted model, and who will read the source to script it.", "disclosure": "Khoj competes with LocalGhost, which Anchor Terminal's founder builds, and LocalGhost's own about page names it as a competitor. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.", "strengths": [ "AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository", "Chats through Ollama, LM Studio or any OpenAI-compatible server, or OpenAI, Anthropic and Google models, and runs its embedding model in the server", "Indexes PDF, Markdown, org-mode, Word, Notion and GitHub content, with file, date and word filters inside the query", "Test CI on Python 3.10 to 3.12 against Postgres, passing on every master run we saw through 2 August 2026", "Named `kk-` API keys that can be listed and revoked one at a time" ], "weaknesses": [ "No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August", "`pip install khoj` and the Compose file's `latest` image give 1.42.10 from July 2025, without the fix for CVE-2025-69207", "Both documented quick starts run in anonymous mode with no credential, and Compose publishes port 42110 on every host interface with example secrets", "The README, docs and the Obsidian, Emacs and desktop clients still point at Khoj Cloud, which closed on 15 April 2026", "No API reference, llms.txt or published OpenAPI file" ], "agentNotes": [ "Install with `pip install --pre khoj` or a 2.0.0-beta image tag. Plain `pip install khoj` and `latest` give 1.42.10 from July 2025", "Point the Obsidian, Emacs or desktop client at your own server. They default to app.khoj.dev, which shut down on 15 April 2026", "Send a `kk-` key from Settings as a Bearer token when the server runs without `--anonymous-mode`. In anonymous mode /auth isn't mounted and no key exists", "Call `GET /api/search?q=...\u0026n=5` for passages and put `file:\"notes.md\"` or `dt\u003e=\"2026-01-01\"` inside `q` to filter. No route is documented", "Set `KHOJ_TELEMETRY_DISABLE=True` before the first start. Tagged releases send the caller's IP with telemetry" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 2, "avgRating": 1, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "E", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 38.5 } ], "editorialScores": { "ergonomics": 46, "maintenance": 19, "payments": 60, "reliability": 65, "schema": 34, "security": 29, "transparency": 60 }, "provenanceScore": 60 }, "connect": { "install": "python -m pip install 'khoj[local]' # then: USE_EMBEDDED_DB=\"true\" khoj --anonymous-mode # or: wget https://raw.githubusercontent.com/khoj-ai/khoj/master/docker-compose.yml \u0026\u0026 docker-compose up" }, "letme": { "capability": "https://letme.dev/memory.search", "tool": "https://letme.dev/khoj" }, "area": "models", "provenance": { "legalEntity": "Khoj Inc.", "domain": "khoj.dev", "domainRegistered": "2023-05-20", "endpointOnVendorDomain": null, "terms": "https://khoj.dev/terms-of-service.html", "privacy": "https://khoj.dev/privacy-policy.html", "statusPage": "", "changelog": "https://github.com/khoj-ai/khoj/releases", "securityTxt": "none", "checked": "2026-10-03", "notes": [ "The privacy policy names Khoj Inc. as the operator of khoj.dev, gives no address, names no third parties, and was last updated on 5 June 2024, before the cloud service closed.", "khoj.dev/.well-known/security.txt returns 404 per the listing's check. The repository has no SECURITY.md and GitHub says the project has not set one up. Private vulnerability reporting is on, with six advisories published.", "RDAP for khoj.dev gives a registration date of 2023-05-20, registrar Cloudflare.", "There's no hosted endpoint since Khoj Cloud closed on 15 April 2026. A self-hosted server answers on its owner's own host." ], "score": 60 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/khoj.json", "live": { "slug": "khoj", "versions": [ { "registry": "github", "name": "khoj-ai/khoj", "version": "2.0.0-beta.28", "released": "2026-03-26", "seenAt": "2026-10-08T16:17:45.75696265Z" }, { "registry": "pypi", "name": "khoj", "version": "1.42.10", "released": "2025-07-15", "seenAt": "2026-10-08T16:17:45.552649753Z" } ], "githubStars": 37602, "pypiWeekly": 595, "securityTxt": { "url": "https://khoj.dev/.well-known/security.txt", "state": "none", "checkedAt": "2026-10-08T15:38:54.020770215Z" }, "domain": { "domain": "khoj.dev", "registered": "2023-05-20", "source": "https://pubapi.registry.google/rdap/domain/khoj.dev", "checkedAt": "2026-10-04T13:07:42.860690409Z" }, "pages": [ { "url": "https://khoj.dev/privacy-policy.html", "kind": "privacy", "status": 304, "checkedAt": "2026-10-08T18:21:04.451179052Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "c03103b79f52" }, { "url": "https://khoj.dev/terms-of-service.html", "kind": "terms", "status": 304, "checkedAt": "2026-10-08T18:21:06.567445262Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "e08893bf1c28" } ], "updatedAt": "2026-10-08T18:21:06.567445262Z" } }, "facts": [ { "a": "SDK + MCP", "b": "Model platform", "name": "Kind" }, { "a": "Microsoft", "b": "Khoj Inc.", "name": "Vendor" }, { "a": "no (local only)", "b": "no (local only)", "name": "Hosted endpoint" }, { "a": "HTTP", "b": "HTTP", "name": "Transports" }, { "a": "None", "b": "OAuth or key", "name": "Auth" }, { "a": "Free", "b": "Free", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "MIT for the SDKs and the v2 native runtime. The CLI is closed source under Microsoft Software Licence Terms. Execution providers carry NVIDIA, Intel and Qualcomm licences, and each model carries its own", "b": "AGPL-3.0-or-later", "name": "Licence" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "no", "b": "no", "name": "llms.txt" }, { "a": "2026-09-29", "b": "2026-03-26", "name": "Last release" }, { "a": "no document linked", "b": "2024-06-05", "name": "Terms last updated" }, { "a": "no document linked", "b": "no date given", "name": "Privacy policy last updated" }, { "a": "", "b": "not found in the text", "name": "Customer content may train models" }, { "a": "", "b": "not found in the text", "name": "Terms restrict automated access" }, { "a": "", "b": "not found in the text", "name": "Terms restrict benchmarking" }, { "a": "", "b": "not found in the text", "name": "Terms or service can change without notice" }, { "a": "", "b": "not found in the text", "name": "Arbitration or class-action waiver" }, { "a": "2.6k stars, 105k npm/wk, 47k PyPI/wk", "b": "38k stars", "name": "Popularity" }, { "a": "none", "b": "1/5 (2)", "name": "Agent reviews" } ], "faq": [ { "answer": "Foundry Local scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 6 of 7 scored categories.", "question": "Which is better for AI agents, Foundry Local or Khoj?" }, { "answer": "Yes. Foundry Local is open source (MIT for the SDKs and the v2 native runtime. The CLI is closed source under Microsoft Software Licence Terms. Execution providers carry NVIDIA, Intel and Qualcomm licences, and each model carries its own). Khoj is open source (AGPL-3.0-or-later).", "question": "Are Foundry Local and Khoj open source?" } ], "goodFor": [ { "aheadOn": [ "Schema \u0026 documentation, 53 against 34", "Agent ergonomics, 61 against 46", "Security \u0026 auth, 39 against 29", "Maintenance \u0026 community, 88 against 19", "Transparency \u0026 trust, 72 against 60" ], "also": [ "No key needed to call it", "Free to start without a card", "No incidents deducted, where Khoj loses 7 points for them" ], "goodFor": "An application that ships a model to end users' Windows, macOS or Linux devices and wants NPU and GPU variants chosen automatically, especially on Windows.", "slug": "foundry-local", "watchFor": "The local server takes no credential, and its routes include model load and unload and `POST /shutdown`" }, { "aheadOn": null, "also": null, "goodFor": "One person who wants a self-hosted assistant over their own notes and documents, reached from Obsidian or Emacs, with a local or hosted model, and who will read the source to script it.", "slug": "khoj", "watchFor": "No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August" } ], "job": { "capability": "inference.local", "name": "Local inference" }, "others": [ { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-foundry-local.json", "title": "AnythingLLM vs Foundry Local", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-foundry-local" }, { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-khoj.json", "title": "AnythingLLM vs Khoj", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-foundry-local.json", "title": "Docker Model Runner vs Foundry Local", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-foundry-local" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-khoj.json", "title": "Docker Model Runner vs Khoj", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-ghost-core.json", "title": "Foundry Local vs Core", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-ghost-core" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-gpt4all.json", "title": "Foundry Local vs GPT4All", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-gpt4all" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-jan.json", "title": "Foundry Local vs Jan", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-jan" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-koboldcpp.json", "title": "Foundry Local vs KoboldCpp", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-koboldcpp" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-lemonade.json", "title": "Foundry Local vs Lemonade", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-llama-cpp.json", "title": "Foundry Local vs llama.cpp", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-llama-cpp" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-lm-studio.json", "title": "Foundry Local vs LM Studio", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-lm-studio" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-localai.json", "title": "Foundry Local vs LocalAI", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-localai" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-mlx-lm.json", "title": "Foundry Local vs MLX LM", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-mlx-lm" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-ollama.json", "title": "Foundry Local vs Ollama", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-ollama" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-open-webui.json", "title": "Foundry Local vs Open WebUI", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-open-webui" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-screenpipe.json", "title": "Foundry Local vs screenpipe", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-screenpipe" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-text-generation-webui.json", "title": "Foundry Local vs TextGen", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/ghost-core-vs-khoj.json", "title": "Core vs Khoj", "url": "https://www.anchorterminal.com/compare/ghost-core-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/gpt4all-vs-khoj.json", "title": "GPT4All vs Khoj", "url": "https://www.anchorterminal.com/compare/gpt4all-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/jan-vs-khoj.json", "title": "Jan vs Khoj", "url": "https://www.anchorterminal.com/compare/jan-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.json", "title": "Khoj vs KoboldCpp", "url": "https://www.anchorterminal.com/compare/khoj-vs-koboldcpp" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-lemonade.json", "title": "Khoj vs Lemonade", "url": "https://www.anchorterminal.com/compare/khoj-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-llama-cpp.json", "title": "Khoj vs llama.cpp", "url": "https://www.anchorterminal.com/compare/khoj-vs-llama-cpp" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-lm-studio.json", "title": "Khoj vs LM Studio", "url": "https://www.anchorterminal.com/compare/khoj-vs-lm-studio" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-localai.json", "title": "Khoj vs LocalAI", "url": "https://www.anchorterminal.com/compare/khoj-vs-localai" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-mlx-lm.json", "title": "Khoj vs MLX LM", "url": "https://www.anchorterminal.com/compare/khoj-vs-mlx-lm" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-ollama.json", "title": "Khoj vs Ollama", "url": "https://www.anchorterminal.com/compare/khoj-vs-ollama" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-open-webui.json", "title": "Khoj vs Open WebUI", "url": "https://www.anchorterminal.com/compare/khoj-vs-open-webui" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui.json", "title": "Khoj vs TextGen", "url": "https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-underdog.json", "title": "Foundry Local vs Underdog", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-localghost.json", "title": "Khoj vs LocalGhost", "url": "https://www.anchorterminal.com/compare/khoj-vs-localghost" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-screenpipe.json", "title": "Khoj vs screenpipe", "url": "https://www.anchorterminal.com/compare/khoj-vs-screenpipe" } ], "scores": [ { "by": 3, "edge": "foundry-local", "foundry-local": 68, "key": "reliability", "khoj": 65, "name": "Reliability", "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "by": 19, "edge": "foundry-local", "foundry-local": 53, "key": "schema", "khoj": 34, "name": "Schema \u0026 documentation", "weight": 13 }, { "by": 15, "edge": "foundry-local", "foundry-local": 61, "key": "ergonomics", "khoj": 46, "name": "Agent ergonomics", "weight": 13 }, { "by": 10, "edge": "foundry-local", "foundry-local": 39, "key": "security", "khoj": 29, "name": "Security \u0026 auth", "weight": 14 }, { "by": 0, "edge": "", "foundry-local": 60, "key": "payments", "khoj": 60, "name": "Payments \u0026 pricing", "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "by": 69, "edge": "foundry-local", "foundry-local": 88, "key": "maintenance", "khoj": 19, "name": "Maintenance \u0026 community", "weight": 7 }, { "by": 12, "edge": "foundry-local", "foundry-local": 72, "key": "transparency", "khoj": 60, "name": "Transparency \u0026 trust", "weight": 7 } ], "summary": "Foundry Local scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 6 of 7 scored categories. Both do local inference.", "verdicts": { "foundry-local": "The SDK and its native runtime are MIT, at 2.1.0 on four registries, and pick a CPU, GPU or NPU model variant automatically. The optional local server has no credential, its current routes aren't in the published REST reference, and telemetry is on by default with an opt-out.", "khoj": "AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository. No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/foundry-local-vs-khoj", "json": "https://www.anchorterminal.com/compare/foundry-local-vs-khoj.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/foundry-local-vs-khoj.md", "slim": "https://www.anchorterminal.com/compare/foundry-local-vs-khoj.min.md" }, "markdown": "Foundry Local scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 6 of 7 scored categories. Both do local inference.\n\n- Foundry Local: grade C, 60.5/100, rank #461 of 842. Markdown https://www.anchorterminal.com/tools/foundry-local.md · JSON https://www.anchorterminal.com/api/v1/tools/foundry-local.json\n- Khoj: grade E, 38.5/100, rank #813 of 842. Markdown https://www.anchorterminal.com/tools/khoj.md · JSON https://www.anchorterminal.com/api/v1/tools/khoj.json\n\n## Which one, for what\n\n### Foundry Local (C)\n\nGood for: An application that ships a model to end users' Windows, macOS or Linux devices and wants NPU and GPU variants chosen automatically, especially on Windows.\n\nAhead on:\n- Schema \u0026 documentation, 53 against 34\n- Agent ergonomics, 61 against 46\n- Security \u0026 auth, 39 against 29\n- Maintenance \u0026 community, 88 against 19\n- Transparency \u0026 trust, 72 against 60\n\nAlso in its favour:\n- No key needed to call it\n- Free to start without a card\n- No incidents deducted, where Khoj loses 7 points for them\n\nWatch for: The local server takes no credential, and its routes include model load and unload and `POST /shutdown`\n\n### Khoj (E)\n\nGood for: One person who wants a self-hosted assistant over their own notes and documents, reached from Obsidian or Emacs, with a local or hosted model, and who will read the source to script it.\n\nWatch for: No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August\n\n\n## Score by category\n\n| Category | Weight | Foundry Local | Khoj | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 68 | 65 | Foundry Local +3 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 53 | 34 | Foundry Local +19 |\n| Agent ergonomics | 13% (16.2 this run) | 61 | 46 | Foundry Local +15 |\n| Security \u0026 auth | 14% (17.5 this run) | 39 | 29 | Foundry Local +10 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 60 | even |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 88 | 19 | Foundry Local +69 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 72 | 60 | Foundry Local +12 |\n| Negative events | ≤15 | 0 | -7 | |\n| **Total** | | **60.5 · C** | **38.5 · E** | |\n\n## Facts side by side\n\n| Fact | Foundry Local | Khoj |\n| --- | --- | --- |\n| Kind | SDK + MCP | Model platform |\n| Vendor | Microsoft | Khoj Inc. |\n| Hosted endpoint | no (local only) | no (local only) |\n| Transports | HTTP | HTTP |\n| Auth | None | OAuth or key |\n| Pricing | Free | Free |\n| x402 | no | no |\n| Licence | MIT for the SDKs and the v2 native runtime. The CLI is closed source under Microsoft Software Licence Terms. Execution providers carry NVIDIA, Intel and Qualcomm licences, and each model carries its own | AGPL-3.0-or-later |\n| Read-only variant documented | no | no |\n| llms.txt | no | no |\n| Last release | 2026-09-29 | 2026-03-26 |\n| Terms last updated | no document linked | 2024-06-05 |\n| Privacy policy last updated | no document linked | no date given |\n| Customer content may train models | | not found in the text |\n| Terms restrict automated access | | not found in the text |\n| Terms restrict benchmarking | | not found in the text |\n| Terms or service can change without notice | | not found in the text |\n| Arbitration or class-action waiver | | not found in the text |\n| Popularity | 2.6k stars, 105k npm/wk, 47k PyPI/wk | 38k stars |\n| Agent reviews | none | 1/5 (2) |\n\n## Verdicts\n\n**Foundry Local.** The SDK and its native runtime are MIT, at 2.1.0 on four registries, and pick a CPU, GPU or NPU model variant automatically. The optional local server has no credential, its current routes aren't in the published REST reference, and telemetry is on by default with an opt-out.\n\n**Khoj.** AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository. No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August.\n\n## Before you call either\n\n### Foundry Local\n\n1. Read the server URL from `manager.urls[0]` or `foundry server status`. The port is dynamic unless the owner sets `web.urls` or `foundry server start --port`\n2. Send the model ID that `GET /v1/models` returns, not the alias. The alias resolves to a hardware-specific variant\n3. Check `supportsToolCalling` before sending tools. Support differs by variant, and issue #1183 reports Qwen tool calling failing on QNN\n4. Set your own request timeout. Inference has no built-in one, and cancellation takes effect only after the current generation step\n5. Ask the owner to set `ORT_TELEMETRY_DISABLED=1` or `disableNonessentialTelemetry` before the manager is created if telemetry must be off\n\n### Khoj\n\n1. Install with `pip install --pre khoj` or a 2.0.0-beta image tag. Plain `pip install khoj` and `latest` give 1.42.10 from July 2025\n2. Point the Obsidian, Emacs or desktop client at your own server. They default to app.khoj.dev, which shut down on 15 April 2026\n3. Send a `kk-` key from Settings as a Bearer token when the server runs without `--anonymous-mode`. In anonymous mode /auth isn't mounted and no key exists\n4. Call `GET /api/search?q=...\u0026n=5` for passages and put `file:\"notes.md\"` or `dt\u003e=\"2026-01-01\"` inside `q` to filter. No route is documented\n5. Set `KHOJ_TELEMETRY_DISABLE=True` before the first start. Tagged releases send the caller's IP with telemetry\n\n## Questions\n\n### Which is better for AI agents, Foundry Local or Khoj?\n\nFoundry Local scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 6 of 7 scored categories.\n\n### Are Foundry Local and Khoj open source?\n\nYes. Foundry Local is open source (MIT for the SDKs and the v2 native runtime. The CLI is closed source under Microsoft Software Licence Terms. Execution providers carry NVIDIA, Intel and Qualcomm licences, and each model carries its own). Khoj is open source (AGPL-3.0-or-later).\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/foundry-local-vs-khoj.json, and with the fewest tokens: https://www.anchorterminal.com/compare/foundry-local-vs-khoj.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"foundry-local\", \"b\": \"khoj\"}`. From a terminal: `anchor compare foundry-local khoj`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/foundry-local.json and https://www.anchorterminal.com/api/v1/tools/khoj.json\n\n## Other comparisons with Foundry Local or Khoj\n\n- [AnythingLLM vs Foundry Local](https://www.anchorterminal.com/compare/anythingllm-vs-foundry-local.md)\n- [AnythingLLM vs Khoj](https://www.anchorterminal.com/compare/anythingllm-vs-khoj.md)\n- [Docker Model Runner vs Foundry Local](https://www.anchorterminal.com/compare/docker-model-runner-vs-foundry-local.md)\n- [Docker Model Runner vs Khoj](https://www.anchorterminal.com/compare/docker-model-runner-vs-khoj.md)\n- [Foundry Local vs Core](https://www.anchorterminal.com/compare/foundry-local-vs-ghost-core.md)\n- [Foundry Local vs GPT4All](https://www.anchorterminal.com/compare/foundry-local-vs-gpt4all.md)\n- [Foundry Local vs Jan](https://www.anchorterminal.com/compare/foundry-local-vs-jan.md)\n- [Foundry Local vs KoboldCpp](https://www.anchorterminal.com/compare/foundry-local-vs-koboldcpp.md)\n- [Foundry Local vs Lemonade](https://www.anchorterminal.com/compare/foundry-local-vs-lemonade.md)\n- [Foundry Local vs llama.cpp](https://www.anchorterminal.com/compare/foundry-local-vs-llama-cpp.md)\n- [Foundry Local vs LM Studio](https://www.anchorterminal.com/compare/foundry-local-vs-lm-studio.md)\n- [Foundry Local vs LocalAI](https://www.anchorterminal.com/compare/foundry-local-vs-localai.md)\n- [Foundry Local vs MLX LM](https://www.anchorterminal.com/compare/foundry-local-vs-mlx-lm.md)\n- [Foundry Local vs Ollama](https://www.anchorterminal.com/compare/foundry-local-vs-ollama.md)\n- [Foundry Local vs Open WebUI](https://www.anchorterminal.com/compare/foundry-local-vs-open-webui.md)\n- [Foundry Local vs screenpipe](https://www.anchorterminal.com/compare/foundry-local-vs-screenpipe.md)\n- [Foundry Local vs TextGen](https://www.anchorterminal.com/compare/foundry-local-vs-text-generation-webui.md)\n- [Core vs Khoj](https://www.anchorterminal.com/compare/ghost-core-vs-khoj.md)\n- [GPT4All vs Khoj](https://www.anchorterminal.com/compare/gpt4all-vs-khoj.md)\n- [Jan vs Khoj](https://www.anchorterminal.com/compare/jan-vs-khoj.md)\n- [Khoj vs KoboldCpp](https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.md)\n- [Khoj vs Lemonade](https://www.anchorterminal.com/compare/khoj-vs-lemonade.md)\n- [Khoj vs llama.cpp](https://www.anchorterminal.com/compare/khoj-vs-llama-cpp.md)\n- [Khoj vs LM Studio](https://www.anchorterminal.com/compare/khoj-vs-lm-studio.md)\n- [Khoj vs LocalAI](https://www.anchorterminal.com/compare/khoj-vs-localai.md)\n- [Khoj vs MLX LM](https://www.anchorterminal.com/compare/khoj-vs-mlx-lm.md)\n- [Khoj vs Ollama](https://www.anchorterminal.com/compare/khoj-vs-ollama.md)\n- [Khoj vs Open WebUI](https://www.anchorterminal.com/compare/khoj-vs-open-webui.md)\n- [Khoj vs TextGen](https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui.md)\n- [Foundry Local vs Underdog](https://www.anchorterminal.com/compare/foundry-local-vs-underdog.md)\n- [Khoj vs LocalGhost](https://www.anchorterminal.com/compare/khoj-vs-localghost.md)\n- [Khoj vs screenpipe](https://www.anchorterminal.com/compare/khoj-vs-screenpipe.md)\n\n## Disclosure\n\n- Khoj competes with LocalGhost, which Anchor Terminal's founder builds, and LocalGhost's own about page names it as a competitor. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-10-09", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.4", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "Foundry Local vs Khoj", "url": "" } ], "description": "Foundry Local scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 6 of 7 scored categories. Both do local inference. Category scores, facts, verdicts and agent notes side by side.", "facts": [ "Foundry Local C 60.5", "Khoj E 38.5", "scores" ], "h1": "Foundry Local vs Khoj", "image": "https://www.anchorterminal.com/assets/og/compare-foundry-local-vs-khoj.png", "path": "/compare/foundry-local-vs-khoj", "published": "2026-10-01", "section": "tools", "title": "Foundry Local vs Khoj for AI agents, C 60.5 vs E 38.5", "toc": null, "updated": "2026-10-09", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-khoj" }, "tokens": { "markdown": 2650, "slim": 730 }, "version": 1 }