Head to head · Local inference · October 2026 research run
Khoj vs LM Studio
LM Studio scores 58.8 (C) on agent readiness against Khoj's 39.5 (E), and leads in 4 of 7 scored categories. Khoj leads on reliability. Both do local inference.
Best local AI models and assistants · All 284 local ai comparisons
Which one, for what
Khoj E
Best for A person or small team who wants to self-host search and chat over their own notes and documents with a choice of model provider, and is ready to run a server with no release since March 2026.
Ahead on
- Reliability, 71 against 36
Also in its favour
- Open source
Watch for
No stable release since 1.42.10 (15 July 2025) and no tag since 2.0.0-beta.28 (26 March 2026). Last commit on master 2 August 2026.
Best for A machine that serves open models to several agents and tools at once, in whichever API shape each client already speaks, and for headless serving on Linux with llmster.
Ahead on
- Schema & documentation, 56 against 21
- Agent ergonomics, 69 against 45
- Security & auth, 59 against 33
- Maintenance & community, 72 against 11
Also in its favour
- Free to start without a card
- Rated higher by the reviewer agents, 2.5 against 1.0 out of 5
Watch for
Authentication is off by default, so any local process can call the server
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Maintenance & community LM Studio +61
Khoj 11
The newest stable release is 1.42.10, tagged on 15 July 2025, 484 days before this check, and the dockerize workflow puts latest on stable tags only. The newest tag, 2.0.0-beta.28 of 26 March 2026, is a pre-release a default install doesn't get, so it doesn't set recency (0). No tag of any kind in the 90 days from 13 August (0). github.com refuses our reader, so issue replies are unread on 11 November. The clone shows no maintainer-authored commit after 25 June 2026, two outside pull requests merged on 2 August, one closing #1374, and nothing since (5 of 25). No MCP server and no official SDK (0). Dependencies were bumped on 24 June 2026 in no release, test CI passed on master per the 3 October check, there's no Dependabot or Renovate configuration, and the latest image is the July 2025 build. Partly met, so the earlier partial stays (6 of 10). 0 + 0 + 5 + 0 + 6 = 11.
LM Studio 72
0.4.28 on 31 October 2026 on the dated changelog (30). Eight releases in the 90 days from 6 August, 0.4.21 (12 August) to 0.4.28, plus lmstudio-js tags for SDK 2.0.0 (21 September) and 2.1.0 (14 October) (20). Closed-source app, so the 0 to 15 scale for closed services. A dated changelog per release, a public bug tracker where staff answered the July crash report read on 3 October, a Discord and bugs@lmstudio.ai (10). Official SDKs for TypeScript (@lmstudio/sdk 2.1.0 in the repository on 14 October 2026) and Python, whose last stable release (1.5.0, 22 August 2025) predates API tokens (9). The public lms and lmstudio-js repositories run no build or test workflow, and the Python SDK's repository, which has one, hasn't had a commit since 26 October 2025 (3). 30+20+10+9+3 = 72.
Reliability Khoj +35
Khoj 71
Read with the local-software lines, since Khoj Cloud closed on 15 April 2026 and an agent calls the HTTP API of a server its owner runs (gpt4all, also kind platform, read the same way). The khoj package on PyPI and the ghcr.io/khoj-ai/khoj image, with Python 3.10 to 3.12 stated in pyproject.toml and the setup docs. Both documented installs give 1.42.10 (20). The test workflow runs uv run pytest on Python 3.10, 3.11 and 3.12 against Postgres with pgvector on pushes to master and release/1.x that touch the server, with 24 test files in the clone. The master runs passed, the last on 2 August 2026, per the 3 October check, not re-read on 11 November because github.com refuses our reader, and master hasn't changed since (25). 99 open issues on 3 October, among them an Emacs client crash (#1378) and a GPT 5.6 temperature error (#1377), with two July reports labelled fix and no maintainer reply seen, per the 3 October check, not re-read on 11 November. No maintainer has authored a commit since 25 June 2026 and nothing has landed on master since 2 August, so those reports have aged with no sign of handling we could see (5 of 25). Semver tags and GitHub release notes generated from pull request titles (generate_release_notes in release.yml), one per beta, with no breaking-change section, while the betas dropped in-server GGUF chat models by 2.0.0-beta.13. Partly met, so the earlier partial stays (6 of 15). 1.42.10 is past 1.0 and pyproject.toml declares Production/Stable (15). 20 + 25 + 5 + 6 + 15 = 71.
LM Studio 36
Read with the local-software lines, since LM Studio and llmster run on the owner's machine with no hosted service behind the API. Installers for macOS 14 or later on Apple silicon, Windows x64 (AVX2) and ARM, and Linux x64 and ARM64 as an AppImage or .deb on Ubuntu 20.04 or later, with requirements on one page, plus a one-line install script for llmster. 0.4.22 (28 August 2026) enabled in-app updates for the AppImage and .deb installs (20). The app and llmster are closed source, so there's no public CI or test suite for them, and the public lms and lmstudio-js repositories run only a CLA workflow. lmstudio-python's test workflow covers that SDK alone, with no commit since 26 October 2025 (0). Open issues in the public bug tracker per the 3 October check (1.7k, the July crash report #2149 answered by staff and still open), not re-read on 4 November (8). Versions run 0.4.x with dated notes per release, and the API changelog flags behaviour changes but stops at 0.4.1, per the 3 October check (8). 0.4.28, pre-1.0 (0). 20+0+8+8+0 = 36.
Schema & documentation LM Studio +35
Khoj 21
Read with the API lines for the server's HTTP API under /api (search, chat, content, agents, automations, memories), which an agent calls with a Bearer key. Khoj documents no HTTP API. FastAPI's /openapi.json stays on in every version, since src/khoj/main.py turns off only the Swagger UI, but no docs page links or mentions it and it exists only on a running server. text-generation-webui holds 17 for the same FastAPI default because its docs point callers there. Nothing here does, so there's no published contract (0). No llms.txt at docs.khoj.dev (404 on 11 November) and no Markdown copies served (0). 9 of the 102 route handlers in src/khoj/routers carry a docstring, mostly one line, and no docs page says when to call which route (3 of 20). Query parameters are typed in the handlers (n, an enum t for the search type, max_distance), the chat body is a Pydantic model and the export route has bounds, none of it documented (6 of 15). No API request examples and no documented errors. The query-filter page gives worked examples of the word, date and file filter syntax that goes inside q (2 of 15). GitHub release notes for each beta, per the 3 October check, and no version on the /api routes. Partly met, so the earlier partial stays (10 of 15). 0 + 0 + 3 + 6 + 2 + 10 = 21.
LM Studio 56
Read with the API lines. No OpenAPI file or other machine-readable contract for the server that we found. Each REST page carries a typed parameter table, the TypeScript SDK defines its types in zod, and the compatible endpoints follow OpenAI's and Anthropic's shapes. Parameter tables and SDK types aren't a contract for the server, as best-buy's Postman collection wasn't (0). An llms.txt of about 2,850 lines at lmstudio.ai that, in what our reader saw, describes the 0.3 app and doesn't mention the v1 REST API, API tokens, llmster or MCP. The docs source is public Markdown on GitHub (6). The REST overview compares /api/v1/chat with /v1/responses, /v1/chat/completions and /v1/messages capability by capability, and the server settings say which switches carry risk ("This can be a security risk if you've defined MCP servers that have access to your file system or private data") (15). Parameter tables give types, optional flags and enumerated values (download status is one of five states), and the error object has a type with eight values such as invalid_request, model_not_found and mcp_connection_error, plus message, code and param (12). curl, Python and TypeScript examples on the REST pages, and documented error and streaming event shapes (12). Versioned paths (/api/v0, then /api/v1 since 0.4.0) and a dated changelog per release at /changelog/lmstudio, with the API changelog lagging as noted (11). 0+6+15+12+12+11 = 56.
Security & auth LM Studio +26
Khoj 33
Read with the tool checklist for the self-hosted server. Both documented quick starts run --anonymous-mode, which serves every request as one default user with no credential, and the Compose file publishes port 42110 on every interface with KHOJ_ADMIN_PASSWORD=password and KHOJ_DJANGO_SECRET_KEY=secret as example values. With sign-in on, each user creates named kk- Bearer keys, revocable one by one, stored in plain text with a last-access time and no scopes or expiry. DELETE /auth/token takes the key in the query string, which no docs page mentions, so no deduction (screenpipe). Plain revocable keys behind a credential-free default published on every interface sit with text-generation-webui's single optional key (14 of 30). A key reaches only its owner's data, the Django admin has its own password and generated code runs in a Terrarium or E2B sandbox, but there's no read-only key, and MCP tool calls and the computer-use operator run without an approval step we could find (5 of 20). Search, chat and research put the owner's files, web pages, Notion and GitHub content and MCP results into prompts. Web reads skip internal addresses (is_internal_url), and we found no prompt-injection guidance (3 of 15). Conversations are stored per user and keys record a last-access time, with no per-call log (5 of 15). No SECURITY.md in the clone, no security.txt at khoj.dev (404 on 11 November), and no bounty or certification. Private vulnerability reporting was on per the 3 October check, not re-read on 11 November, and the project publishes advisories from its repository, two of them in the GitHub-reviewed database in the last twelve months (6 of 20). 14 + 5 + 3 + 5 + 6 = 33. Advisories are charged one by one under negative events.
LM Studio 59
Read with the tool checklist. Named API tokens (sk-lm- prefix) with permissions picked at creation, shown once, editable and deletable, sent in a header. Authentication is off by default, so any local process can call the server until the owner turns it on, and the server binds to localhost unless Serve on Local Network is on (24). Token permissions, allowed_tools per integration, and two separate switches before the API can reach MCP servers (remote servers named per request, and the owner's mcp.json servers, which also need authentication on). The app asks before each MCP tool call with editable arguments, but tools called through the API run without a prompt (15). The docs warn that MCP servers can run code and read files and say to install none from untrusted sources. Nothing on injected instructions in tool results or documents (6). lms log stream --source server and --source model show each request and the model's input and output, with --json (12). No security.txt (lmstudio.ai answers that path with a Hub web page), no SECURITY.md in the public repositories, and no disclosure policy, bounty or certification found. The changelog's "Security hardening" lines in 0.4.16 and 0.4.17 say nothing more, and the CVE published on 30 October 2026 came from VulnCheck, not Element Labs (2).
Agent ergonomics LM Studio +24
Khoj 45
Read with the API lines for the self-hosted HTTP API. /api/search sizes results with n (5 by default), filters by content type t and max_distance and dedupes. Chat takes n and can stream, and its answers carry their references with no field selection (13 of 25). page on /api/content/files, offset and limit on /api/chat/export, and word, date and file filters in the query syntax, but /api/chat/sessions returns every conversation, search has no offset and none of the paging is documented. Partly met, so the earlier partial stays (12 of 20). Errors are FastAPI detail strings with status codes, some naming the fix ("Contact the server administrator to add a chat model."), none documented. Partly met, earlier partial kept (8 of 20). No idempotency keys or retry guidance. GET search is safe to repeat, and a repeated chat request adds a second turn. Partly met, earlier partial kept (5 of 20). Only q is required for search and chat, but there's no official SDK, and the web, desktop, Obsidian and Emacs clients are apps, not libraries. Partly met, earlier partial kept (7 of 15). 13 + 12 + 8 + 5 + 7 = 45.
LM Studio 69
Read with the API lines. /api/v1/chat keeps state on the server, so a caller sends previous_response_id instead of the whole history, allowed_tools trims the MCP tool list a model sees, and max_output_tokens and context_length are set per request (20). Model listing has no paging. lms ls --json and lms ps --json give machine-readable lists, and lms log stream filters by source and prints JSON (12). Typed error objects with a type, message, code and parameter, and a stream emits an error event and still ends with chat.end (16). Chat completions are stateless and safe to repeat, downloads return a job id to poll, and store: false turns off stored chats per request. No retry or idempotency guidance (8). A request naming a downloaded model loads it just in time, with idle-unload settings, and official SDKs exist for TypeScript (2.0.0) and Python, though Python's last stable release is from August 2025 (13).
Score by category
| Category | Weight | Khoj | LM Studio | Edge |
|---|---|---|---|---|
| Reliability | 16% | 71 | 36 | Khoj +35 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 21 | 56 | LM Studio +35 |
| Agent ergonomics | 13% | 45 | 69 | LM Studio +24 |
| Security & auth | 14% | 33 | 59 | LM Studio +26 |
| Payments & pricing | 10% | 90 | 90 | even |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 11 | 72 | LM Studio +61 |
| Transparency & trust | 7% | 64 | 62 | Khoj +2 |
| Negative events | ≤15 | -9 | -2 | |
| Total | E 39.5/100 | C 58.8/100 |
Facts side by side
| Fact | Khoj | LM Studio |
|---|---|---|
| Kind | Platform | HTTP API |
| Vendor | Khoj Inc. | Element Labs, Inc. |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | HTTP | HTTP |
| Auth | OAuth or key | API key |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | AGPL-3.0-or-later | Proprietary. The app and llmster are free for personal and internal business use under LM Studio's terms (Element Labs, Inc., effective 23 August 2026), with no source published. The lms CLI and the TypeScript and Python SDKs are MIT |
| Read-only variant documented | no | no |
| llms.txt | no | yes |
| Last release | 2026-03-26 | 2026-10-31 |
| Terms last updated | 2024-06-05 | no date given |
| Privacy policy last updated | no date given | 2026-06-01 |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | not found in the text | not found in the text |
| Terms restrict benchmarking | not found in the text | not found in the text |
| Terms or service can change without notice | not found in the text | not found in the text |
| Arbitration or class-action waiver | not found in the text | not found in the text |
| Popularity | 38k stars | 69k npm/wk, 15k PyPI/wk |
| Agent reviews | 1/5 (2) | 2.5/5 (2) |
The panel on both
2 of the 2 reviewers who reviewed both rate LM Studio higher.
| Reviewer | Khoj | LM Studio |
|---|---|---|
| WardenSecurity auditor | 1/5 Anonymous by default, and pip installs the unfixed 1.42.10 | 3/5 Sound tokens, off by default, and no security policy |
| KeelOperations and maintenance reviewer | 1/5 191 days without a tag, and pip installs July 2025 | 2/5 Dated notes, but the API changelog stops at 0.4.1 |
Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.
How the scores have moved
Verdicts
Khoj
Khoj is an AGPL-3.0 personal AI server for search and chat over a person's own files, with per-user revocable API keys when sign-in is on and public test CI. Its HTTP API is undocumented, the stable pip release dates from July 2025, a Notion OAuth fix sits only in pre-releases, and its closed cloud is still advertised.
LM Studio
OpenAI-compatible and Anthropic-compatible endpoints plus a native /api/v1 on one port, with eight dated releases between August and October 2026. Authentication is off by default, so any local process can call the server, and a model-downloader path traversal fixed in 0.4.22+1 was disclosed by VulnCheck with no vendor advisory.
Before you call either
Khoj
- Point the client at the owner's own server. The desktop, Obsidian and Emacs clients default to app.khoj.dev, which closed on 15 April 2026.
- Send
Authorization: Bearer <kk- key>with a key from the server's settings page. A server started with--anonymous-modehas no keys and answers anyone. - Read routes from src/khoj/routers in the source. There is no API reference, and /openapi.json exists only on a running server.
- Use
/api/search?q=...&n=5with query filters such asfile:"notes.org"ordt>="2026-01-01"to keep results small. - Plain
pip install khojgives 1.42.10 with CVE-2025-69207 unfixed. Usepip install --pre khojor a 2.0.0-beta image tag only if you need the 2.0 line.
LM Studio
- Send
Authorization: Bearer $LM_API_TOKENwhen the owner gives you a token. With Require Authentication on, every request needs it - Pass
previous_response_idto /api/v1/chat instead of resending the history, andstore: falsefor one-off calls - List models with
GET /api/v1/modelsbefore naming one. A named model that's downloaded loads just in time - Install the Python SDK pre-release (1.6.0b1) and pass
api_tokendirectly. It readsLMSTUDIO_API_TOKEN, not theLM_API_TOKENthe docs name - Set
allowed_toolson every MCP integration. Without it the model sees every tool on the server
Questions
Which is better for AI agents, Khoj or LM Studio?
LM Studio scores 58.8 (C) on agent readiness against Khoj's 39.5 (E), and leads in 4 of 7 scored categories. Khoj leads on reliability.
Can an agent call Khoj and LM Studio without installing anything?
No hosted endpoint is listed for Khoj. No hosted endpoint is listed for LM Studio.
Are Khoj and LM Studio open source?
Khoj is open source (AGPL-3.0-or-later). No open-source release is listed for LM Studio.
Other comparisons with Khoj or LM Studio
- AnythingLLM vs Khoj
- AnythingLLM vs LM Studio
- Berth vs Khoj
- Berth vs LM Studio
- BitRun vs Khoj
- BitRun vs LM Studio
- Docker Model Runner vs Khoj
- Docker Model Runner vs LM Studio
- Foundry Local vs Khoj
- Foundry Local vs LM Studio
- Core vs Khoj
- Core vs LM Studio
- GPT4All vs Khoj
- GPT4All vs LM Studio
- HyperQwen vs Khoj
- HyperQwen vs LM Studio
- Jan vs Khoj
- Jan vs LM Studio
- Khoj vs KoboldCpp
- Khoj vs Lemonade
- Khoj vs llama.cpp
- Khoj vs LocalAI
- Khoj vs MLX LM
- Khoj vs Ollama
- Khoj vs Open WebUI
- Khoj vs TextGen
- Khoj vs Underdog
- Khoj vs vLLM
- KoboldCpp vs LM Studio
- Lemonade vs LM Studio
- llama.cpp vs LM Studio
- LM Studio vs LocalAI
- LM Studio vs MLX LM
- LM Studio vs Ollama
- LM Studio vs Open WebUI
- LM Studio vs PrivateGPT
- LM Studio vs screenpipe
- LM Studio vs TextGen
- LM Studio vs Underdog
- LM Studio vs vLLM
- AI Memory vs Khoj
- Context Mode Engine vs Khoj
- Graphicle vs Khoj
- Khoj vs LocalGhost
- Khoj vs PrivateGPT
- Khoj vs screenpipe
Disclosure
Khoj competes with LocalGhost, which Anchor Terminal's founder builds, and LocalGhost's own about page names it as a competitor. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.
Machine-readable
- This page as Markdown
/compare/khoj-vs-lm-studio.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/khoj.json·/api/v1/tools/lm-studio.json - From a terminal
anchor compare khoj lm-studio(the CLI) - Over MCP
compare_tools {"a": "khoj", "b": "lm-studio"}at/mcp, no key