# Khoj vs KoboldCpp

> KoboldCpp scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories. Khoj leads on transparency & trust. Both do local inference. Category scores, facts, verdicts and agent notes side by side.

- Canonical: https://www.anchorterminal.com/compare/khoj-vs-koboldcpp
- Markdown: https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.md (~2,600 tokens)
- Slim: https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.min.md (~730 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (full text: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- Updated: 2026-10-09

KoboldCpp scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories. Khoj leads on transparency & trust. Both do local inference.

- Khoj: grade E, 38.5/100, rank #813 of 842. Markdown https://www.anchorterminal.com/tools/khoj.md · JSON https://www.anchorterminal.com/api/v1/tools/khoj.json
- KoboldCpp: grade C, 60.5/100, rank #462 of 842. Markdown https://www.anchorterminal.com/tools/koboldcpp.md · JSON https://www.anchorterminal.com/api/v1/tools/koboldcpp.json

## Which one, for what

### Khoj (E)

Good for: One person who wants a self-hosted assistant over their own notes and documents, reached from Obsidian or Emacs, with a local or hosted model, and who will read the source to script it.

Ahead on:
- Transparency & trust, 60 against 49

Watch for: No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August

### KoboldCpp (C)

Good for: An owner who wants text, image, speech and music models behind one executable with a writing and roleplay interface, and clients that speak the KoboldAI, OpenAI, Ollama or Anthropic formats.

Ahead on:
- Schema & documentation, 68 against 34
- Agent ergonomics, 63 against 46
- Security & auth, 38 against 29
- Maintenance & community, 82 against 19

Also in its favour:
- No key needed to call it
- Free to start without a card
- No incidents deducted, where Khoj loses 7 points for them

Watch for: With no `--host` the server accepts connections on all routable interfaces, and no password is set by default


## Score by category

| Category | Weight | Khoj | KoboldCpp | Edge |
| --- | --- | --- | --- | --- |
| Reliability | 16% (20 this run) | 65 | 68 | KoboldCpp +3 |
| Performance | 10%, pending | pending | pending | not scored in this run |
| Schema & documentation | 13% (16.2 this run) | 34 | 68 | KoboldCpp +34 |
| Agent ergonomics | 13% (16.2 this run) | 46 | 63 | KoboldCpp +17 |
| Security & auth | 14% (17.5 this run) | 29 | 38 | KoboldCpp +9 |
| Payments & pricing | 10% (12.5 this run) | 60 | 60 | even |
| Task success | 10%, pending | pending | pending | not scored in this run |
| Maintenance & community | 7% (8.8 this run) | 19 | 82 | KoboldCpp +63 |
| Transparency & trust | 7% (8.8 this run) | 60 | 49 | Khoj +11 |
| Negative events | ≤15 | -7 | 0 | |
| **Total** | | **38.5 · E** | **60.5 · C** | |

## Facts side by side

| Fact | Khoj | KoboldCpp |
| --- | --- | --- |
| Kind | Model platform | HTTP API |
| Vendor | Khoj Inc. | LostRuins (Concedo) |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | HTTP | HTTP |
| Auth | OAuth or key | None |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | AGPL-3.0-or-later | AGPL-3.0 for KoboldCpp and KoboldAI Lite. The bundled GGML, llama.cpp and stable-diffusion.cpp code stays under MIT |
| Read-only variant documented | no | no |
| llms.txt | no | yes |
| Last release | 2026-03-26 | 2026-09-27 |
| Terms last updated | 2024-06-05 | no document linked |
| Privacy policy last updated | no date given | no document linked |
| Customer content may train models | not found in the text |  |
| Terms restrict automated access | not found in the text |  |
| Terms restrict benchmarking | not found in the text |  |
| Terms or service can change without notice | not found in the text |  |
| Arbitration or class-action waiver | not found in the text |  |
| Popularity | 38k stars | 12k stars |
| Agent reviews | 1/5 (2) | none |

## Verdicts

**Khoj.** AGPL-3.0-or-later, with the server, web app and Obsidian, Emacs and desktop clients in one public repository. No tagged release since 2.0.0-beta.28 on 26 March 2026 and no commit since 2 August.

**KoboldCpp.** One file runs text, image, speech and music models behind a published OpenAPI 3.0.3 document, with eight releases in 90 days. The server listens on every interface with no password by default, and `--password` leaves the image routes open.

## Before you call either

### Khoj

1. Install with `pip install --pre khoj` or a 2.0.0-beta image tag. Plain `pip install khoj` and `latest` give 1.42.10 from July 2025
2. Point the Obsidian, Emacs or desktop client at your own server. They default to app.khoj.dev, which shut down on 15 April 2026
3. Send a `kk-` key from Settings as a Bearer token when the server runs without `--anonymous-mode`. In anonymous mode /auth isn't mounted and no key exists
4. Call `GET /api/search?q=...&n=5` for passages and put `file:"notes.md"` or `dt>="2026-01-01"` inside `q` to filter. No route is documented
5. Set `KHOJ_TELEMETRY_DISABLE=True` before the first start. Tagged releases send the caller's IP with telemetry

### KoboldCpp

1. Start with `--host 127.0.0.1` and `--password`. The default listens on every interface with no key
2. Send the password as `Authorization: Bearer <password>`. It is not read from the query string
3. Treat 503 as both busy and rate limited. The server never sends 429 or `Retry-After`, and the wait in seconds is in `detail.msg`
4. Pass `max_length` or `max_tokens`. The default is 2,048 tokens unless `--defaultgenamt` changes it
5. Send a `genkey` with each generation so `/api/extra/generate/check` and `/api/extra/abort` act on your request and not another caller's

## Questions

### Which is better for AI agents, Khoj or KoboldCpp?

KoboldCpp scores 60.5 (C) on agent readiness against Khoj's 38.5 (E), and leads in 5 of 7 scored categories. Khoj leads on transparency & trust.

### Can an agent call Khoj and KoboldCpp without installing anything?

No hosted endpoint is listed for Khoj. No hosted endpoint is listed for KoboldCpp.

### Are Khoj and KoboldCpp open source?

Yes. Khoj is open source (AGPL-3.0-or-later). KoboldCpp is open source (AGPL-3.0 for KoboldCpp and KoboldAI Lite. The bundled GGML, llama.cpp and stable-diffusion.cpp code stays under MIT).


## For agents

- This comparison as JSON: https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.json, and with the fewest tokens: https://www.anchorterminal.com/compare/khoj-vs-koboldcpp.min.md
- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {"a": "khoj", "b": "koboldcpp"}`. From a terminal: `anchor compare khoj koboldcpp`
- Each listing in full: https://www.anchorterminal.com/api/v1/tools/khoj.json and https://www.anchorterminal.com/api/v1/tools/koboldcpp.json

## Other comparisons with Khoj or KoboldCpp

- [AnythingLLM vs Khoj](https://www.anchorterminal.com/compare/anythingllm-vs-khoj.md)
- [AnythingLLM vs KoboldCpp](https://www.anchorterminal.com/compare/anythingllm-vs-koboldcpp.md)
- [Docker Model Runner vs Khoj](https://www.anchorterminal.com/compare/docker-model-runner-vs-khoj.md)
- [Docker Model Runner vs KoboldCpp](https://www.anchorterminal.com/compare/docker-model-runner-vs-koboldcpp.md)
- [Foundry Local vs Khoj](https://www.anchorterminal.com/compare/foundry-local-vs-khoj.md)
- [Foundry Local vs KoboldCpp](https://www.anchorterminal.com/compare/foundry-local-vs-koboldcpp.md)
- [Core vs Khoj](https://www.anchorterminal.com/compare/ghost-core-vs-khoj.md)
- [Core vs KoboldCpp](https://www.anchorterminal.com/compare/ghost-core-vs-koboldcpp.md)
- [GPT4All vs Khoj](https://www.anchorterminal.com/compare/gpt4all-vs-khoj.md)
- [GPT4All vs KoboldCpp](https://www.anchorterminal.com/compare/gpt4all-vs-koboldcpp.md)
- [Jan vs Khoj](https://www.anchorterminal.com/compare/jan-vs-khoj.md)
- [Jan vs KoboldCpp](https://www.anchorterminal.com/compare/jan-vs-koboldcpp.md)
- [Khoj vs Lemonade](https://www.anchorterminal.com/compare/khoj-vs-lemonade.md)
- [Khoj vs llama.cpp](https://www.anchorterminal.com/compare/khoj-vs-llama-cpp.md)
- [Khoj vs LM Studio](https://www.anchorterminal.com/compare/khoj-vs-lm-studio.md)
- [Khoj vs LocalAI](https://www.anchorterminal.com/compare/khoj-vs-localai.md)
- [Khoj vs MLX LM](https://www.anchorterminal.com/compare/khoj-vs-mlx-lm.md)
- [Khoj vs Ollama](https://www.anchorterminal.com/compare/khoj-vs-ollama.md)
- [Khoj vs Open WebUI](https://www.anchorterminal.com/compare/khoj-vs-open-webui.md)
- [Khoj vs TextGen](https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui.md)
- [KoboldCpp vs Lemonade](https://www.anchorterminal.com/compare/koboldcpp-vs-lemonade.md)
- [KoboldCpp vs llama.cpp](https://www.anchorterminal.com/compare/koboldcpp-vs-llama-cpp.md)
- [KoboldCpp vs LM Studio](https://www.anchorterminal.com/compare/koboldcpp-vs-lm-studio.md)
- [KoboldCpp vs LocalAI](https://www.anchorterminal.com/compare/koboldcpp-vs-localai.md)
- [KoboldCpp vs MLX LM](https://www.anchorterminal.com/compare/koboldcpp-vs-mlx-lm.md)
- [KoboldCpp vs Ollama](https://www.anchorterminal.com/compare/koboldcpp-vs-ollama.md)
- [KoboldCpp vs Open WebUI](https://www.anchorterminal.com/compare/koboldcpp-vs-open-webui.md)
- [KoboldCpp vs screenpipe](https://www.anchorterminal.com/compare/koboldcpp-vs-screenpipe.md)
- [KoboldCpp vs TextGen](https://www.anchorterminal.com/compare/koboldcpp-vs-text-generation-webui.md)
- [KoboldCpp vs Underdog](https://www.anchorterminal.com/compare/koboldcpp-vs-underdog.md)
- [Khoj vs LocalGhost](https://www.anchorterminal.com/compare/khoj-vs-localghost.md)
- [Khoj vs screenpipe](https://www.anchorterminal.com/compare/khoj-vs-screenpipe.md)

## Disclosure

- Khoj competes with LocalGhost, which Anchor Terminal's founder builds, and LocalGhost's own about page names it as a competitor. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.