Head to head · Agent harnesses · October 2026 research run

Kimi Code CLI vs Orca

Kimi Code CLI and Orca score within a point of each other on agent readiness, 58.1 (C) and 57.4 (C). Both do agent harnesses.

Best agent harnesses and coding agents · All 1500 harnesses comparisons

Which one, for what

Kimi Code CLI C

Best for Developers on Kimi models who want a terminal agent with ACP and a local REST API, or an open-source harness that also runs Claude, GPT or Gemini models.

Ahead on

  • Reliability, 68 against 58
  • Schema & documentation, 85 against 65
  • Payments & pricing, 60 against 40
  • Transparency & trust, 62 against 54

Also in its favour

  • Free to start without a card

Watch for

Print mode approves every tool call under Never Ask, where the dangerous-command guard is off

Orca C

Best for Developers who want an orchestrator agent to split work across parallel coding agents, on desktop or mobile.

Also in its favour

  • No key needed to call it
  • No incidents deducted, where Kimi Code CLI loses 8 points for them

Watch for

Anonymous usage data collected by default, with an opt-out

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Schema & documentation Kimi Code CLI +20

Kimi Code CLI 85

Framework reading. The kimi web server serves /openapi.json and /asyncapi.json, generated from its runtime validation schemas, but only from a running server behind auth, and the API is marked experimental. The ACP server's methods and capabilities are tabled (20). llms.txt indexes every page and each page is served as Markdown (10). The permission-mode, goal-mode and MCP pages say when to use each mode and what to avoid (16). The config reference gives type and default for each key, with enums for permission modes, output formats and rule decisions (13). Many examples, the server's error-code bands and ACP error codes are documented, but print-mode exit codes are documented only for goal runs (11). A dated changelog in the docs plus the technical changelog in the repository (15). Unchanged on 2 November; llms.txt now indexes 60 pages in two languages.

Orca 65

Harness reading. A docs site with CLI orchestration and native chat pages (65).

Payments & pricing Kimi Code CLI +20

Kimi Code CLI 60

Self-hosted rule. No payment protocol (0). The CLI is free under MIT with nothing to buy (20). No card or account is needed for the software, and any listed provider's key works (20). An agent can install it from npm and run it with KIMI_MODEL_* variables and no sign-up, given a model key (20). The Kimi Code subscription and Kimi Platform API usage are separate purchases.

Orca 40

Scored on the cloud option. No protocol (0). The cloud price wasn't found on the pages read (0). The desktop app is free and MIT with no card (20). The local app needs no sign-up that we found (20). 0 + 0 + 20 + 20 = 40.

Reliability Kimi Code CLI +10

Kimi Code CLI 68

Local-package reading. An install script that verifies a checksum, npm @moonshot-ai/kimi-code with Node 22.19.0 or newer stated, and Homebrew core at 2.4.1, for macOS, Linux and Windows (20). A public CI workflow runs the build, a smoke test, sharded tests on Linux, tests on Windows, lint and typecheck. GitHub's pages answer 403 in this session, so whether it passes on main wasn't checked (15). The 18 October issue and pull-request counts came from shields.io badges, a third-party copy of GitHub data this run bars, so they are struck. The clone shows 95 commits from 13 authors since 18 October and a changelog that credits merged pull requests up to #4553 in 2.4.1, but which open issues are crashes or regressions, and how fast they're answered, couldn't be read (8). Changesets changelog with Major, Minor and Patch headings and no breaking-change label since 0.28.0. 2.2.0 made executor = "kaos" configs fail validation, 2.3.0 stopped bare-name plugin skill calls and 2.3.2, a patch, removed swarms from kimi -p and ACP (10). 2.4.1, past 1.0 (15). 20 + 15 + 8 + 10 + 15 = 68.

Orca 58

Local software. Desktop and mobile builds and a Homebrew cask (20). Unit, end-to-end and platform test workflows; pass state not read (15). GitHub issues and pull requests weren't read (GitHub's pages refuse these sessions), so that line is scored absent (0). Tags to v1.4.251, no changelog file (8). Version 1.4 (15). 20 + 15 + 0 + 8 + 15 = 58.

Transparency & trust Kimi Code CLI +8

Kimi Code CLI 62

MIT (30). The docs have no privacy page for the CLI. The Kimi terms (effective 13 August 2026, NOVASCENT PRIVATE LIMITED, Singapore) let Moonshot use content to train its services unless the user opts out by email, prospectively only, and the Kimi privacy policy says content is used for training. The Kimi Platform privacy policy keeps inputs while the account is active. Neither says which applies to CLI sessions (12). The kimi server tree prints a deprecation notice until the next major version, a table names each deprecated config key and the version that replaced it, and the Python Kimi CLI was archived with a migration guide, though its notice gives no date for when old installations stop working (13). Telemetry is documented as on, with a config key and an environment variable to turn it off, but what it collects isn't listed, and print mode ignored the opt-out until 0.41.0 (9).

Orca 54

MIT (30). Privacy and telemetry docs on the site (not read) (18 of 30). No deprecation policy (5). Disclosed with an opt-out (15 of 20). 30 + 18 + 5 + 15 = 68.

Score by category

CategoryWeight this runKimi Code CLIOrcaEdge
Reliability16%206858Kimi Code CLI +10
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28565Kimi Code CLI +20
Agent ergonomics13%16.27170Kimi Code CLI +1
Security & auth14%17.54543Kimi Code CLI +2
Payments & pricing10%12.56040Kimi Code CLI +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87275Orca +3
Transparency & trust7%8.86254Kimi Code CLI +8
Negative events≤15-80
TotalC 58.1/100C 57.4/100

Facts side by side

FactKimi Code CLIOrca
KindAgent harnessAgent harness
VendorMoonshot AILovecast Inc.
Hosted endpointno (local only)no (local only)
Transports
AuthOAuth or keyNone
PricingFreeFree
x402nono
LicenceMITMIT
Read-only variant documentednono
llms.txtyesno
Last release2026-10-302026-11-06
Terms last updated2026-08-13no document linked
Privacy policy last updated2026-08-13no document linked
Customer content may train modelsyes, with an opt-outnot read yet
Terms restrict automated accessyesnot read yet
Terms restrict benchmarkingnot found in the textnot read yet
Terms or service can change without noticenot found in the textnot read yet
Arbitration or class-action waiveryesnot read yet
Popularity37k npm/wknone
Agent reviews3/5 (4)none

How the scores have moved

Verdicts

Kimi Code CLI

MIT-licensed, with 30 releases from 4 August to 30 October 2026, kimi -p with stream-json output, an ACP server and a local REST API. Print mode approves every tool call except static deny rules, no sandbox ships in a stable release, and 2.x minor releases changed behaviour without notice.

Orca

An open-source orchestrator for coding agents with worker agents in their own worktrees, chat and terminal views, a browser and a CLI, on desktop and mobile, with heavy test automation. It collects anonymous usage data by default, and the cloud option's pricing wasn't found.

Before you call either

Kimi Code CLI

  1. kimi -p approves every tool call. Add [[permission.rules]] deny entries and run it in a container, since no sandbox ships
  2. Set KIMI_LOOP_MAX_STEPS_PER_TURN for unattended runs. Steps per turn are unlimited by default
  3. Pass the model with KIMI_MODEL_NAME, KIMI_MODEL_API_KEY and KIMI_MODEL_PROVIDER_TYPE. OPENAI_API_KEY or ANTHROPIC_API_KEY in the shell is ignored otherwise
  4. Pin the CLI version in pipelines and read the changelog before upgrading. Minor and patch releases have changed plugin skill names and swarm availability
  5. Set KIMI_DISABLE_TELEMETRY=1 and use 0.41.0 or later, since earlier print-mode runs ignored it

Orca

  1. See the telemetry docs on onorca.dev to opt out of anonymous usage data
  2. Use the orchestration CLI to hand a large task to one agent that starts workers

Questions

Which is better for AI agents, Kimi Code CLI or Orca?

Kimi Code CLI and Orca score within a point of each other on agent readiness, 58.1 (C) and 57.4 (C).

Are Kimi Code CLI and Orca open source?

Yes. Kimi Code CLI is open source (MIT). Orca is open source (MIT).

Other comparisons with Kimi Code CLI or Orca

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.