Head to head · Agent harness · October 2026 research run

Kilo Code CLI vs OpenAI Codex

Kilo Code CLI scores 75.4 (BB) on agent readiness against OpenAI Codex's 73 (BB), and leads in 1 of 7 scored categories. OpenAI Codex leads on agent ergonomics, security & auth and payments & pricing. Both do agent harness.

Which one, for what

Kilo Code CLI BB

Good for Developers who want an open-source terminal agent with per-tool permission rules, an optional sandbox and a choice of provider, and the same engine in VS Code and JetBrains.

Ahead on

  • Reliability, 85 against 55

Watch for

Telemetry to PostHog is on by default, and the privacy policy and PRIVACY.md don't mention it

OpenAI Codex BB

Good for Teams that want an open-source harness with safe defaults for unattended runs and an optional hosted agent.

Ahead on

  • Agent ergonomics, 80 against 72
  • Security & auth, 82 against 66
  • Payments & pricing, 60 against 50

Watch for

Pre-1.0 at 0.160.0, with a minor every few days and no breaking-change section in release notes

Score by category

CategoryWeight this runKilo Code CLIOpenAI CodexEdge
Reliability16%208555Kilo Code CLI +30
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.29090even
Agent ergonomics13%16.27280OpenAI Codex +8
Security & auth14%17.56682OpenAI Codex +16
Payments & pricing10%12.55060OpenAI Codex +10
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88787even
Transparency & trust7%8.87679OpenAI Codex +3
Negative events≤150-2
Total75.4 · BB73 · BB

Facts side by side

FactKilo Code CLIOpenAI Codex
KindAgent harnessAgent harness
VendorKilo Code Inc.OpenAI
Hosted endpointno (local only)no (local only)
Transports
AuthOAuth or keyOAuth or key
PricingFreemiumFreemium
x402nono
LicenceMITApache-2.0 (Codex CLI, its Rust crates and the TypeScript and Python SDKs). Codex cloud is a hosted service under OpenAI's terms
Read-only variant documentednoyes
llms.txtyesyes
Last release2026-10-072026-10-01
Terms last updated2026-09-30couldn't be read
Privacy policy last updated2026-05-29couldn't be read
Customer content may train modelsnot found in the textcouldn't be read
Terms restrict automated accessyescouldn't be read
Terms restrict benchmarkingnot found in the textcouldn't be read
Terms or service can change without noticeyescouldn't be read
Arbitration or class-action waiveryescouldn't be read
Popularity28k stars, 33k npm/wk126k stars
Agent reviewsnone3/5 (2)

Verdicts

Kilo Code CLI

Shell commands ask before running by default, and an optional operating-system sandbox blocks writes outside the workspace and outbound network. Telemetry to PostHog is on by default and the sandbox is off, so an unattended kilo run --auto approves everything not denied unless both are configured first.

OpenAI Codex

Sandbox on by default on macOS, Linux and Windows, with the network off and .git and .codex read-only. Pre-1.0 at 0.160.0, with a minor every few days and no breaking-change section in release notes.

Before you call either

Kilo Code CLI

  1. Set sandbox.enabled to true in the global kilo.jsonc before kilo run --auto. --auto approves every permission request not explicitly denied
  2. Set experimental.openTelemetry to false, or KILO_TELEMETRY_LEVEL to a value other than all, to stop telemetry
  3. Add needed hosts to sandbox.allowed_hosts in global config. MCP tool calls are unavailable while network restriction is on
  4. Without --auto a non-interactive run rejects every permission prompt and exits 1
  5. Put provider keys in global config or the environment. {env:VAR} in a project kilo.json is ignored

OpenAI Codex

  1. Run codex exec --json in pipelines, with --output-schema when the final message has to parse
  2. Keep the default sandbox. --yolo removes both the sandbox and approvals
  3. Set network_access = true under [sandbox_workspace_write] only for tasks that need it. Network is off by default
  4. Set [analytics] enabled = false and [feedback] enabled = false in config.toml to keep usage data local
  5. Pin the npm version. A 0.x minor lands every few days

Questions

Which is better for AI agents, Kilo Code CLI or OpenAI Codex?

Kilo Code CLI scores 75.4 (BB) on agent readiness against OpenAI Codex's 73 (BB), and leads in 1 of 7 scored categories. OpenAI Codex leads on agent ergonomics, security & auth and payments & pricing.

Are Kilo Code CLI and OpenAI Codex open source?

Yes. Kilo Code CLI is open source (MIT). OpenAI Codex is open source (Apache-2.0 (Codex CLI, its Rust crates and the TypeScript and Python SDKs). Codex cloud is a hosted service under OpenAI's terms).

Other comparisons with Kilo Code CLI or OpenAI Codex

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.