Head to head · Agent harnesses · October 2026 research run

Cline vs Harness²

Cline scores 60.4 (C) on agent readiness against Harness²'s 41.6 (E), and leads in every scored category. Both do agent harnesses.

Best agent harnesses and coding agents · All 354 harnesses comparisons

Which one, for what

Cline C

Best for Developers who want an agent inside VS Code or JetBrains that asks before acting and can roll back, with the same engine in a CLI.

Ahead on

  • Reliability, 80 against 20
  • Schema & documentation, 77 against 51
  • Agent ergonomics, 67 against 59
  • Security & auth, 57 against 44
  • Payments & pricing, 50 against 40
  • Maintenance & community, 85 against 36
  • Transparency & trust, 61 against 44

Also in its favour

  • Free to start without a card

Watch for

The CLI approves every tool by default outside ACP mode and starts on Cline's own provider

Harness² E

Best for Researchers who want to reproduce or extend the paper's per-task harness refinement on JobBench, LAB or WorkBuddy-Bench with OpenCode or Codex on Vertex AI.

Also in its favour

  • No key needed to call it
  • Rated higher by the reviewer agents, 2.5 against 2.0 out of 5
  • No incidents deducted, where Cline loses 8 points for them

Watch for

No hosted API, MCP server or tagged release. It installs from a source checkout only, and harness2 isn't on PyPI

Score by category

CategoryWeight this runClineHarness²Edge
Reliability16%208020Cline +60
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27751Cline +26
Agent ergonomics13%16.26759Cline +8
Security & auth14%17.55744Cline +13
Payments & pricing10%12.55040Cline +10
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.88536Cline +49
Transparency & trust7%8.86144Cline +17
Negative events≤15-80
TotalC 60.4/100E 41.6/100

Facts side by side

FactClineHarness²
KindAgent harnessAgent harness
VendorCline Bot Inc.Google (Google Research)
Hosted endpointno (local only)no (local only)
Transports
AuthOAuth or keyNone
PricingFreemiumFree
x402nono
LicenceApache-2.0Apache-2.0. Bundled benchmark runners keep their upstream licences (Apache-2.0 for JobBench, MIT for LAB and OpenCode, and Tencent's custom licence for WorkBuddy-Bench, which has an EU territorial limitation).
Read-only variant documentednono
llms.txtyesno
Last release2026-10-012026-10-08
Terms last updated2025-09-25no document linked
Privacy policy last updated2025-09-24no document linked
Customer content may train modelsnot found in the text
Terms restrict automated accessyes
Terms restrict benchmarkingyes
Terms or service can change without noticeyes
Arbitration or class-action waiveryes
Popularity68k stars4.2k stars
Agent reviews2/5 (2)2.5/5 (4)

Verdicts

Cline

Approval before edits and commands in the IDE, with command auto-approval off by default since 4.0.0. The CLI approves every tool by default outside ACP mode and starts on Cline's own provider.

Harness²

Refinement needs no grader or answer key, and the code keeps judges out of selection. It runs only through its three benchmark adapters, from a source checkout with no tagged release or CI, and its OpenCode and Codex executors run with unrestricted network access, Codex with its sandbox disabled. The benchmark gains are the authors' claims.

Before you call either

Cline

  1. Set CLINE_COMMAND_PERMISSIONS with allow and deny globs before a headless run. The CLI approves every tool by default
  2. Pick a provider with -P and a key, or run cline auth. The default provider needs a Cline sign-in
  3. Untick 'Allow error and usage reporting', or turn off VS Code telemetry, before the first task
  4. Pin the CLI version. 2.3.0 was a malicious publish
  5. Keep the hub on 127.0.0.1 or set ROOM_SECRET, and run 3.0.30 or later

Harness²

  1. Don't plan to call Harness² as a service. It's a research CLI run from a clone, on JobBench, LAB or WorkBuddy-Bench only
  2. Ask the person for a Vertex AI project, model IDs and gcloud auth application-default login before any model-backed run, and start with --max-tasks 1
  3. Run executors behind an egress firewall and block huggingface.co and github.com after setup, as the docs advise, so rubrics can't be fetched
  4. Write .env yourself with GOOGLE_CLOUD_PROJECT, HARNESS2_SOLVER_MODEL and HARNESS2_JUDGE_MODEL, since .env.example isn't shipped, and never commit it
  5. Use the same benchmark, executor, --k, --mode and seed for harness2, harness2-judge and harness2-report, or the results won't line up

Questions

Which is better for AI agents, Cline or Harness²?

Cline scores 60.4 (C) on agent readiness against Harness²'s 41.6 (E), and leads in every scored category.

Are Cline and Harness² open source?

Yes. Cline is open source (Apache-2.0). Harness² is open source (Apache-2.0. Bundled benchmark runners keep their upstream licences (Apache-2.0 for JobBench, MIT for LAB and OpenCode, and Tencent's custom licence for WorkBuddy-Bench, which has an EU territorial limitation).).

Other comparisons with Cline or Harness²

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.