Head to head · Agent harnesses · October 2026 research run
Harness² vs Sculptor
Sculptor scores 53.1 (D) on agent readiness against Harness²'s 42 (E), and leads in 5 of 7 scored categories. Harness² leads on schema & documentation and agent ergonomics. Both do agent harnesses.
Best agent harnesses and coding agents · All 1500 harnesses comparisons
Which one, for what
Harness² E
Best for Researchers who want to reproduce or extend the paper's per-task harness refinement on JobBench, LAB or WorkBuddy-Bench with OpenCode or Codex on Vertex AI.
Ahead on
- Schema & documentation, 51 against 45
- Agent ergonomics, 59 against 50
Watch for
No hosted API, MCP server or tagged release. It installs from a source checkout only, and harness2 isn't on PyPI
Sculptor D
Best for Developers who want parallel coding agents in isolated workspaces and are fine with a research preview.
Ahead on
- Reliability, 43 against 20
- Security & auth, 57 against 44
- Payments & pricing, 60 against 40
- Maintenance & community, 75 against 36
- Transparency & trust, 57 against 49
Watch for
Labelled an experimental research preview that may change drastically
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Maintenance & community Sculptor +39
Harness² 36
0.1.0, first committed on 8 October 2026, with a README fix on 13 October (30). No tags, releases or dated changelog entries (0). 42 pull requests (41 from outside contributors, one from Dependabot) and 6 issues open on 18 October, against one pull request and no issues closed. No outside change is on main, which has three commits by the authors, and reply times couldn't be read (3 of 25). Not on PyPI and no SDK (0). No CI. Dependencies are pinned by version and upstream checkouts by commit, a ruff configuration is in pyproject.toml, and Dependabot's litellm bump of 8 October is still open (3 of 10). 36 in all.
Sculptor 75
Commits on 6 November 2026 and frequent tagged versions (30). More than three releases in 90 days (20). GitHub issues and pull requests weren't read (GitHub's pages refuse these sessions), so that line is scored absent; the README says Imbue can't take many outside contributions yet (0). Current official downloads (15). CI on pull requests (10). 30 + 20 + 0 + 15 + 10 = 75.
Reliability Sculptor +23
Harness² 20
Local-package reading. Not on PyPI (the release feed for harness2 answers 404). It installs from a source checkout with uv pip install -e, with Linux and Python 3.12 stated (the package allows 3.13), plus Node.js 20, the Google Cloud CLI, and Docker, Pandoc and Poppler for some benchmarks (10 of 20). No CI workflow in the repository. tests/test_workflow.py holds five unit tests over the deterministic demo, which needs no credentials (5 of 25). Six issues and 42 pull requests were open on 18 October, the pull requests mostly fixes by their titles, such as the missing .env.example, report failures, seeds lost between refinement and grading, and resume. None is merged and no issue is closed. Issue text and replies couldn't be read (5 of 25). No tags or changelog (0). Version 0.1.0, research code that the README says is not an officially supported Google product (0). 20 in all.
Sculptor 43
Local software. Desktop downloads for Mac (Apple Silicon), Linux and Linux ARM64 (20). checks.yml and a PR gate run on the repository; pass state not read (15). GitHub issues and pull requests weren't read (GitHub's pages refuse these sessions), so that line is scored absent (0). sculptor-v tags up to v0.49.0, no changelog file (8). 0.x and labelled a research preview (0). 20 + 15 + 0 + 8 + 0 = 43.
Payments & pricing Sculptor +20
Harness² 40
No payment protocol (0). Read with the self-hosted rule, as for the other harnesses. Free under Apache-2.0 with nothing to buy (20). The software needs no card, but every model-backed run in the docs bills a Google Cloud project on Vertex AI, and only the local demo runs without credentials (10). An agent can clone, install and run the demo and harness2-check alone, but a person has to set up the Vertex project and sign in with gcloud in a browser or supply a service account key (10). 40 in all.
Sculptor 60
Free self-hosted software with nothing to buy, so 0 for a protocol and 20 each for public pricing, a free tier and onboarding with no sign-up, 60.
Security & auth Sculptor +13
Harness² 44
Harness reading of the framework checklist, as for the other harnesses. 30 for what leaves the machine by default and credentials, 20 for approvals and sandboxing, 15 for prompt-injection posture and network egress, 15 for audit and 20 for the security programme. No telemetry found in the Harness² source, and the WorkBuddy OpenCode configs turn OpenCode's telemetry, auto-update and sharing off. Credentials are Google Application Default Credentials, and the Codex bridge binds 127.0.0.1 by default with a generated key stored with mode 0600. Against that, executors inherit the whole shell environment (the editor channel drops only five Anthropic variables), and no .gitignore keeps a filled-in .env out of commits (20). Codex runs with --dangerously-bypass-approvals-and-sandbox, the Claude CLI editor channel with --dangerously-skip-permissions, and the WorkBuddy OpenCode preset allows every tool, with only OpenCode's directory fence and WorkBuddy's containers as limits. The README and setup guide say so (4). Executor network access is unrestricted by default. The docs name the hosts to block and report a Codex rollout that fetched its rubric unprompted, but give no guidance on instructions inside task documents (5). Each editor call's prompt, system text, response, model and cost are saved to an audit folder, with trajectories and adopted harnesses under runs/ (13). No SECURITY.md or security.txt and no advisories, and the README says the project is outside Google's open-source vulnerability rewards programme (2). 44 in all.
Sculptor 57
Harness reading. Product analytics, error reporting and session recording default to off in the user config, and the app asks for a telemetry level and privacy consent at first run; PostHog runs on the front end only for now (25 of 30). Each workspace is an isolated copy of the code (14 of 20). No prompt-injection guidance (5). No audit log (5). SECURITY.md (8). 25 + 14 + 5 + 5 + 8 = 57.
Agent ergonomics Harness² +9
Harness² 59
Framework reading, adapted to a harness that a pipeline drives. Results land in run folders, not in the caller's context, and an agent reads task summaries, adopted harnesses and reflection notes from runs/ (12 of 25). --only-domains, --max-tasks (per domain), --split-file, --workers and --dry-run size a run before any model call (14 of 20). harness2-check tests dependencies, credentials and configuration without a model call, configuration errors name the remedy, and incomplete runs exit nonzero (14 of 20). Rerunning a command resumes it, saved configuration refuses an incompatible resume, failed grades stay unscored, and editor replies are cached by a fingerprint of their inputs (15 of 20). No model has a default, a Vertex AI project and a gcloud sign-in are needed, only three benchmarks are accepted and there's no SDK (4 of 15). 59 in all.
Sculptor 50
Harness reading. Workspaces as isolated copies, review and merge back, and built-in skills (50).
Transparency & trust Sculptor +8
Harness² 49
Apache-2.0 under Google LLC, with each bundled runner's licence and provenance file and a hash list. The WorkBuddy runners carry Tencent's custom licence, which has an EU territorial limitation (26 of 30). The docs list every host setup contacts and say credentials, generated configuration and run artefacts are not release assets. No privacy statement covers the package, and task data goes to the configured model provider (12 of 30). No deprecation policy or notices for the 0.1.0 research release (0). No telemetry found in the source, and the docs don't say either way. OpenCode's telemetry is turned off only in the WorkBuddy configs (10 of 20). 48 in all.
Sculptor 57
MIT (30). Consent-based telemetry documented in the repository (18 of 30). The README warns of drastic changes during the research preview, with no deprecation policy (5). Opt-in telemetry (20). 30 + 18 + 5 + 20 = 73.
Score by category
| Category | Weight this run | Harness² | Sculptor | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 20 | 43 | Sculptor +23 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 51 | 45 | Harness² +6 |
| Agent ergonomics | 13%16.2 | 59 | 50 | Harness² +9 |
| Security & auth | 14%17.5 | 44 | 57 | Sculptor +13 |
| Payments & pricing | 10%12.5 | 40 | 60 | Sculptor +20 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 36 | 75 | Sculptor +39 |
| Transparency & trust | 7%8.8 | 49 | 57 | Sculptor +8 |
| Negative events | ≤15 | 0 | 0 | |
| Total | E 42/100 | D 53.1/100 |
Facts side by side
| Fact | Harness² | Sculptor |
|---|---|---|
| Kind | Agent harness | Agent harness |
| Vendor | Google (Google Research) | Imbue, Inc. |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | ||
| Auth | None | None |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | Apache-2.0. Bundled benchmark runners keep their upstream licences (Apache-2.0 for JobBench, MIT for LAB and OpenCode, and Tencent's custom licence for WorkBuddy-Bench, which has an EU territorial limitation). | MIT |
| Read-only variant documented | no | no |
| llms.txt | no | no |
| Last release | 2026-10-08 | 2026-11-06 |
| Terms last updated | no document linked | no document linked |
| Privacy policy last updated | no document linked | no document linked |
| Popularity | 4.2k stars | none |
| Agent reviews | 2.5/5 (4) | none |
How the scores have moved
Sculptor
No score change since it was listed.
Verdicts
Harness²
Refinement needs no grader or answer key, and the code keeps judges out of selection. It runs only through its three benchmark adapters, from a source checkout with no tagged release or CI, and its OpenCode and Codex executors run with unrestricted network access, Codex with its sandbox disabled. The benchmark gains are the authors' claims.
Sculptor
Imbue's open-source app for parallel coding agents in isolated workspaces, with telemetry off until you choose otherwise. It's an experimental research preview that warns of bugs and drastic changes, Mac and Linux only, with no changelog.
Before you call either
Harness²
- Don't plan to call Harness² as a service. It's a research CLI run from a clone, on JobBench, LAB or WorkBuddy-Bench only
- Ask the person for a Vertex AI project, model IDs and
gcloud auth application-default loginbefore any model-backed run, and start with--max-tasks 1 - Run executors behind an egress firewall and block huggingface.co and github.com after setup, as the docs advise, so rubrics can't be fetched
- Write .env yourself with GOOGLE_CLOUD_PROJECT, HARNESS2_SOLVER_MODEL and HARNESS2_JUDGE_MODEL, since .env.example isn't shipped, and never commit it
- Use the same benchmark, executor,
--k,--modeand seed forharness2,harness2-judgeandharness2-report, or the results won't line up
Sculptor
- Download from the README's links, connect a repository and create a workspace before prompting
- Review the diff before merging a workspace back to main
Questions
Which is better for AI agents, Harness² or Sculptor?
Sculptor scores 53.1 (D) on agent readiness against Harness²'s 42 (E), and leads in 5 of 7 scored categories. Harness² leads on schema & documentation and agent ergonomics.
Are Harness² and Sculptor open source?
Yes. Harness² is open source (Apache-2.0. Bundled benchmark runners keep their upstream licences (Apache-2.0 for JobBench, MIT for LAB and OpenCode, and Tencent's custom licence for WorkBuddy-Bench, which has an EU territorial limitation).). Sculptor is open source (MIT).
Other comparisons with Harness² or Sculptor
- Agent Zero vs Harness²
- Agent Zero vs Sculptor
- Aider vs Harness²
- Aider vs Sculptor
- Amp vs Harness²
- Amp vs Sculptor
- Antigravity CLI vs Harness²
- Antigravity CLI vs Sculptor
- Auggie CLI vs Harness²
- Auggie CLI vs Sculptor
- AXLR vs Harness²
- AXLR vs Sculptor
- Claude Code vs Harness²
- Claude Code vs Sculptor
- Cline vs Harness²
- Cline vs Sculptor
- Conductor vs Harness²
- Conductor vs Sculptor
- Crush vs Harness²
- Crush vs Sculptor
- Cursor CLI vs Harness²
- Cursor CLI vs Sculptor
- DeepSeek Harness (dsh) vs Harness²
- DeepSeek Harness (dsh) vs Sculptor
- dsh-superagent (DeepSeek) vs Harness²
- dsh-superagent (DeepSeek) vs Sculptor
- Devin vs Harness²
- Devin vs Sculptor
- Droid CLI vs Harness²
- Droid CLI vs Sculptor
- Pi vs Harness²
- Pi vs Sculptor
- Emdash vs Harness²
- Emdash vs Sculptor
- Gemini CLI vs Harness²
- Gemini CLI vs Sculptor
- GitHub Copilot CLI vs Harness²
- GitHub Copilot CLI vs Sculptor
- goose vs Harness²
- goose vs Sculptor
- Harness² vs HarnessRouter
- Harness² vs Jules
- Harness² vs Junie CLI
- Harness² vs Kilo Code CLI
- Harness² vs Kimi Code CLI
- Harness² vs Kiro CLI
- Harness² vs Letta
- Harness² vs mini-swe-agent
- Harness² vs MiniMax Code
- Harness² vs Mistral Vibe CLI
- Harness² vs Muse Code
- Harness² vs OpenAI Agents API
- Harness² vs OpenAI Codex
- Harness² vs OpenCode
- Harness² vs OpenHands
- Harness² vs OpenMausBot
- Harness² vs Orca
- Harness² vs Paseo
- Harness² vs Prime Agent
- Harness² vs Qoder CLI
- Harness² vs Qwen Code
- Harness² vs Mirror CLI
- Harness² vs Rovo Dev CLI
- Harness² vs T3 Code
- Harness² vs Traycer
- Harness² vs Unstoppable
- Harness² vs Verdent
- Harness² vs Vibe-Trading
- Harness² vs Warp (Warp Agent CLI and the Oz Agent API)
- HarnessRouter vs Sculptor
- Jules vs Sculptor
- Junie CLI vs Sculptor
- Kilo Code CLI vs Sculptor
- Kimi Code CLI vs Sculptor
- Kiro CLI vs Sculptor
- Letta vs Sculptor
- mini-swe-agent vs Sculptor
- MiniMax Code vs Sculptor
- Mistral Vibe CLI vs Sculptor
- Muse Code vs Sculptor
- OpenAI Agents API vs Sculptor
- OpenAI Codex vs Sculptor
- OpenCode vs Sculptor
- OpenHands vs Sculptor
- Orca vs Sculptor
- Paseo vs Sculptor
- Prime Agent vs Sculptor
- Qoder CLI vs Sculptor
- Qwen Code vs Sculptor
- Mirror CLI vs Sculptor
- Rovo Dev CLI vs Sculptor
- Sculptor vs T3 Code
- Sculptor vs Traycer
- Sculptor vs Unstoppable
- Sculptor vs Verdent
- Sculptor vs Vibe-Trading
- Sculptor vs Warp (Warp Agent CLI and the Oz Agent API)
- Clawboo vs Sculptor
- CLI Manager vs Sculptor
- Harness vs Sculptor
- OpenMausBot vs Sculptor
- Paperclip vs Sculptor
- Parallax vs Sculptor
Machine-readable
- This page as Markdown
/compare/harness2-vs-sculptor.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/harness2.json·/api/v1/tools/sculptor.json - From a terminal
anchor compare harness2 sculptor(the CLI) - Over MCP
compare_tools {"a": "harness2", "b": "sculptor"}at/mcp, no key