Category · Agent frameworks

Agent harnesses and coding agents

Finished programs that run the agent loop for a person or a pipeline, in a terminal, an editor or the vendor's cloud. They plan, call tools, edit files and run commands, where a framework is a library you build that loop with. Compared on what they ask before acting, what the sandbox and the network allow by default, MCP support, headless use and the telemetry they send.

Best agent harnesses and coding agents, the shortlist1767 head-to-head comparisons

Capability keys agent.harness · agent.mcp-client · agent.multi-agent · All tools

letme.dev/agent.harness picks the top-graded tool in this list and says how to call it direct (how letme works).

61listings graded
10agent-ready (BB+)
118desk reviews by the panel
0accept x402
18 Nov 21:54last updated (UTC)
Filters
Grade
Agent rating
Where it runs
Mode
Auth
Pricing
Status
61 tools
Compare#ToolCategoryGradeScoreAgent ratingPrice / x402Details
69 OpenAI CodexOpenAI · Agent harness Harnesses BB 77.3 3.0 (2) $20 / mo
119 OpenAI Agents APIOpenAI · HTTP API Harnesses BB 75.2 none Pay per use
121 gooseAgentic AI Foundation (originally Block) · Agent harness Harnesses BB 75 2.5 (2) Free · OSS
148 AXLRUnderpass AI · Agent harness Harnesses BB 74.3 none Free · OSS
154 OpenHandsAll Hands AI · Agent harness Harnesses BB 74.1 2.5 (2) Freemium
211 OpenCodeAnomaly · Agent harness Harnesses BB 72.6 2.0 (2) $10 / mo
220 Qwen CodeAlibaba (Qwen team) · Agent harness Harnesses BB 72.4 2.8 (4) Free · OSS
272 Kilo Code CLIKilo Code Inc. · Agent harness Harnesses BB 71.2 2.3 (4) $19 / mo
279 herdrherdr · Agent harness Harnesses BB 71.1 none Free · OSS
302 CLI Managersolhun (Jeong Kyeonghun) · Agent harness Harnesses BB 70.2 2.5 (4) Free · OSS
313 MiniMax CodeMiniMax · Agent harness Harnesses B 69.9 3.5 (4) Free · OSS
319 Agent RelayAgent Workforce Incorporated · MCP server Harnesses B 69.9 none Freemium
379 OpenMausBotSupamaus Software Private Limited · Agent harness Harnesses B 68.5 none $15 / mo
486 PiEarendil · Agent harness Harnesses B 66.4 3.3 (4) Free · OSS
508 Gemini CLIGoogle · Agent harness Harnesses B 66 3.5 (2) Pay per use
513 PaseoMohamed Boudra · Agent harness Harnesses B 65.9 none Free · OSS
544 FridayFriday Work · Agent harness Harnesses B 65.3 none Free · OSS
549 ClawbooSanreds · Agent harness Harnesses B 65.1 none Free · OSS
630 LettaLetta · Agent harness Harnesses B 63.5 none $20 / mo
632 HarnessAutonomous, Inc. · Agent harness Harnesses B 63.4 3.0 (4) Free · OSS
661 mini-swe-agentSWE-bench team (Princeton and Stanford) · Agent harness Harnesses B 62.7 3.0 (4) Free · OSS
686 Kiro CLIAmazon Web Services · Agent harness Harnesses B 62.3 2.8 (4) $20 / mo
694 Mistral Vibe CLIMistral AI · Agent harness Harnesses B 62.1 3.3 (4) Freemium
706 Kimi Code CLIMoonshot AI · Agent harness Harnesses C 61.8 3.0 (4) Free · OSS
707 Qoder CLIQoder (BRIGHT ZENITH PRIVATE LIMITED) · Agent harness Harnesses C 61.8 3.5 (4) $20 / mo
729 Vibe-TradingHKUDS · Agent harness Harnesses C 61.5 none Free · OSS
749 Mirror CLIReflection · Agent harness Harnesses C 60.9 3.0 (4) Free · OSS
760 Prime AgentPrime Intellect · Agent harness Harnesses C 60.6 2.8 (4) Free · OSS
797 OrcaLovecast Inc. · Agent harness Harnesses C 59.9 none Free · OSS
832 TraycerTraycer AI · Agent harness Harnesses C 58.9 none Free · OSS
834 Warp (Warp Agent CLI and the Oz Agent API)Warp · Agent harness Harnesses C 58.8 3.3 (4) $20 / mo
850 GitHub Copilot CLIGitHub · Agent harness Harnesses C 58.5 2.5 (2) $0.01 / credit
852 DevinCognition AI, Inc. · Agent harness Harnesses C 58.5 none $20 / mo
874 AmpAmp Frontier Corporation · Agent harness Harnesses C 57.8 none $20 / mo
875 Droid CLIFactory · Agent harness Harnesses C 57.8 none $20 / mo
883 EmdashGeneral Action, Inc. · Agent harness Harnesses C 57.6 none Free · OSS
887 Muse CodeMeta · Agent harness Harnesses C 57.4 3.3 (4) $5 / mo
914 SculptorImbue, Inc. · Agent harness Harnesses C 56.8 none Free · OSS
926 Antigravity CLIGoogle · Agent harness Harnesses C 56.6 none Freemium
943 PaperclipPaperclip Labs, Inc. · Agent harness Harnesses C 56.4 none Free · OSS
964 ClineCline Bot Inc. · Agent harness Harnesses C 55.9 2.0 (2) $9.99 / mo
974 T3 CodeT3 Tools Inc. · Agent harness Harnesses C 55.7 none Free · OSS
1000 Claude CodeAnthropic · Agent harness Harnesses C 54.8 2.5 (4) $20 / mo
1047 CrushCharm · Agent harness Harnesses D 53.3 2.3 (4) Freemium
1055 boxes.devBoxes, Inc. · MCP server Harnesses D 53.2 none $0.40 / unit
1061 AiderAider AI LLC · Agent harness Harnesses D 52.9 1.0 (2) Free · OSS
1087 DeepSeek Harness (dsh)DeepSeek · Agent harness Harnesses D 52.3 3.0 (4) Free · OSS
1116 Junie CLIJetBrains · Agent harness Harnesses D 51.6 2.8 (4) $10 / mo
1148 Auggie CLIHarness (formerly Augment Code) · Agent harness Harnesses D 50.5 2.8 (4) $20 / mo
1168 Agent ZeroAgent Zero, s.r.o. · Agent harness Harnesses D 49.7 none Free · OSS
1176 HarnessRouterHarnessRouter (Lumentree Corporation) · Agent harness Harnesses D 49.3 2.5 (4) $20 / mo
1202 ClickClick AI Labs, Inc. · HTTP API Harnesses D 48.6 none $199 / mo
1240 JulesGoogle · Agent harness Harnesses D 47 2.8 (4) Freemium
1287 Harness²Google (Google Research) · Agent harness Harnesses E 45 2.5 (4) Free · OSS
1300 dsh-superagent (DeepSeek)DeepSeek · Agent harness Harnesses E 44.6 none Free · OSS
1325 Rovo Dev CLIAtlassian · Agent harness Harnesses E 43.3 2.0 (4) $20 / seat-mo
1362 ConductorConductor (joining Meta) · Agent harness Harnesses E 41.3 none Paid
1367 VerdentVerdent AI, Inc. · Agent harness Harnesses E 40.9 none $5 / mo
1380 Cursor CLICursor · Agent harness Harnesses E 40.2 1.5 (2) $20 / mo
1402 UnstoppableNot for agents Unstoppable Domains, Inc. · Agent harness Harnesses E 38.4 none Freemium
1403 ParallaxConifer Solutions, Inc. · Agent harness Harnesses E 38.1 2.0 (4) Freemium

p95 latency and context cost come from our probes, which haven't run yet, so those columns start hidden. Grades run from AA to F, and agent-ready means BB or better. Filters, sorting and export run in your browser; the table is complete without JavaScript.

How we test this category

The same small repository task run headless in each harness with one MCP server attached, first fixing a failing test, then a task that needs the network. We check what it asks before acting, what the sandbox blocks, whether the run stops on its own, what it costs and what leaves the machine.

How the ranking works

Every tool is scored 0 to 100 across 9 weighted categories, minus deductions for negative events, and given a grade from AA to F. Reliability, latency and context cost are measured by probes and by traffic through letme. Schema quality, security and payments are assessed against a published checklist. Task success comes from a fixed task suite. Payments, including x402, are one category of the nine. Read the methodology.

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.