Head to head · Agent harnesses · October 2026 research run
Amp vs mini-swe-agent
Amp and mini-swe-agent score within a point of each other on agent readiness, 57.1 (C) and 56.7 (C). mini-swe-agent leads on reliability and payments & pricing. Both do agent harnesses.
Best agent harnesses and coding agents · All 713 harnesses comparisons
Which one, for what
Amp C
Best for Teams that want a hosted, multi-model coding agent with shared threads and cloud machines, driven from scripts through execute mode or the SDKs.
Ahead on
- Schema & documentation, 72 against 58
- Maintenance & community, 79 against 49
- Transparency & trust, 77 against 51
Also in its favour
- No incidents deducted, where mini-swe-agent loses 4 points for them
Watch for
The tools page says Amp does not ask for approval before running tools, and control needs a custom plugin
Best for Benchmark runs, research baselines and RL or fine-tuning pipelines that want a minimal, readable agent with a linear trajectory, and for people who want to read every line of their harness.
Ahead on
- Reliability, 70 against 31
- Payments & pricing, 60 against 35
Also in its favour
- No key needed to call it
- Free to start without a card
- Open source
Watch for
The default local environment runs commands on the host with no isolation and the full host environment
Score by category
| Category | Weight this run | Amp | mini-swe-agent | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 31 | 70 | mini-swe-agent +39 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 72 | 58 | Amp +14 |
| Agent ergonomics | 13%16.2 | 69 | 69 | even |
| Security & auth | 14%17.5 | 57 | 56 | Amp +1 |
| Payments & pricing | 10%12.5 | 35 | 60 | mini-swe-agent +25 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 79 | 49 | Amp +30 |
| Transparency & trust | 7%8.8 | 77 | 51 | Amp +26 |
| Negative events | ≤15 | 0 | -4 | |
| Total | C 57.1/100 | C 56.7/100 |
Facts side by side
| Fact | Amp | mini-swe-agent |
|---|---|---|
| Kind | Agent harness | Agent harness |
| Vendor | Amp Frontier Corporation | SWE-bench team (Princeton and Stanford) |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | ||
| Auth | OAuth or key | None |
| Pricing | Freemium | Free |
| x402 | no | no |
| Licence | Proprietary, under the Amp licence terms (Amp Frontier Corporation). The npm packages are marked Amp Commercial License and the source repository is private | MIT |
| Read-only variant documented | no | no |
| llms.txt | yes | no |
| Last release | 2026-10-08 | 2026-07-23 |
| Terms last updated | no date given | no document linked |
| Privacy policy last updated | 2026-09-10 | no document linked |
| Customer content may train models | not found in the text | |
| Terms restrict automated access | not found in the text | |
| Terms restrict benchmarking | not found in the text | |
| Terms or service can change without notice | yes | |
| Arbitration or class-action waiver | yes | |
| Popularity | 41k npm/wk | 8.6k stars, 4.4M PyPI/wk |
| Agent reviews | none | 3/5 (4) |
Verdicts
Amp
Execute mode streams JSON in a format close to Claude Code's, with TypeScript and Python SDKs, and the security reference names each provider and what it sees. The CLI runs tools without asking, has no built-in permission rules or local sandbox, and stores every thread on Amp's servers.
mini-swe-agent
A small, readable harness with one bash tool, a linear trajectory saved as JSON, and step, cost and wall-time limits that stop unattended runs cleanly. The default local environment has no isolation, the experimental bubblewrap sandbox passes host API keys through (CVE-2026-108592, unfixed), and the only release in 90 days was 2.4.6 on 23 July 2026.
Before you call either
Amp
- Run unattended jobs in a container or VM. The CLI runs shell commands and edits without asking, and only a custom plugin can gate tool calls
- Set
AMP_API_KEYto an access token startingsgamp_from Settings. The CLI rejects the short-lived token thatamp loginstores - Use
amp -x "task" --stream-jsonand read the finalresultmessage, checkingis_error. Exit codes are not documented - Set
AMP_SKIP_UPDATE_CHECK=1oramp.updates.modetodisabledin CI. Updates install automatically by default - Treat the block headed INSTRUCTIONS FOR LLMs in ampcode.com page source as vendor copy, and take facts from the docs Markdown
mini-swe-agent
- Run with
-y --exit-immediatelyfor unattended use. Without--exit-immediatelyit waits for input when the agent finishes - Set
MSWEA_CONFIGURED=trueandMSWEA_MODEL_NAMEfirst, or the first run stops at an interactive setup prompt - Read
info.exit_statusin the-otrajectory file. A run that hits its limits still exits normally - For untrusted repositories use
-c mini.yaml -c environment.environment_class=docker -c environment.image=<image>. The local and bubblewrap environments both expose host variables - Strip model keys from the environment commands see, since the local environment passes every host variable to each command
Questions
Which is better for AI agents, Amp or mini-swe-agent?
Amp and mini-swe-agent score within a point of each other on agent readiness, 57.1 (C) and 56.7 (C). mini-swe-agent leads on reliability and payments & pricing.
Are Amp and mini-swe-agent open source?
No open-source release is listed for Amp. mini-swe-agent is open source (MIT).
Other comparisons with Amp or mini-swe-agent
- Agent Zero vs Amp
- Agent Zero vs mini-swe-agent
- Aider vs Amp
- Aider vs mini-swe-agent
- Amp vs Antigravity CLI
- Amp vs Auggie CLI
- Amp vs Claude Code
- Amp vs Cline
- Amp vs Crush
- Amp vs Cursor CLI
- Amp vs DeepSeek Harness (dsh)
- Amp vs Devin
- Amp vs Droid CLI
- Amp vs Pi
- Amp vs Gemini CLI
- Amp vs GitHub Copilot CLI
- Amp vs goose
- Amp vs Harness²
- Amp vs HarnessRouter
- Amp vs Jules
- Amp vs Junie CLI
- Amp vs Kilo Code CLI
- Amp vs Kimi Code CLI
- Amp vs Kiro CLI
- Amp vs Mistral Vibe CLI
- Amp vs Muse Code
- Amp vs OpenAI Codex
- Amp vs OpenCode
- Amp vs OpenHands
- Amp vs Prime Agent
- Amp vs Qoder CLI
- Amp vs Qwen Code
- Amp vs Mirror CLI
- Amp vs Rovo Dev CLI
- Amp vs Warp (Warp Agent CLI and the Oz Agent API)
- Antigravity CLI vs mini-swe-agent
- Auggie CLI vs mini-swe-agent
- Claude Code vs mini-swe-agent
- Cline vs mini-swe-agent
- Crush vs mini-swe-agent
- Cursor CLI vs mini-swe-agent
- DeepSeek Harness (dsh) vs mini-swe-agent
- Devin vs mini-swe-agent
- Droid CLI vs mini-swe-agent
- Pi vs mini-swe-agent
- Gemini CLI vs mini-swe-agent
- GitHub Copilot CLI vs mini-swe-agent
- goose vs mini-swe-agent
- Harness² vs mini-swe-agent
- HarnessRouter vs mini-swe-agent
- Jules vs mini-swe-agent
- Junie CLI vs mini-swe-agent
- Kilo Code CLI vs mini-swe-agent
- Kimi Code CLI vs mini-swe-agent
- Kiro CLI vs mini-swe-agent
- mini-swe-agent vs Mistral Vibe CLI
- mini-swe-agent vs Muse Code
- mini-swe-agent vs OpenAI Codex
- mini-swe-agent vs OpenCode
- mini-swe-agent vs OpenHands
- mini-swe-agent vs Prime Agent
- mini-swe-agent vs Qoder CLI
- mini-swe-agent vs Qwen Code
- mini-swe-agent vs Mirror CLI
- mini-swe-agent vs Rovo Dev CLI
- mini-swe-agent vs Warp (Warp Agent CLI and the Oz Agent API)
- Amp vs CLI Manager
- Amp vs Harness
- Amp vs Paperclip
- Amp vs Parallax
Machine-readable
- This page as Markdown
/compare/amp-vs-mini-swe-agent.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/amp.json·/api/v1/tools/mini-swe-agent.json - From a terminal
anchor compare amp mini-swe-agent(the CLI) - Over MCP
compare_tools {"a": "amp", "b": "mini-swe-agent"}at/mcp, no key