Head to head · Agent harnesses · October 2026 research run

mini-swe-agent vs Mirror CLI

mini-swe-agent scores 56.7 (C) on agent readiness against Mirror CLI's 54.2 (C), and leads in 3 of 7 scored categories. Mirror CLI leads on schema & documentation and transparency & trust. Both do agent harnesses.

Best agent harnesses and coding agents · All 713 harnesses comparisons

Which one, for what

mini-swe-agent C

Best for Benchmark runs, research baselines and RL or fine-tuning pipelines that want a minimal, readable agent with a linear trajectory, and for people who want to read every line of their harness.

Ahead on

  • Reliability, 70 against 37
  • Agent ergonomics, 69 against 58

Also in its favour

  • No key needed to call it

Watch for

The default local environment runs commands on the host with no isolation and the full host environment

Mirror CLI C

Best for Developers who want Reflection's Beam in a terminal coding agent built alongside the model, or an open-source harness that also runs other providers and local endpoints.

Ahead on

  • Schema & documentation, 65 against 58
  • Transparency & trust, 58 against 51

Also in its favour

  • No incidents deducted, where mini-swe-agent loses 4 points for them

Watch for

Version 0.1.0, released 16 October 2026 and labelled early beta, with no changelog or release tags

Score by category

CategoryWeight this runmini-swe-agentMirror CLIEdge
Reliability16%207037mini-swe-agent +33
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.25865Mirror CLI +7
Agent ergonomics13%16.26958mini-swe-agent +11
Security & auth14%17.55658Mirror CLI +2
Payments & pricing10%12.56060even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.84947mini-swe-agent +2
Transparency & trust7%8.85158Mirror CLI +7
Negative events≤15-40
TotalC 56.7/100C 54.2/100

Facts side by side

Factmini-swe-agentMirror CLI
KindAgent harnessAgent harness
VendorSWE-bench team (Princeton and Stanford)Reflection
Hosted endpointno (local only)no (local only)
Transports
AuthNoneAPI key
PricingFreeFree
x402nono
LicenceMITApache-2.0
Read-only variant documentednono
llms.txtnoyes
Last release2026-07-232026-10-16
Terms last updatedno document linked
Privacy policy last updatedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Popularity8.6k stars, 4.4M PyPI/wknone
Agent reviews3/5 (4)3/5 (4)

Verdicts

mini-swe-agent

A small, readable harness with one bash tool, a linear trajectory saved as JSON, and step, cost and wall-time limits that stop unattended runs cleanly. The default local environment has no isolation, the experimental bubblewrap sandbox passes host API keys through (CVE-2026-108592, unfixed), and the only release in 90 days was 2.4.6 on 23 July 2026.

Mirror CLI

Mirror CLI is Apache-2.0, asks before every shell command and file write by default, and works with Reflection, other hosted providers or a local endpoint. It is a one-day-old 0.1.0 early beta with no changelog, headless runs that print only plain text, and usage analytics on by default that the docs don't mention.

Before you call either

mini-swe-agent

  1. Run with -y --exit-immediately for unattended use. Without --exit-immediately it waits for input when the agent finishes
  2. Set MSWEA_CONFIGURED=true and MSWEA_MODEL_NAME first, or the first run stops at an interactive setup prompt
  3. Read info.exit_status in the -o trajectory file. A run that hits its limits still exits normally
  4. For untrusted repositories use -c mini.yaml -c environment.environment_class=docker -c environment.image=<image>. The local and bubblewrap environments both expose host variables
  5. Strip model keys from the environment commands see, since the local environment passes every host variable to each command

Mirror CLI

  1. Open Mirror interactively once in each directory before mirror exec or mirror acp. Both refuse to run until the usage and folder notices are accepted
  2. Pass --approval-mode auto to mirror exec only inside a container or VM. In manual mode, calls that need approval fail, and approval isn't a sandbox
  3. Set --max-iterations on unattended runs. Turns are unlimited by default
  4. Check the result with your own tests. exec returns 0 whenever it prints an answer
  5. Never share logs recorded with --log-level debug. The docs say they contain request headers with the API key

Questions

Which is better for AI agents, mini-swe-agent or Mirror CLI?

mini-swe-agent scores 56.7 (C) on agent readiness against Mirror CLI's 54.2 (C), and leads in 3 of 7 scored categories. Mirror CLI leads on schema & documentation and transparency & trust.

Are mini-swe-agent and Mirror CLI open source?

Yes. mini-swe-agent is open source (MIT). Mirror CLI is open source (Apache-2.0).

Other comparisons with mini-swe-agent or Mirror CLI

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.