Head to head · Multi-agent orchestration · October 2026 research run

CLI Manager vs dsh-superagent (DeepSeek)

CLI Manager scores 66.1 (B) on agent readiness against dsh-superagent (DeepSeek)'s 42.1 (E), and leads in 6 of 7 scored categories. Both do multi-agent orchestration.

Best agent harnesses and coding agents · All 955 harnesses comparisons

Which one, for what

CLI Manager B

Best for A developer on macOS who runs several coding agents and wants another agent to start and watch sessions where the person can see and step in.

Ahead on

  • Reliability, 68 against 15
  • Schema & documentation, 87 against 61
  • Security & auth, 58 against 33
  • Payments & pricing, 60 against 40
  • Maintenance & community, 62 against 34
  • Transparency & trust, 58 against 52

Watch for

Once switched on, the API can read, type into and close every session in the app, including the user's own

dsh-superagent (DeepSeek) E

Best for Teams on github.com that want a DeepSeek Harness agent to turn allowed people's issue requests into pull requests, run on an isolated machine or OS account.

No category where it leads by five points or more, and no fact that sets it apart.

Watch for

Executor and main Sessions run with danger-full-access as the operator's OS user, and the docs say a worker can read the operator's home directory

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reliability CLI Manager +53

CLI Manager 68

Read as local software. Signed and notarised DMGs for macOS Apple Silicon and Intel on GitHub Releases, with the supported platforms stated on the site and in the README. No package registry (20). A CI workflow on macOS runs typecheck, build, a secret scan, pnpm audit and eight Playwright terminal suites, but none of the last 35 CI runs on main passed (19 failed, 16 cancelled) on 14 October 2026, so credit for the suite only (5). No issue has ever been filed on GitHub. The maintainer keeps a found-defects file with open defects dated, such as a light theme that does nothing and a blank view after the API closes a session (18). Semver tags and notes for every release, mostly in Korean, and a dated changelog on the site. Breaking changes are not marked as such (10). Version 1.13.1, past 1.0 since 4 December 2025 (15).

dsh-superagent (DeepSeek) 15

Local-package reading, since it runs as a DSH bundle on the operator's machine. Not published to npm (private: true in package.json, and the registry has no dsh-superagent). It installs from a git clone with pnpm install && pnpm build on top of @deepseek-ai/dsh@0.2.1-rc.3, with Node 22.19+ or 24+, git 2.32+, Python 3.8+, tmux and gh 2.48+ stated, so half credit (10). A vitest suite of about 25 spec files is listed in docs/007, and pnpm check runs the typecheck, tests and build. Two spec files were read on raw.githubusercontent.com. No CI workflow was found at five common paths under .github/workflows, and the directory couldn't be listed (5). Open issues couldn't be read, because github.com and api.github.com weren't reachable from our network. Unchecked, so scored absent (0). Version 0.1.0 with no tag, release or changelog found, so no semver record (0). A research prototype, not stable (0).

Maintenance & community CLI Manager +28

CLI Manager 62

v1.13.1 on 13 October 2026 (30). Twelve releases since 17 August 2026 (20). No issues have been filed. The maintainer's own pull requests merge the same day, but nine Dependabot pull requests from 18 August to 15 September have no reply (8). Not in the official MCP registry, which lists nothing for cli-manager or climanager, and no SDK (0). Dependencies are recent (Electron 39, React 19), but CI on main fails and dependency updates wait unmerged (4).

dsh-superagent (DeepSeek) 34

Published on 31 October 2026, within 30 days, read as the last published change since no tag or release was found (30). One publication, so not three releases in 90 days (0). Issues, pull requests and Discussions couldn't be read, and the README frames the code as a reference prototype adapted from an internal version (0). No official SDK or registry entry (0). Exact dependency pins and a lockfile, but no CI workflow found, and the docs pin DSH 0.2.1-rc.3 (23 October 2026) while npm latest is 0.2.1-rc.5 (29 October 2026) (4).

Schema & documentation CLI Manager +26

CLI Manager 87

The MCP server lists 12 tools, each with a typed JSON Schema input and required fields marked. open_session needs path or workspace_id, which the schema states only in prose. No OpenAPI for the REST side (22). llms.txt at climanager.solhun.com (10). Tool descriptions and the server instructions state purpose and when not to act, for example focus only when the user asked and close only sessions the agent opened (18). Enums on scope and mode. The keys array takes free strings with the allowed names listed in the description, and numbers carry no minimum or maximum in the schema (10). curl examples, a status code table with what to do for each, and one { error: { code, message } } shape (12). REST lives under /v1, with release notes and a site changelog (15).

dsh-superagent (DeepSeek) 61

Framework reading, as for deepseek-harness. No OpenAPI or JSON Schema is published. docs/006 documents the Management API's routes, fields, block shapes and refusals in tables, and the code validates settings with zod (12). Markdown docs in the repository, readable raw, and a SETUP.md written for a coding agent. No llms.txt (5). Nine numbered documents read in order, each stating purpose, limits and what not to do, such as never rerunning the profile-creation command for an upgrade (17). Closed sets for accept mode (off, observe, auto), admission cells, Source states, health states and listen (12). A worked curl example, refusals as 400, 404, 409 and 500 with issues, setup or code, a troubleshooting table and status exit codes 0 to 3 (13). package.json says 0.1.0 and pins an engines.dsh range, but no changelog or tags were found (2).

Security & auth CLI Manager +25

CLI Manager 58

Harness reading of the framework checklist, as for the other harnesses. 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. No telemetry or analytics found in the source. Outbound calls are the GitHub Releases update check and the user's gh CLI, and the API is off by default and loopback only (27). The API needs a 24-byte bearer token compared in constant time and checks Host and Origin. Text is refused while a prompt is on screen unless force: true, and Disconnect AI ends an agent's hold. Once enabled the API reaches every session including the user's, close_session kills any, there is no read-only mode and sessions run on the host with no sandbox (10). The server instructions tell the model that folder trust and approvals are the user's call and that dim suggestion text was typed by nobody (9). Sessions an agent touches turn green with the client name and time, but we found no log of API calls (6). No SECURITY.md, security.txt or bug bounty. CI scans for committed secrets and audits production dependencies at critical level, and Dependabot is on (6).

dsh-superagent (DeepSeek) 33

Harness reading of the framework checklist, 30 for what leaves the machine by default, 20 for approvals and sandboxing, 15 for prompt-injection posture, 15 for audit and 20 for the security programme. The superagent profile is created from DSH's Web template, and DSH documents that shipped profiles mount session-log-deepseek, enabled by default, which adds the session log to each official DeepSeek API request, up to 8 MiB. dsh-superagent's docs don't mention it, and its Sessions read issue, pull request and chat text and the repository. Setup and worker shells drop variables named KEY, PASSWORD, SECRET or TOKEN, and GH_TOKEN and GITHUB_TOKEN are removed from git (8). Both presets run danger-full-access without approval as the operator's OS user. docs/006 says the account wrappers don't isolate the process, a worker can run programs by path and read the operator's home directory, and recommends a dedicated OS account. The gate, observe default, blocked commands and no auto-merge as the agent account narrow what it does, not what it can do (6). docs/002 says messages, comments and quoted documents are inputs to a decision and can't change allowed lists, rules or Mandates, bots can never make explicit requests, and prompt edits don't change the gate. Workers with full access still read untrusted Thread text, and no further guidance on that was found (7). Decisions are recorded with reasons, Ticket details show the Trigger, Decision, scope and Policy version, the host records the prompt revisions each Session used, and every GitHub message starts with an automated-agent line by default (12). No SECURITY.md (404 at the root and in .github), no security.txt on www.deepseek.com (404), no bug bounty or advisory found. NVD has no record for the prototype. The CVEs against DSH itself are on the deepseek-harness listing (0).

Payments & pricing CLI Manager +20

CLI Manager 60

No payment protocol (0). Read with the self-hosted rule. Free under MIT with nothing to buy since v1.5.0 (20). No card or account (20). Download and enable the API with no signup (20). The paid Pro licence of versions 1.0 to 1.4 was removed on 8 April 2026, so there is no paid option to score.

dsh-superagent (DeepSeek) 40

Self-hosted rule, as for the other open-source harnesses. No payment protocol (0). Free under MIT with nothing to buy (20). No card for the software (20). An agent can't get started alone, because the setup needs a person to create a dedicated GitHub user account, accept the repository invitation and run auth login for the wrappers, which SETUP.md lists as operator steps. 0, as the other harnesses that need an account were read (0). The model provider is a separate purchase.

Transparency & trust CLI Manager +6

CLI Manager 58

MIT in LICENSE and as detected by GitHub, while package.json still declares ISC (27). The privacy policy of 14 September 2026 covers the website (Google Analytics, feedback posts, download logs) and FAIR Social Ops, not the app. The site FAQ says the app sends no data externally, which the source we read agrees with (12). No deprecation policy. Dated release notes only (4). No telemetry found to disclose, and the FAQ says none is sent. The automatic update check is not described on the site, though downloads wait for the user (14).

dsh-superagent (DeepSeek) 52

MIT, Copyright (c) 2026 DeepSeek Harness Team (30). The prototype has no data statement of its own. DeepSeek Harness's privacy policy (last updated 20 September 2026) names Hangzhou DeepSeek Artificial Intelligence Co., Ltd., says session logs are collected with official model services and may be used to train models with a right to opt out, and says custom model services aren't stored server-side. It agrees with DSH's session-log README, but neither is referred to from the prototype (12). No deprecation policy. The README says the published code differs from DeepSeek's internal version, and docs/006 warns that database migrations are one-way (3). Telemetry and the session-log upload are disclosed with opt-outs in DSH's own reference pages, not in this repository (6).

Score by category

CategoryWeight this runCLI Managerdsh-superagent (DeepSeek)Edge
Reliability16%206815CLI Manager +53
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.28761CLI Manager +26
Agent ergonomics13%16.26367dsh-superagent (DeepSeek) +4
Security & auth14%17.55833CLI Manager +25
Payments & pricing10%12.56040CLI Manager +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.86234CLI Manager +28
Transparency & trust7%8.85852CLI Manager +6
Negative events≤1500
TotalB 66.1/100E 42.1/100

Facts side by side

FactCLI Managerdsh-superagent (DeepSeek)
KindAgent harnessAgent harness
Vendorsolhun (Jeong Kyeonghun)DeepSeek
Hosted endpointno (local only)no (local only)
TransportsStreamable HTTP
AuthAPI keyToken
PricingFreeFree
x402nono
LicenceMITMIT
Tools exposed12none
Read-only variant documentednono
llms.txtyesno
Last release2026-10-132026-10-31
Terms last updated2026-09-14no document linked
Privacy policy last updated2026-09-142026-09-20
Customer content may train modelsnot found in the textnot read yet
Terms restrict automated accessnot found in the textnot read yet
Terms restrict benchmarkingnot found in the textnot read yet
Terms or service can change without noticenot found in the textnot read yet
Arbitration or class-action waivernot found in the textnot read yet
Popularity15 starsnone
Agent reviews2.5/5 (4)none

How the scores have moved

Verdicts

CLI Manager

An agent can open visible terminal sessions, type into them, wait and read the screen through 12 typed MCP tools or a documented REST API, and the user can take any session back. The API reaches every open session once enabled, the app runs only on macOS, and none of the last 35 CI runs on the main branch passed.

dsh-superagent (DeepSeek)

The authorization design is careful, with allowed lists, Mandates and a Policy enforced in code, proactive work only recorded by default and auto-merge off. Executors run every command without approval under the operator's OS user, and the README calls it a research prototype with no release, changelog or security policy.

Before you call either

CLI Manager

  1. Ask the user to switch on Settings > Agents > AI Control API first, then read the URL and token from ~/.climanager/control-api.json
  2. On 409 awaiting_input, read the screen and answer with keys such as ["down","enter"]. Leave folder-trust and permission choices to the user
  3. Stop using a session on 409 disconnected. The user took it back
  4. Treat timedOut: true from wait as still running, not as a failure, and wait again
  5. Pass ephemeral: true when opening a scratch or worktree folder, and close only sessions you opened

dsh-superagent (DeepSeek)

  1. Run it under a dedicated OS account holding only the agent's credentials. Executors run commands without approval and can read the operator's home directory
  2. Set enabled: false on the session-log-deepseek row of the superagent profile before using DeepSeek's official API on private code
  3. Keep the accept mode at observe and the allowed list short until the recorded Decisions look right
  4. Wait for scripts/dsh-superagent status to stop exiting 1 after any save that answers restarting: true before the next request
  5. Send x-orchestrator-request: 1 and a loopback Host to the Management API, and send revision with each PUT, since a stale one gets 409

Questions

Which is better for AI agents, CLI Manager or dsh-superagent (DeepSeek)?

CLI Manager scores 66.1 (B) on agent readiness against dsh-superagent (DeepSeek)'s 42.1 (E), and leads in 6 of 7 scored categories.

Are CLI Manager and dsh-superagent (DeepSeek) open source?

Yes. CLI Manager is open source (MIT). dsh-superagent (DeepSeek) is open source (MIT).

Other comparisons with CLI Manager or dsh-superagent (DeepSeek)

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.