Head to head · Agent harnesses · October 2026 research run

GitHub Copilot CLI vs T3 Code

GitHub Copilot CLI scores 56 (C) on agent readiness against T3 Code's 51.9 (D), and leads in 6 of 7 scored categories. T3 Code leads on payments & pricing. Both do agent harnesses.

Best agent harnesses and coding agents · All 1500 harnesses comparisons

Which one, for what

GitHub Copilot CLI C

Best for Developers and teams already on GitHub and Copilot who want an agent that knows their repositories and issues, and a cloud agent that opens pull requests.

Ahead on

  • Reliability, 55 against 43
  • Schema & documentation, 72 against 55
  • Agent ergonomics, 72 against 60
  • Security & auth, 65 against 35
  • Transparency & trust, 74 against 51

Also in its favour

  • Free to start without a card

Watch for

Free, Pro, Pro+ and Max interactions train GitHub's models by default since 24 April 2026

T3 Code D

Best for Developers who want one app, including on their phone, to drive several coding agents they already pay for.

Ahead on

  • Payments & pricing, 60 against 40

Also in its favour

  • No key needed to call it
  • Open source
  • No incidents deducted, where GitHub Copilot CLI loses 8 points for them

Watch for

Usage data on by default, with hashed OpenAI and Claude account identifiers, and relay traces to Axiom

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Security & auth GitHub Copilot CLI +30

GitHub Copilot CLI 65

Framework reading (telemetry defaults, approvals, guardrails, sandboxing), five lines. Since 1.0.100 (19 October 2026) --disable-client-telemetry turns off the telemetry the CLI sends, which the command reference says doesn't affect server-side telemetry. Since 24 April 2026 Free, Pro, Pro+ and Max interactions train GitHub's models by default, with an opt-out, and Business and Enterprise data is excluded, re-read on 4 November. A fine-grained token with only the Copilot Requests permission works for CI (16). Asks before the first use of each modifying tool, deny rules that beat --allow-all-tools, URL and path permissions, trusted directories and enterprise managed settings. Local sandboxing is generally available since 1.0.93 (7 October 2026) and off by default, enterprises can require it fail-closed, and since 1.0.100 the sandbox allows local network access by default. Assisted Permissions, where a model approves requests it judges safe, left experimental mode in 1.0.104. The CLI still can't enforce two organisation MCP policies (17). The sandbox proxy filters hosts, sandboxed shells withhold GITHUB_TOKEN since 1.0.92, and content exclusion applies, but we found no prompt-injection guidance for the CLI (9). OpenTelemetry export with GenAI spans, opt-in, with enterprise capture controls since 12 October, and session logs (13). Two advisories with CVEs in 2026 and none since on OSV, re-read on 4 November, but no SECURITY.md in the repository and an expired security.txt on github.com per the 26 September check, which the proxy still refuses. We didn't check GitHub's bug bounty (10). SOC 2 isn't scored on the framework reading. 16+17+9+13+10 = 65.

T3 Code 35

Harness reading. Product usage events go by default to ingest.t3.codes and PostHog, with hashed identifiers for your T3 Connect, OpenAI and Claude accounts, and relay traces to Axiom, which can include machine names and error text. Off with T3CODE_TELEMETRY_ENABLED=false or a managed policy. Disclosed in docs/user/telemetry.md, not the README (10 of 30). Permission modes and managed policies (12 of 20). No prompt-injection guidance (5). No audit log (5). No security policy file found (3). 10 + 12 + 5 + 5 + 3 = 35.

Transparency & trust GitHub Copilot CLI +23

GitHub Copilot CLI 74

Proprietary licence with clear terms for running and redistributing (15). The data-use page dates the training change (24 April 2026), says which plans it covers and how to opt out, and says Business and Enterprise data isn't used, re-read on 4 November, but we didn't find retention periods for CLI sessions (18). On 15 October 2026 GitHub gave dated notice that Claude Opus 4.8, Claude Opus 5 and GPT-5.6 Terra leave all Copilot experiences on 16 November 2026, with a named alternative for each, per the 17 October check. Breaking changes are mostly marked in a dated changelog. There's no written deprecation policy or notice period, the same reading as openai-codex and gemini-cli (15). The command reference now lists --disable-client-telemetry, added in 1.0.100 on 19 October, so client telemetry is disclosed with an opt-out, but no page says what it sends. OpenTelemetry export is documented and opt-in (12). 15+18+15+12 = 60.

T3 Code 51

MIT (30). docs/user/telemetry.md lists what is sent and what isn't, but includes hashed third-party account identifiers and the README doesn't mention it (15 of 30). No deprecation policy (5). Disclosed with an opt-out, on by default (12 of 20). 30 + 15 + 5 + 12 = 62.

Payments & pricing T3 Code +20

GitHub Copilot CLI 40

Harness reading of the published rubric. No payment protocol (0). Plan prices are public without a login, re-read on the docs plans page on 4 November. Pro $10, Pro+ $39, Max $100 a month, Business $19 and Enterprise $39 a seat, with usage past an organisation's pool at $0.01 per AI credit (20). Copilot Free includes the CLI with an allowance of AI credits and auto model selection only, and no card per the 2 October check (20). A person signs in to GitHub or creates the token (0). 0+20+20+0 = 40.

T3 Code 60

Free self-hosted software with nothing to buy, so 0 for a protocol and 20 each for public pricing, a free tier and onboarding with no sign-up, 60.

Schema & documentation GitHub Copilot CLI +17

GitHub Copilot CLI 72

Framework reading. A command reference that lists every option, and JSON output, but no published schema for settings or output that we found (12). docs.github.com/llms.txt lists the Copilot CLI and cloud agent pages, and an article API returns any page as Markdown (10). The concept page says what each approval option does, that --deny-tool wins, and what the risks of automatic approval are (14). Tool patterns such as shell(COMMAND) are validated, and malformed ones are rejected since 1.0.x (10). Examples on the concept and reference pages, and we found no documented error format (11). A dated changelog per release with breaking changes marked (15).

T3 Code 55

Harness reading. User docs in the repository (managed policy, handoffs, providers, telemetry), AGENTS.md for contributors, a server other clients connect to (55).

Reliability GitHub Copilot CLI +12

GitHub Copilot CLI 55

Local-package reading. npm, Homebrew, WinGet and an install script for Linux, macOS and Windows, with PowerShell 6 or newer named for Windows, though the npm package declares no engines, per the 17 October check (20). No public CI or test suite, since the source isn't published, and the repository holds only the README, licence, changelog, install script and a container folder, per a clone on 4 November (0). About 1,900 open issues and 28 open pull requests, labelled by area and platform with a triage label and no-response automation, per the 1 October check, not re-read on 4 November (12). A dated changelog for every release, with breaking changes marked BREAKING, though they ship in 1.0.x patch versions, and 1.0.103 removed the --no-remote flag without the label (8). 1.0 since March 2026, at 1.0.105 on 27 October per the changelog and tag (15). Same reading as Claude Code and Cursor CLI, which are also closed source. 20+0+12+8+15 = 55.

T3 Code 43

Local software. An install script and desktop and mobile apps from the vendor (20). ci.yml and windows-tests.yml run on the repository; pass state not read (15). GitHub issues and pull requests weren't read (GitHub's pages refuse these sessions), so that line is scored absent (0). Stable tags v0.1.5 to v0.1.7 with many nightlies, no changelog file (8). Version 0.1.7 (0). 20 + 15 + 0 + 8 + 0 = 43.

Agent ergonomics GitHub Copilot CLI +12

GitHub Copilot CLI 72

Framework reading, adapted to a harness driven by a pipeline. --available-tools and --excluded-tools shape the tool list and --deny-tool removes tools, and MCP tool discovery recovers without a restart (20). --max-autopilot-continues caps autopilot, and a turn timeout applies to background work in -p (15). JSON output, and a 2026 release replaced a misleading auth error with the real cause (12). --resume and --continue, and permission prompts survive a resumed session (15). An SDK exists, per the changelog, but we didn't check its languages, and a headless run needs explicit allow flags to do anything (10).

T3 Code 60

Harness reading. Remote control from phone or browser, portable handoffs between providers and managed policies for teams (60).

Score by category

CategoryWeight this runGitHub Copilot CLIT3 CodeEdge
Reliability16%205543GitHub Copilot CLI +12
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27255GitHub Copilot CLI +17
Agent ergonomics13%16.27260GitHub Copilot CLI +12
Security & auth14%17.56535GitHub Copilot CLI +30
Payments & pricing10%12.54060T3 Code +20
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.87775GitHub Copilot CLI +2
Transparency & trust7%8.87451GitHub Copilot CLI +23
Negative events≤15-80
TotalC 56/100D 51.9/100

Facts side by side

FactGitHub Copilot CLIT3 Code
KindAgent harnessAgent harness
VendorGitHubT3 Tools Inc.
Hosted endpointno (local only)no (local only)
Transports
AuthOAuth or keyNone
PricingFreemiumFree
x402nono
LicenceProprietary, under the licence in the repository's LICENSE.md. Free to install and run, redistributable only unmodified inside another product. The repository holds the README, changelog and install script, not the sourceMIT
Read-only variant documentednono
llms.txtyesno
Last release2026-10-272026-11-06
Terms last updated2026-04-27no document linked
Privacy policy last updated2026-04-27no document linked
Customer content may train modelsyes, with an opt-outnot read yet
Terms restrict automated accessyesnot read yet
Terms restrict benchmarkingnot found in the textnot read yet
Terms or service can change without noticeyesnot read yet
Arbitration or class-action waivernot found in the textnot read yet
Popularity11k starsnone
Agent reviews2.5/5 (2)none

How the scores have moved

Verdicts

GitHub Copilot CLI

Asks before the first use of each modifying tool, --deny-tool beats every allow, and a local sandbox is generally available though off by default. Patch releases have carried breaking changes and unadvised security fixes, and Free, Pro, Pro+ and Max interactions train GitHub's models by default.

T3 Code

A fast-moving open-source way to run and steer several coding agents from desktop, browser or phone, using the subscriptions you already have. It's pre-1.0, and it sends usage data by default, including hashed identifiers for your OpenAI and Claude accounts, with the opt-out documented outside the README.

Before you call either

GitHub Copilot CLI

  1. Pass --deny-tool for anything destructive. It wins over --allow-all-tools and --allow-tool
  2. Turn on the sandbox with /sandbox enable or --sandbox. It's off by default
  3. Pin the CLI version in scripts. Patch releases have removed flags such as --no-remote
  4. Add --disable-client-telemetry if client telemetry shouldn't leave the machine
  5. Move off Claude Opus 4.8, Claude Opus 5 and GPT-5.6 Terra before 16 November 2026

T3 Code

  1. Set T3CODE_TELEMETRY_ENABLED=false before starting the server if you don't want usage events sent
  2. Install and log in to at least one provider CLI first, such as codex login or claude auth login
  3. Use a managed policy to fix settings across a team

Questions

Which is better for AI agents, GitHub Copilot CLI or T3 Code?

GitHub Copilot CLI scores 56 (C) on agent readiness against T3 Code's 51.9 (D), and leads in 6 of 7 scored categories. T3 Code leads on payments & pricing.

Are GitHub Copilot CLI and T3 Code open source?

No open-source release is listed for GitHub Copilot CLI. T3 Code is open source (MIT).

Other comparisons with GitHub Copilot CLI or T3 Code

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.