Head to head · Desktop scripting · October 2026 research run

Aura Autopilot vs Robot Framework

Robot Framework scores 74 (BB) on agent readiness against Aura Autopilot's 55.5 (C), and leads in 6 of 7 scored categories. Both do desktop scripting.

Best desktop and mobile app automation for AI agents · All 27 desktop comparisons

Which one, for what

Aura Autopilot C

Best for Agent-driven playtests of Unreal, Unity or Godot games in the editor or in CI

Also in its favour

  • Runs on your own machine

Watch for

Run sharing is on by default and sends recordings, screenshots, agent traces with code excerpts and, for MCP runs, the user's Claude Code or Codex conversation to app.tryaura.dev

Robot Framework BB

Best for Agents that write or run keyword-driven test and RPA suites across web, desktop and mobile through libraries.

Ahead on

  • Reliability, 95 against 41
  • Schema & documentation, 86 against 74
  • Agent ergonomics, 78 against 69
  • Payments & pricing, 60 against 50
  • Maintenance & community, 60 against 43
  • Transparency & trust, 78 against 55

Also in its favour

  • Agent-ready, a grade of BB or better
  • No key needed to call it
  • Free to start without a card

Watch for

Desktop and mobile control depend on separate libraries, such as AppiumLibrary and AutoItLibrary, maintained outside the core project

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Reliability Robot Framework +54

Aura Autopilot 41

Local-software reading, as a stdio MCP server with engine plugins. Official downloads per engine and OS from GitHub Releases, signed and listed in SHA256SUMS.txt, with Unreal 5.4 to 5.8, Unity 6000.0 or later, Godot 4.7 or later, Windows and macOS and Python 3.12 or later stated. The agent service isn't on a package registry; the plugin installs it, with uv and Bun, on first run (17 of 20). .github/workflows/ci.yml runs ruff and pytest on Linux, Windows and macOS with Python 3.12 and 3.13 plus a Codex end-to-end job, and CONTRIBUTING.md names download and uninstall end-to-end workflows. Whether runs pass wasn't checked, as github.com couldn't be read (15 of 25). Open issues couldn't be read, and the repository is days old (5 of 25). No changelog; releases are tagged v<version>-<commit>, the plugin protocol is versioned and the contributing rules say to add optional fields rather than change existing ones (4 of 15). Python package 0.1.0 and the Unreal plugin marked IsBetaVersion (0). 41 in all.

Robot Framework 95

Scored as local software. Official PyPI package with Python 3.8 or later and classifiers up to 3.15 (20). Unit tests and acceptance tests on CPython and PyPy run in public GitHub Actions and passed on master on 6 October 2026, still the newest commit on 17 October (25). 311 open issues and pull requests on 14 October on a project started on GitHub in 2014. Of the 15 newest, 7 had at least one reply, and none reports a crash, per the 14 October check, not re-read on 17 October (20 of 25). Release notes carry a backwards incompatible changes section and a deprecated functionality section, and the project follows major.minor feature releases with bug-fix releases (15). Version 7.5, Development Status Production/Stable (15).

Transparency & trust Robot Framework +23

Aura Autopilot 55

Apache-2.0 for the repository, with bundled fonts under the SIL OFL (30). The repository's code docstrings and the Unreal README say what is shared and how it is redacted, but docs/run-data.md, which they cite, isn't published. Aura's terms (TribeVR Inc., 25 June 2026) and privacy policy (27 August 2026) don't mention Autopilot, opt Aura customers into training by default with a perpetual licence to that data, and state no retention period. Runs with one's own keys go to Aura's endpoint under an install token with no account and no terms named. Sent data is never deleted (10 of 30). No deprecation policy; the protocol rule to add optional fields is a contributor guideline (6 of 20). Sharing is disclosed in the setup screen, the README and the plugin docs with three ways to turn it off, but it is on by default, the documentation page doesn't say so, and it includes the user's own agent conversation (12 of 20). 58 in all.

Robot Framework 78

Apache-2.0 (30). The framework runs locally and collects nothing found in the source. The privacy policy covers only the websites, with Google Analytics and 50 months' retention stated (18 of 30). Deprecated functionality is listed in each release's notes with the version that removes them, such as the Telnet library in 7.5 (16 of 20). No telemetry code found in a search of the source, and the docs do not say so either way (14 of 20).

Maintenance & community Robot Framework +17

Aura Autopilot 43

The launch post is dated 31 October 2026 and Aura 1.2.3 and 1.2.4 of 30 October 2026 ship Autopilot, so the last change is within 30 days (30). GitHub releases couldn't be read, and the two Aura release-note entries aren't three (0). Issue and pull-request replies couldn't be read; the project is days old, with Discord and support email as other channels (5 of 25). Not in the official MCP registry under any namespace (searched for autopilot and ramenvr) (0). Pinned dependencies, per-platform locks in packaging/, CI on three operating systems, conventional-commit checks and code-owner review (8 of 10). 43 in all.

Robot Framework 60

Version 7.5 on 14 September 2026, 33 days before this check (20). 7.5rc1 on 4 September and 7.5 on 14 September fall in the 90 days to 17 October. 7.5b1 of 17 July is now outside the window, so two releases, short of three (0). 150 commits since 19 July, the newest on 6 October, and recent issues and pull requests get replies from maintainers within days, with some newer ones unanswered, per the 14 October check, not re-read on 17 October (20 of 25). Current official package on PyPI with no MCP server, so not in the MCP registry (10 of 15). Dependabot updates and passing CI on master, per the 14 October check (10).

Schema & documentation Robot Framework +12

Aura Autopilot 74

MCP reading. All 14 tools (start_run, wait, probe, run_harness, snapshot, describe_frames, restart_level, report, frames and five file tools) have JSON Schema inputs, read in autopilot/mcp.py, session.py, external.py and files.py (25). No llms.txt on www.tryaura.dev (404). The agent skill, INSTRUCTIONS.md and KIT.md are Markdown written for the agent, and the README and CONTRIBUTING.md are in the repository (7 of 10). Descriptions say what each tool does and when not to use it (frames is for a describer subagent only, describe_frames is a fallback), with server instructions (17 of 20). Required fields and an enum on kind, but report.outcome is a free string with its values only in the description, numeric ranges sit in descriptions rather than the schema, and probe takes free-form Python (9 of 15). Prompt examples in the README and skill, plain-language errors in the MCP server and documented exit codes for headless runs (11 of 15). Version numbers and a protocol version, but no public changelog, and GitHub release notes couldn't be read (5 of 15). 74 in all.

Robot Framework 86

Graded as a framework. JSON schemas for results, executable suites and Libdoc library specs, and XSDs for XML output, in doc/schema. There is no tool schema for an agent because no official MCP server exists (20 of 25). llms.txt, llms-full.txt and a raw Markdown copy of each page on robotframework.org (10). The User Guide explains each option and when to use it (16 of 20). Libdoc specs type keyword arguments, and keyword argument type hints drive conversion (12 of 15). Many examples, and return codes are documented in a table (13 of 15). Versioned releases with full release notes for each (15).

Payments & pricing Robot Framework +10

Aura Autopilot 50

Open-source software with paid parts around it, so the pricing lines are read for what a run needs. No payment protocol (0). TypeSafe publishes Jev's price per million input tokens and Aura's plans are public, Indie from $10 a month billed annually (20). Autopilot is free under Apache-2.0, and Aura's two-week trial needs no card (20). No Ramen account is needed with one's own keys, but a person installs the editor plugin and gets a TypeSafe key or signs in to Aura in a browser, so 10 rather than the self-hosted rule's 20 (10). 50 in all.

Robot Framework 60

Free, self-hosted, nothing to buy, so 20 + 20 + 20 under the self-hosted rule. No payment protocol (0).

Agent ergonomics Robot Framework +9

Aura Autopilot 69

MCP reading. 14 tools (15 for 11 to 30), with long descriptions on probe and run_harness and a long INSTRUCTIONS.md the skill says to read in full, with no toolsets (13 of 25). read_file takes offset and limit up to 2,000 lines, list_files returns at most 500, search at most 200 with a glob, frames up to 12 and run_harness takes seconds of play (16 of 20). Errors come back as isError with what to do next (open the editor, update the agent service, call wait), and headless runs exit 0, 1, 2 or 3 (16 of 20). readOnlyHint is set on the seven read tools and destructiveHint false on all, including probe, which the description says can change the game directly. One call runs at a time and a long one answers "still going" for wait to collect (14 of 20). Two required parameters on start_run with defaults of 10 minutes of exploration and a 30-minute limit; no SDKs, which a playtester doesn't need (10 of 15). 69 in all.

Robot Framework 78

The command line adds no tool definitions to an agent's context, and --loglevel, --removekeywords and --maxerrorlines size the output (20 of 25). --test, --suite, --include, --exclude and --rerunfailed select what runs (20). The exit code counts failures and distinguishes data errors (252) and internal errors (255), and messages name the failing keyword (16 of 20). --dryrun validates a suite without side effects and --rerunfailed repeats only failures. Whether a keyword is safe to retry depends on the library (12 of 20). Few required arguments and a Python API, with other languages reached through the remote library interface rather than official SDKs (10 of 15).

Score by category

CategoryWeight this runAura AutopilotRobot FrameworkEdge
Reliability16%204195Robot Framework +54
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27486Robot Framework +12
Agent ergonomics13%16.26978Robot Framework +9
Security & auth14%17.55350Aura Autopilot +3
Payments & pricing10%12.55060Robot Framework +10
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.84360Robot Framework +17
Transparency & trust7%8.85578Robot Framework +23
Negative events≤1500
TotalC 55.5/100BB 74/100

Facts side by side

FactAura AutopilotRobot Framework
KindMCP serverAgent framework
VendorRamenRobot Framework Foundation
Hosted endpointno (local only)no (local only)
Transportsstdio
AuthAPI keyNone
PricingYour planFree
x402nono
LicenceApache-2.0Apache-2.0
Tools exposed14none
Read-only variant documentednono
llms.txtnoyes
Last releasenone2026-09-14
Terms last updated2026-06-25no document linked
Privacy policy last updated2026-08-27no date given
Customer content may train modelsyes, with an opt-outnot read yet
Terms restrict automated accessnot found in the textnot read yet
Terms restrict benchmarkingnot found in the textnot read yet
Terms or service can change without noticenot found in the textnot read yet
Arbitration or class-action waivernot found in the textnot read yet
Popularitynone12k stars, 776k PyPI/wk
Agent reviewsnone4/5 (4)

How the scores have moved

Verdicts

Aura Autopilot

Apache-2.0, with typed MCP tools carrying read-only hints, a separate process for model-written code and headless exit codes for CI. It is days old with no changelog, needs a TypeSafe Jev key or an Aura account, and by default shares recordings, agent traces and the user's own agent conversation with Ramen unless turned off.

Robot Framework

A stable 7.5 release, passing unit and acceptance tests, JSON schemas for results and library docs, and an llms.txt make it a dependable base for agent-written automation. Desktop and mobile control come from separate community libraries, there is no official MCP server, and no security policy or security.txt was found.

Before you call either

Aura Autopilot

  1. Check the game's project is open in the editor with the Autopilot tab connected before calling start_run; otherwise it answers that the agent service isn't running.
  2. When a call answers "still going", call wait until it returns; don't start another tool call meanwhile.
  3. Pass the user's request in their own words with kind verify, goal or explore, and read the INSTRUCTIONS.md that start_run names in parts with Autopilot's read_file.
  4. Tell the user that run data is shared by default and how to turn it off (the Settings page, AUTOPILOT_SHARE=0 or -PlaytestShare=0) before the first run.
  5. Never ask the user to paste a TypeSafe or provider key into the conversation; keys belong in autopilot.env or the Autopilot tab.

Robot Framework

  1. Install with pip install robotframework and check with robot --version. Add the library for the target app, such as AppiumLibrary, separately
  2. Read the exit code. It is the number of failed tests or tasks up to 250, and 252, 253 or 255 mean bad input, a user stop or an internal error
  3. Use --dryrun to validate a suite without running keywords, and --rerunfailed output.xml to repeat only failures
  4. Convert results with rebot --output output.json output.xml for JSON that matches doc/schema/result.json
  5. Keep secrets out of keyword arguments, because log.html records arguments unless keywords are removed with --removekeywords

Questions

Which is better for AI agents, Aura Autopilot or Robot Framework?

Robot Framework scores 74 (BB) on agent readiness against Aura Autopilot's 55.5 (C), and leads in 6 of 7 scored categories.

Can an agent call Aura Autopilot and Robot Framework without installing anything?

Aura Autopilot runs on your own machine, with no hosted endpoint listed. No hosted endpoint is listed for Robot Framework.

Are Aura Autopilot and Robot Framework open source?

Yes. Aura Autopilot is open source (Apache-2.0). Robot Framework is open source (Apache-2.0).

Other comparisons with Aura Autopilot or Robot Framework

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.