Head to head · Desktop scripting · October 2026 research run
AutoHotkey vs Robot Framework
Robot Framework scores 76.4 (BB) on agent readiness against AutoHotkey's 52.8 (D), and leads in 6 of 7 scored categories. Both do desktop scripting.
Best desktop and mobile app automation for AI agents · All 15 desktop comparisons
Which one, for what
Best for An agent automating Windows desktop apps on one machine by writing short scripts.
No category where it leads by five points or more, and no fact that sets it apart.
Watch for
Windows only, and scripts act with every right of the user who runs them
Best for Agents that write or run keyword-driven test and RPA suites across web, desktop and mobile through libraries.
Ahead on
- Reliability, 95 against 61
- Schema & documentation, 86 against 54
- Agent ergonomics, 78 against 46
- Security & auth, 50 against 24
- Maintenance & community, 90 against 72
Also in its favour
- Agent-ready, a grade of BB or better
- Free to start without a card
Watch for
Desktop and mobile control depend on separate libraries, such as AppiumLibrary and AutoItLibrary, maintained outside the core project
Score by category
| Category | Weight this run | AutoHotkey | Robot Framework | Edge |
|---|---|---|---|---|
| Reliability | 16%20 | 61 | 95 | Robot Framework +34 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13%16.2 | 54 | 86 | Robot Framework +32 |
| Agent ergonomics | 13%16.2 | 46 | 78 | Robot Framework +32 |
| Security & auth | 14%17.5 | 24 | 50 | Robot Framework +26 |
| Payments & pricing | 10%12.5 | 60 | 60 | even |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7%8.8 | 72 | 90 | Robot Framework +18 |
| Transparency & trust | 7%8.8 | 73 | 76 | Robot Framework +3 |
| Negative events | ≤15 | 0 | 0 | |
| Total | D 52.8/100 | BB 76.4/100 |
Facts side by side
| Fact | AutoHotkey | Robot Framework |
|---|---|---|
| Kind | SDK + MCP | Agent framework |
| Vendor | AutoHotkey Foundation | Robot Framework Foundation |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | ||
| Auth | None | None |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | GPL-2.0 | Apache-2.0 |
| Read-only variant documented | no | no |
| llms.txt | no | yes |
| Last release | 2026-10-09 | 2026-09-14 |
| Terms last updated | no document linked | no document linked |
| Privacy policy last updated | no document linked | no date given |
| Customer content may train models | ||
| Terms restrict automated access | ||
| Terms restrict benchmarking | ||
| Terms or service can change without notice | ||
| Arbitration or class-action waiver | ||
| Popularity | 13k stars | 12k stars, 776k PyPI/wk |
Verdicts
AutoHotkey
An agent can write a script and run it through the command line, with a script read from standard input, /Validate and /ErrorStdOut for clean failures, and a function reference of 356 pages. It runs on Windows only with the user's full rights, and the repository has no CI or test suite.
Robot Framework
A stable 7.5 release, passing unit and acceptance tests, JSON schemas for results and library docs, and an llms.txt make it a dependable base for agent-written automation. Desktop and mobile control come from separate community libraries, there is no official MCP server, and no security policy or security.txt was found.
Before you call either
AutoHotkey
- Write output with
FileAppend text, "*"and pipe the interpreter's output, since stdout does not appear at the console it was launched from - Run
AutoHotkey64.exe /ErrorStdOut /Validate script.ahkbefore running a new script - Add
OnErrorortryblocks so a runtime error does not leave a dialog open in an unattended run - Target v2 syntax. v1 is unmaintained and its scripts do not run on v2
Robot Framework
- Install with
pip install robotframeworkand check withrobot --version. Add the library for the target app, such as AppiumLibrary, separately - Read the exit code. It is the number of failed tests or tasks up to 250, and 252, 253 or 255 mean bad input, a user stop or an internal error
- Use
--dryrunto validate a suite without running keywords, and--rerunfailed output.xmlto repeat only failures - Convert results with
rebot --output output.json output.xmlfor JSON that matches doc/schema/result.json - Keep secrets out of keyword arguments, because log.html records arguments unless keywords are removed with
--removekeywords
Questions
Which is better for AI agents, AutoHotkey or Robot Framework?
Robot Framework scores 76.4 (BB) on agent readiness against AutoHotkey's 52.8 (D), and leads in 6 of 7 scored categories.
Are AutoHotkey and Robot Framework open source?
Yes. AutoHotkey is open source (GPL-2.0). Robot Framework is open source (Apache-2.0).
Other comparisons with AutoHotkey or Robot Framework
Machine-readable
- This page as Markdown
/compare/autohotkey-vs-robot-framework.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/autohotkey.json·/api/v1/tools/robot-framework.json - From a terminal
anchor compare autohotkey robot-framework(the CLI) - Over MCP
compare_tools {"a": "autohotkey", "b": "robot-framework"}at/mcp, no key