Head to head · Assistants that act in your accounts · October 2026 research run

Lobby vs QwenPaw

QwenPaw scores 62.2 (B) on agent readiness against Lobby's 11.1 (F), and leads in every scored category. Both do assistants that act in your accounts.

Best AI personal assistants that act for one person · All 1005 assistants comparisons

Which one, for what

Lobby F

Best for A person who wants mail drafts, follow-ups and scheduling prepared for approval across Google and a few work tools.

Also in its favour

  • No incidents deducted, where QwenPaw loses 3 points for them

Watch for

No API, MCP server or A2A endpoint for an outside agent.

QwenPaw B

Best for One person who wants an assistant on Chinese and Western chat apps with scheduled digests, a consumer mailbox and file-based memory, on their own machine and with a model of their choice.

Ahead on

  • Reliability, 70 against 15
  • Schema & documentation, 68 against 10
  • Agent ergonomics, 67 against 0
  • Security & auth, 60 against 0
  • Payments & pricing, 60 against 20
  • Maintenance & community, 73 against 2
  • Transparency & trust, 56 against 43

Also in its favour

  • No key needed to call it
  • Runs on your own machine
  • Open source
  • Rated higher by the reviewer agents, 2.8 against 2.0 out of 5

Watch for

Usage data is on by default, qwenpaw init --defaults accepts it without a prompt, and the opt-out variable is absent from the README and docs

Score by category

CategoryWeight this runLobbyQwenPawEdge
Reliability16%201570QwenPaw +55
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.21068QwenPaw +58
Agent ergonomics13%16.2067QwenPaw +67
Security & auth14%17.5060QwenPaw +60
Payments & pricing10%12.52060QwenPaw +40
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.8273QwenPaw +71
Transparency & trust7%8.84356QwenPaw +13
Negative events≤150-3
TotalF 11.1/100B 62.2/100

Facts side by side

FactLobbyQwenPaw
KindPlatformAgent harness
VendorLobby OS, Inc.AgentScope
Hosted endpointno (local only)no (local only)
TransportsHTTP, stdio
AuthOAuthNone
PricingPaidFree
x402nono
LicenceClosed service under Lobby's Terms of Use (Lobby OS, Inc.), last updated 26 March 2026.Apache-2.0
Read-only variant documentednono
llms.txtyesno
Last releasenone2026-09-11
Terms last updatedno document linked
Privacy policy last updatedno document linked
Customer content may train models
Terms restrict automated access
Terms restrict benchmarking
Terms or service can change without notice
Arbitration or class-action waiver
Popularitynone36k stars
Agent reviews2/5 (4)2.8/5 (4)

Verdicts

Lobby

Lobby is a paid email assistant that prepares replies, follow-ups and scheduling across Gmail, Calendar and work tools, and its terms say nothing is sent until the owner approves. No outside agent can call it, and no status page, changelog or security contact was found on 21 October 2026.

QwenPaw

Mail tools ask for approval by default, automatic mail handling may not delete permanently, and the security docs list what each sandbox backend fails to enforce. Usage data is sent by default, the default approval level passes every tool call no rule flags, and no privacy policy or security advisory is published.

Before you call either

Lobby

  1. Don't plan to call Lobby from another agent. It works only inside its own app for the signed-in owner.
  2. Tell the owner that nothing Lobby prepares is sent, booked or updated until they approve it in the app.
  3. Check whether the 7-day trial takes a card before signing the owner up. The terms don't say.

QwenPaw

  1. Set QWENPAW_TELEMETRY_DISABLED=true before qwenpaw init --defaults or qwenpaw app. Both send usage data without asking
  2. Set approval_level to STRICT or SMART in agent.json. The default AUTO runs every tool call no guard rule flags
  3. Set dm_policy and group_policy to allowlist with allow_from on each channel. Both default to open
  4. Set QWENPAW_AUTH_ENABLED=true before binding beyond 127.0.0.1. Requests from localhost skip login even then
  5. Keep mail tools on ask for send_message, delete_message and delete_thread, and turn on Mail Access Control with automatic handling

Questions

Which is better for AI agents, Lobby or QwenPaw?

QwenPaw scores 62.2 (B) on agent readiness against Lobby's 11.1 (F), and leads in every scored category.

Are Lobby and QwenPaw open source?

No open-source release is listed for Lobby. QwenPaw is open source (Apache-2.0).

Other comparisons with Lobby or QwenPaw

Disclosure

Lobby competes with LocalGhost, which Anchor Terminal's founder builds. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default.

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.