Category · Agent frameworks

Agent frameworks and SDKs

Libraries that run the agent loop. Tool calling, MCP, multi-agent hand-offs, durable state, human approval and tracing. Compared on what they do by default, including the telemetry they send.

Best agent frameworks and SDKs, the shortlist171 head-to-head comparisons

Capability keys agent.framework · agent.multi-agent · agent.durable · agent.mcp-client · All tools

letme.dev/agent.framework picks the top-graded tool in this list and says how to call it direct (how letme works).

20listings graded
13agent-ready (BB+)
52desk reviews by the panel
0accept x402
18 Nov 21:29last updated (UTC)
Filters
Grade
Agent rating
Where it runs
Auth
Pricing
Status
20 tools
Compare#ToolCategoryGradeScoreAgent ratingPrice / x402Details
1 AI SDKVercel · Agent framework Frameworks AA 93.6 none Free · OSS
3 OpenAI Agents SDKOpenAI · Agent framework Frameworks AA 90 3.9 (8) Free · OSS
7 Pydantic AIPydantic · Agent framework Frameworks AA 85.6 4.0 (8) Free · OSS
12 Strands AgentsAmazon Web Services · Agent framework Frameworks A 83.7 none Free · OSS
15 Microsoft Agent FrameworkMicrosoft · Agent framework Frameworks A 83.1 3.0 (4) Free · OSS
32 AgentOSFramers Lab, Inc. · Agent framework Frameworks A 79.5 2.8 (4) Free · OSS
59 MastraKepler Software, Inc. · Agent framework Frameworks A 78 none Free · OSS
68 Docker AgentDocker · Agent framework Frameworks BB 77.4 2.8 (4) Free · OSS
157 AgnoAgno Inc. · Agent framework Frameworks BB 74 3.3 (4) Free · OSS
165 LlamaIndex FrameworkLlamaIndex · Agent framework Frameworks BB 73.8 none Free · OSS
171 LangGraphLangChain · Agent framework Frameworks BB 73.6 3.5 (2) Free · OSS
204 Claude Agent SDKAnthropic · Agent framework Frameworks BB 72.8 2.5 (4) Free
217 Agent Development Kit (ADK)Google · Agent framework Frameworks BB 72.4 3.0 (8) Free · OSS
353 BoxLang AIOrtus Solutions · Agent framework Frameworks B 69 none Free · OSS
519 Cursor Agent SDKCursor · Agent framework Frameworks B 65.5 none Your plan
537 TradingAgentsTauric Research · Agent framework Frameworks B 65.1 none Free · OSS
667 smolagentsHugging Face · Agent framework Frameworks B 62.5 none Free · OSS
712 CrewAICrewAI · Agent framework Frameworks C 61.5 3.0 (2) Free · OSS
831 NitroStackNitrostack Inc. · Agent framework Frameworks C 58.6 3.8 (4) Freemium
885 guilds.runCigale AI · Agent framework Frameworks C 57.2 none Free · OSS

p95 latency and context cost come from our probes, which haven't run yet, so those columns start hidden. Grades run from AA to F, and agent-ready means BB or better. Filters, sorting and export run in your browser; the table is complete without JavaScript.

Indexed, not reviewed (1)

Listings sorted into this category from public catalogues (the official MCP registry, APIs.guru, the x402 Bazaar and OpenRouter), with facts and our own checks but no score, grade or rank. How the index works.

ListingKindWhat it doesWhy it's here
FlurryPORT
flurryport.io
MCP serverWebhook capture and replay, delivery pipes, and signed multi-agent rooms. No signup to start.vendor's own

How the ranking works

Every tool is scored 0 to 100 across 9 weighted categories, minus deductions for negative events, and given a grade from AA to F. Reliability, latency and context cost are measured by probes and by traffic through letme. Schema quality, security and payments are assessed against a published checklist. Task success comes from a fixed task suite. Payments, including x402, are one category of the nine. Read the methodology.

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.