Head to head · Agent frameworks · October 2026 research run

OpenAI Agents SDK vs smolagents

OpenAI Agents SDK scores 86.2 (AA) on agent readiness against smolagents's 58.7 (C), and leads in 6 of 7 scored categories. Both do agent frameworks.

Best agent frameworks and SDKs · All 171 frameworks comparisons

Which one, for what

OpenAI Agents SDK AA

Best for Teams that want hand-offs, guardrails and approvals with little code, and are happy with OpenAI's tracing or will turn it off.

Ahead on

  • Reliability, 85 against 64
  • Schema & documentation, 95 against 81
  • Agent ergonomics, 97 against 68
  • Security & auth, 80 against 66
  • Maintenance & community, 100 against 34
  • Transparency & trust, 89 against 65

Also in its favour

  • Agent-ready, a grade of BB or better
  • No incidents deducted, where smolagents loses 6 points for them

Watch for

Tracing on by default, with model and tool content, sent to OpenAI

smolagents C

Best for Small Python projects and research that want code-writing agents with minimal abstraction.

Also in its favour

  • No key needed to call it

Watch for

No release since 1.26.0 on 29 May 2026, and few commits to main since August

Why the edge

Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.

Maintenance & community OpenAI Agents SDK +66

OpenAI Agents SDK 100

0.24.0 on PyPI on 2026-10-15, 17 days before 1 November (30). 11 PyPI releases in the 90 days to 1 November, from 0.19.3 on 4 August to 0.24.0 (20). 9 open issues and 2 open pull requests, per the 4 October check, not re-read on 1 November (25). Python 0.24.0 and @openai/agents 0.21.0 (tagged 20 October) both current (15). Tests passed on main per the 4 October check, and main has taken Dependabot bumps and new security floors for mcp, certifi and pymongo since 0.24.0 (10).

smolagents 34

v1.26.0 on 29 May 2026, 161 days before this check (10). No release in the 90 days to 6 November (0). 416 open issues and 1,045 open issues and pull requests on 6 November, with 144 issues opened in the 90 days to 3 November. Of the 50 newest, 26 had a comment and 1 was closed. Two 2026 CVE records say the vendor didn't respond to the reporter, and seven commits reached main from 8 August to 6 November (6). Python only, and the package is the current one (10). CI with actions pinned to commit SHAs and Dependabot for actions (8). 10+0+6+10+8 = 34.

Agent ergonomics OpenAI Agents SDK +29

OpenAI Agents SDK 97

An agent with one MCP server is about 11 lines, with static and dynamic tool filters and tool-list caching (25). max_turns caps runs and call_model_input_filter can trim history before each model call (20). Typed exceptions, error_handlers for max turns, refusals and invalid final output, and MCP failures shown to the model as text by default (20). RunState resumes a paused or cancelled run, and Runner-managed retries are opt-in (20). An agent needs a name and instructions, but 0.20.0 changed the default model (7). Python and JavaScript (5).

smolagents 68

Framework reading. MCPClient loads an MCP server's tools in a few lines (20). max_steps, planning intervals and final_answer_checks bound a run (16). Errors from tools and code go back to the model as observations (14). No built-in retry, idempotency or resume beyond replaying memory (8). Few required parameters and many providers, Python only, and the default model needs a Hugging Face token (10). 20+16+14+8+10 = 68.

Transparency & trust OpenAI Agents SDK +24

OpenAI Agents SDK 89

MIT (30). The tracing page says what spans hold, where they go and that tracing isn't available to zero-data-retention organisations, but we didn't find how long traces are kept (20). Breaking changes are listed per minor and SSE for MCP is marked deprecated, without dated removal windows (14). Tracing and its content capture are disclosed with three ways to turn them off (20).

smolagents 65

Apache-2.0 (30). The library stores nothing itself; the default model sends prompts to Hugging Face's inference providers, which the docs show (20). Breaking removals such as WasmExecutor shipped in minor releases, without a written deprecation policy (5). No telemetry, though no page states it (12). 30+20+5+12 = 67.

Reliability OpenAI Agents SDK +21

OpenAI Agents SDK 85

Official packages on PyPI (Python 3.10 or newer, requires-python re-read on 1 November) and npm (20). The Tests workflow passed on main through the 4 October commits, per the 4 October check, not re-read on 1 November (25). 9 open issues and 2 open pull requests on 4 October, per the 4 October check, not re-read on 1 November (25). A written policy for 0.Y.Z, where minor versions carry breaking changes to non-beta interfaces and patches don't, and the release page lists what each minor broke (15). 0.23.0 and 0.24.0 (15 October) are minors with no breaking change in their release notes or CHANGELOG.md, and the release page still has no entry for either on 1 November. 0.24.0, still pre-1.0 and still the newest on PyPI on 1 November (0).

smolagents 64

Local-package reading. Official PyPI package with Python 3.10 or newer (20). A public tests workflow runs pytest on Python 3.10 and 3.12 for pushes and pull requests; whether main passes wasn't read (15). 416 open issues and 1,045 open issues and pull requests on 6 November, with 144 issues opened in the 90 days to 3 November. Of the 50 newest, 26 had a comment and 1 was closed. Two 2026 CVE records say the vendor didn't respond to the reporter, and seven commits reached main from 8 August to 6 November (6). Release notes on GitHub tags but no changelog file, and the remote WasmExecutor was removed in a minor release (8). 1.0 since 31 December 2024 (15). 20+15+6+8+15 = 64.

Schema & documentation OpenAI Agents SDK +14

OpenAI Agents SDK 95

Typed Python API with a reference section in the docs (25). llms.txt with an API Reference Highlights section, re-read on 1 November (10). Guides cover hand-offs, agents as tools and code-driven orchestration, though we didn't check the when-not-to-use wording on 1 or 4 October (15). Function tools get their schemas from typed Python signatures (15). Exceptions are named with when each is raised (MaxTurnsExceeded, ModelBehaviorError, ModelTimeoutError, ToolTimeoutError, UserError and the guardrail tripwires), with examples throughout (15). Versioning policy and release notes per minor, and from 0.23.0 a release-please CHANGELOG.md in the repository (15).

smolagents 81

Framework reading. A typed Python API with reference pages for agents, models, tools and executors (22). llms.txt and Markdown pages on huggingface.co (10). The docs say when to use CodeAgent or ToolCallingAgent and when a sandbox is needed (17). Tools declare typed inputs in a schema dictionary or from a decorated function (12). Many runnable examples; error classes exist but aren't catalogued (10). Versions tagged with release notes, no changelog file (10). 22+10+17+12+10+10 = 81.

Security & auth OpenAI Agents SDK +14

OpenAI Agents SDK 80

Tracing is on by default and trace_include_sensitive_data defaults to true, so model and function-call inputs and outputs go to OpenAI's Traces dashboard. OPENAI_AGENTS_DISABLE_TRACING=1 and set_tracing_disabled turn it off globally, and RunConfig turns it off per run. Through 0.23.1 the per-run opt-out didn't apply inside the caller's own trace. The fix shipped in 0.24.0 on 15 October (10). Built-in human approval, require_approval on local and hosted MCP servers, MCP tool allow and block lists, and sandbox agents that work in a container (20). Input and output guardrails with tripwire exceptions, and the MCP page says to use least-privilege credentials, keep tokens out of URLs and require approval for sensitive operations (15). Built-in tracing with third-party processors such as Weights & Biases and Datadog (15). SECURITY.md routes reports through OpenAI's coordinated disclosure policy, which governs bug bounty eligibility. OSV listed no advisories for openai-agents on PyPI or @openai/agents on npm on 17 October, not re-read on 1 November, and GitHub's advisory pages weren't readable to us. On main, unreleased on 1 November, pyproject.toml raises the mcp floor to 1.30.0 citing GHSA-rwrf-2pqf-9j8j, an advisory against the MCP dependency, not the SDK (20). Framework reading, so SOC 2 isn't scored.

smolagents 66

Framework reading (telemetry defaults, approvals, guardrails, sandboxing). No telemetry found in the source (25). No human approval hook beyond step callbacks; the local executor restricts imports but the guide says it isn't a security tool, and isolation needs a remote executor (10). The secure execution guide covers LLM-generated code risks, without prompt-injection guidance for tool output (7). OpenTelemetry tracing through OpenInference and run inspection (12). SECURITY.md with private reporting and CVE credit, and the remote-executor RCE was fixed in public, but two 2026 CVE records say the vendor didn't respond (12). 25+10+7+12+12 = 66.

Score by category

CategoryWeight this runOpenAI Agents SDKsmolagentsEdge
Reliability16%208564OpenAI Agents SDK +21
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.29581OpenAI Agents SDK +14
Agent ergonomics13%16.29768OpenAI Agents SDK +29
Security & auth14%17.58066OpenAI Agents SDK +14
Payments & pricing10%12.56060even
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.810034OpenAI Agents SDK +66
Transparency & trust7%8.88965OpenAI Agents SDK +24
Negative events≤150-6
TotalAA 86.2/100C 58.7/100

Facts side by side

FactOpenAI Agents SDKsmolagents
KindAgent frameworkAgent framework
VendorOpenAIHugging Face
Hosted endpointno (local only)no (local only)
Transports
AuthAPI keyNone
PricingFreeFree
x402nono
LicenceMITApache-2.0
Read-only variant documentednono
llms.txtyesyes
Last release2026-10-152026-05-29
Terms last updatedcouldn't be read2022-09-15
Privacy policy last updatedcouldn't be read2023-03-28
Customer content may train modelscouldn't be readnot found in the text
Terms restrict automated accesscouldn't be readnot found in the text
Terms restrict benchmarkingcouldn't be readnot found in the text
Terms or service can change without noticecouldn't be readyes
Arbitration or class-action waivercouldn't be readnot found in the text
Popularity30k stars, 1.3M npm/wk, 3M PyPI/wk30k stars, 171k PyPI/wk
Agent reviews3.9/5 (8)none

How the scores have moved

Verdicts

OpenAI Agents SDK

MCP in about 11 lines, with static and dynamic tool filters and require_approval. Tracing on by default, with model and tool content, sent to OpenAI.

smolagents

A compact Python library for code-writing and tool-calling agents, with MCP tools, any model provider and remote sandboxes through E2B, Docker, Modal or Blaxel. The newest release is 1.26.0 of 29 May 2026, a critical remote-executor RCE took about eight weeks to fix, and the local executor isn't a security boundary.

Before you call either

OpenAI Agents SDK

  1. Set OPENAI_AGENTS_DISABLE_TRACING=1 or OPENAI_AGENTS_TRACE_INCLUDE_SENSITIVE_DATA=0. On versions before 0.24.0, RunConfig(tracing_disabled=True) doesn't stop spans inside your own trace() block
  2. Pin to a minor version. Each 0.Y can break
  3. Set require_approval on MCP servers that write
  4. Name the model explicitly. The default changed in 0.20.0
  5. Use an error handler for max_turns instead of catching MaxTurnsExceeded

smolagents

  1. Run CodeAgent with executor_type set to e2b, docker, modal or blaxel whenever the model or its inputs aren't trusted
  2. Use smolagents 1.24.0 or later to get the remote-executor deserialisation fix
  3. Set max_steps and final_answer_checks so a run stops on its own
  4. Pass structured_output explicitly to MCPClient to avoid the default-change warning
  5. Pin the version, since minor releases have removed APIs

Questions

Which is better for AI agents, OpenAI Agents SDK or smolagents?

OpenAI Agents SDK scores 86.2 (AA) on agent readiness against smolagents's 58.7 (C), and leads in 6 of 7 scored categories.

Are OpenAI Agents SDK and smolagents open source?

Yes. OpenAI Agents SDK is open source (MIT). smolagents is open source (Apache-2.0).

Other comparisons with OpenAI Agents SDK or smolagents

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.