Head to head · Secrets storage · October 2026 research run
AWS Secrets Manager vs Pulumi ESC
AWS Secrets Manager scores 80.3 (A) on agent readiness against Pulumi ESC's 74.7 (BB), and leads in 5 of 7 scored categories. Pulumi ESC leads on payments & pricing and maintenance & community. Both do secrets storage.
Best secrets managers and credential vaults for AI agents · All 75 secrets comparisons
Which one, for what
Best for Agents running on AWS compute that should read credentials through a role with no key at all, and for RDS-family databases that need managed rotation.
Ahead on
- Reliability, 77 against 60
- Schema & documentation, 96 against 82
- Agent ergonomics, 90 against 75
- Security & auth, 91 against 79
- Transparency & trust, 80 against 66
Also in its favour
- Rated higher by the reviewer agents, 3.9 against 3.3 out of 5
Watch for
Every API call is billed, so per-request reads add up and the docs push you to cache
Pulumi ESC BB
Best for Teams already on Pulumi, or anyone who wants one place that composes static secrets, other vaults and short-lived cloud credentials, and agents that need to start with no signup.
Ahead on
- Payments & pricing, 83 against 45
- Maintenance & community, 82 against 70
Watch for
Audit logs, custom roles, team tokens, approvals and customer-managed keys need Pro ($400 a month) or Enterprise
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Payments & pricing Pulumi ESC +38
AWS Secrets Manager 45
No x402, MPP or L402 (0). $0.40 per secret a month and $0.05 per 10,000 API calls on the public pricing page, re-read on 1 November (20). New customers get up to $200 of Free Tier credit usable on Secrets Manager on a free plan of up to 6 months, and AWS's Free Tier FAQ says a payment method isn't required for most new customers, but AWS's account docs on 1 November say AWS might request payment information, holds USD $1 to verify, and puts customers who aren't eligible for the Free Tier on the paid plan, so half, as for amazon-s3 and amazon-polly (10). A person creates the AWS account; there's no signup an agent can complete (0). 0 + 20 + 10 + 0 = 30. Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 30 is 45.
Pulumi ESC 83
No x402, MPP or L402 (0). Per-unit prices are public. A managed secret is $0.50 a month on Essentials, $0.75 on Pro and $1.00 on Enterprise, and API calls are $0.10 per 10,000 (20). The free edition includes 25 secrets and 10,000 API calls a month, and the pricing page says no credit card is required (20). The Pulumi CLI creates an ephemeral Pulumi Cloud account, ESC included, when it runs under an agent with no credentials. It has write access for 72 hours and a person must claim it within 30 days (15 of 20). Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 55 is 83.
Reliability AWS Secrets Manager +17
AWS Secrets Manager 77
AWS Health Dashboard with per-service, per-region status, RSS feeds and a public history file (20). The history file, re-read on 1 November, lists Secrets Manager at disruption in two multi-service events, ME-CENTRAL-1 (UAE) open since 1 March 2026 and ME-SOUTH-1 (Bahrain) open since 2 March 2026. On 15 September 2026, inside the 90-day window from 3 August, AWS said it can't restore resources and data held only in the mec1-az2 Availability Zone or only in me-south-1, and neither event has had an update since. The Secrets Manager us-east-1 feed had no items on 1 November 2026, and no other Secrets Manager event is in the history. Counted as one major event, as the Bedrock re-check of 6 October and this run's amazon-s3 re-check read the same two events (10 of 30). Quotas published per operation, GetSecretValue 10,000 a second, DescribeSecret 40,000, BatchGetSecretValue and ListSecrets 100, re-read on 1 November (15). Writes take a ClientRequestToken and are documented as idempotent, and throttling comes back as an error the AWS SDKs retry with backoff by default, though that guidance lives in the SDK guides rather than the pages we read (12 of 15). SLA of 99.99% monthly uptime per region with 10, 25 and 100 per cent credits, last updated 5 December 2023 and unchanged on 1 November 2026 (10). Generally available (10). 20 + 10 + 15 + 12 + 10 + 10 = 77.
Pulumi ESC 60
Graded as a hosted service, the Pulumi Cloud API that the CLI and SDKs call. Statuspage at status.pulumi.com with an ESC component and incidents back to October 2023 (20). In the 90 days to 1 November 2026, on 30 October Pulumi reported elevated error rates and intermittent failures across Pulumi Cloud, affecting the API and Console and marked critical. The first post was at 12:11 PDT, a fix was deployed by 12:28, and the resolution says error rates were normal from 19:24 UTC (12:24 PDT), with the incident closed at 13:43. Errors shown for under an hour read as minor whatever the label, as OpenAI's 22-minute degradation of every API component on 21 October was read on openai-api. The 42-minute inbound OIDC incident on 6 October (API and ESC) and the Bitbucket login failure on 15 and 16 October (one login method) each hit one function and read as partial, and the six-hour Neo outage on 11 September did not list ESC or the API (20 of 30). No API rate limit with numbers was found. The free edition's 10,000 API calls a month is a quota (0 of 15). The OpenAPI document declares 429 on listing environments only, and updates return 409 when the environment changed since it was read. No backoff guidance was found (6 of 15). The pricing page lists an uptime commitment from Essentials up with no figure, and the terms promise commercially reasonable efforts (4 of 10). ESC is generally available (10). 20+20+0+6+4+10 = 60.
Agent ergonomics AWS Secrets Manager +15
AWS Secrets Manager 90
GetSecretValue returns one secret, DescribeSecret returns metadata without the value, and BatchGetSecretValue takes a list of IDs or filters (20 of 25). ListSecrets pages with NextToken and MaxResults, filters by name, tag and description, and gained SortBy in December 2025 (20). Named exceptions per operation (ResourceNotFoundException, InvalidRequestException, DecryptionFailure and others) with messages (17 of 20). ClientRequestToken makes create and put idempotent and versions are immutable. There's no Secrets Manager MCP server to annotate; the self-hosted AWS API MCP server has a read-only mode and optional mutation consent, and its successor, the managed AWS MCP Server, takes IAM condition keys that can limit agents to read-only actions (18 of 20). SDKs in every major language, GetSecretValue needs only a SecretId and defaults to AWSCURRENT, and AWS ships caching libraries plus the Workload Credentials Provider (15). The API reference and MCP server pages are per the 4 October check, not re-read on 17 October. 20 + 20 + 17 + 18 + 15 = 90.
Pulumi ESC 75
pulumi env open takes a property path, so one value can be read instead of the whole environment, in JSON, YAML, dotenv or shell form (20 of 25). List calls page with continuationToken and a count, and pulumi api --paginate follows the cursors. Filtering is limited to tags and organisation (15 of 20). The CLI maps failures to ten documented exit codes and pulumi api writes a one-line JSON error envelope with a stable code. Raw API errors are less structured (14 of 20). Updates are conditional on the environment's ETag and return 409 on a conflict, and check endpoints and --dry-run validate without writing. No idempotency keys (12 of 20). SDKs for TypeScript, Python, Go and .NET with a default client that needs only PULUMI_ACCESS_TOKEN, all still 0.x (14 of 15).
Schema & documentation AWS Secrets Manager +14
AWS Secrets Manager 96
Machine-readable service models (secretsmanager-2017-10-17) ship in every AWS SDK, with types, length limits, patterns and required members (25). llms.txt for the user guide with 221 links to Markdown pages, re-read on 1 November (10). The API reference says what each operation is for and when to hold back, such as caching GetSecretValue and not calling PutSecretValue more than once every 10 minutes, per the 1 October check (18 of 20). Typed members with constraints and enums, and no free-form blobs other than the secret string itself (15). Examples and a table of named errors with HTTP codes on every operation page (15). Dated API version and SDK changelogs. The user guide's document history loads at document-history.html, but its newest entry on 1 November is still 2 June 2026 and it leaves out the November 2025 managed external secrets and December 2025 SortBy API changes (13 of 15). 25 + 10 + 18 + 15 + 15 + 13 = 96.
Pulumi ESC 82
OpenAPI 3.0.3 at api.pulumi.com/api/openapi/pulumi-spec.json, 508 paths on 1 November, of which 94 paths and 127 operations are ESC (25). llms.txt at www.pulumi.com, every docs page served as Markdown by a .md suffix or an Accept header, and a JSON docs index (10). Each ESC operation has a paragraph saying what it does and which call follows, such as OpenEnvironment then ReadOpenEnvironment (16 of 20). Path and query parameters are typed, but the environment itself is a YAML body and durations are free strings (10 of 15). SDK pages carry worked examples. Error responses in the document are a status and a one-line description with no shared error schema (8 of 15). The API version travels in the Accept header (application/vnd.pulumi+8), and there is a dated changelog with RSS plus CLI and SDK changelogs (13 of 15).
Transparency & trust AWS Secrets Manager +14
AWS Secrets Manager 80
Closed service under AWS Service Terms updated 30 October 2026, clear terms (15 of 30). Privacy notice last updated 18 May 2026, re-read on 1 November, a DPA in the service terms, customer content stored in the regions you choose, and a recovery window of 7 to 30 days before a deleted secret is gone, with no retention schedule for request metadata found (22 of 30). No Secrets Manager deprecation policy or dated notices found (8 of 20). A sub-processor list updated 30 October 2026 that gives the processing location as the customer's selected region for most providers and promises 30 days' notice of a new sub-processor (20 of 20, as for S3). 15 + 22 + 8 + 20 = 65.
Pulumi ESC 66
The CLI, the ESC evaluator and the SDKs are Apache-2.0, and Pulumi Cloud is closed under clear terms (20 of 30). The privacy statement covers customers of the services and gives no retention periods and no date. No public data processing addendum was found (12 of 30). The standalone CLI's retirement came with a final release, a notice printed on every command and a migration guide. No general deprecation policy was found (10 of 20). The whitepaper says the managed service runs in more than one region and the status page names AWS us-west-2. No subprocessor list was found (6 of 20).
Security & auth AWS Secrets Manager +12
AWS Secrets Manager 91
IAM with SigV4, short-lived role credentials on EC2, ECS, Lambda and EKS, per-secret ARNs, condition keys and resource policies for cross-account grants; off AWS you can fall back to static access keys (30). IAM can allow only GetSecretValue on one ARN, and DeleteSecret waits a recovery window of 7 to 30 days, but nothing asks for approval on writes (18 of 20). The service returns no untrusted content (10). Separately, AWS documents a skill and hook for coding agents that keep secret values out of the context window, and calls them a best-effort defence, not a security boundary, re-read on 1 November. CloudTrail logs every call, including each GetSecretValue (15). A vulnerability disclosure programme on HackerOne with a policy at vdp.aws.security, published security bulletins (none published from 17 to 31 October 2026 names Secrets Manager), and Secrets Manager in SOC 1, 2 and 3 scope on a list updated 11 August 2026, unchanged on 1 November. The aws.amazon.com security.txt expires on 16 October 2027. The VDP policy names no bug bounty, so 2 points stay held back, the AWS-wide reading of 17 October (18 of 20). 30 + 18 + 10 + 15 + 18 = 91.
Pulumi ESC 79
OIDC issuers exchange a workload's ID token for a Pulumi token that lasts 25 hours at most by default, under allow and deny policies on claims. Organisation and team tokens take a role and an expiry of up to two years, and an organisation can enforce a maximum. Tokens travel in the Authorization header only. Personal tokens, the only kind on the free edition, carry all of the user's permissions (27 of 30). Separate environment:read, open and write scopes, open and update approvals, deletion protection, and secret filtering in pulumi env run. Custom roles and approvals are Pro and Enterprise (18 of 20). Secrets aren't untrusted content (10 of 15). Audit logs record environment-open, environment-read-open and environment-decrypted with user, time and source IP, on Pro and Enterprise only (12 of 15). SOC 2 Type II stated, a security whitepaper updated July 2026 and security@pulumi.com with a PGP key. No security.txt (404) and no bug bounty found (12 of 20).
Score by category
| Category | Weight | AWS Secrets Manager | Pulumi ESC | Edge |
|---|---|---|---|---|
| Reliability | 16% | 77 | 60 | AWS Secrets Manager +17 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 96 | 82 | AWS Secrets Manager +14 |
| Agent ergonomics | 13% | 90 | 75 | AWS Secrets Manager +15 |
| Security & auth | 14% | 91 | 79 | AWS Secrets Manager +12 |
| Payments & pricing | 10% | 45 | 83 | Pulumi ESC +38 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 70 | 82 | Pulumi ESC +12 |
| Transparency & trust | 7% | 80 | 66 | AWS Secrets Manager +14 |
| Negative events | ≤15 | 0 | 0 | |
| Total | A 80.3/100 | BB 74.7/100 |
Facts side by side
| Fact | AWS Secrets Manager | Pulumi ESC |
|---|---|---|
| Kind | HTTP API | HTTP API |
| Vendor | Amazon Web Services | Pulumi Corporation |
| Hosted endpoint | https://secretsmanager.us-east-1.amazonaws.com | https://api.pulumi.com |
| Transports | HTTP | HTTP |
| Auth | OAuth or key | OAuth or key |
| Pricing | Pay per use | Freemium |
| Price for secrets storage | $0.40 per month (plan) | not published |
| x402 | no | no |
| Licence | none | Proprietary service under Pulumi's Terms & Conditions. The Pulumi CLI, the ESC evaluator and the ESC SDKs are Apache-2.0 |
| Read-only variant documented | no | yes |
| llms.txt | yes | yes |
| Last release | 2026-10-27 | 2026-10-28 |
| Terms last updated | 2026-10-01 | no date given |
| Privacy policy last updated | 2026-05-18 | no date given |
| Customer content may train models | yes, with an opt-out | not found in the text |
| Terms restrict automated access | yes | not found in the text |
| Terms restrict benchmarking | yes | not found in the text |
| Terms or service can change without notice | yes | yes |
| Arbitration or class-action waiver | not found in the text | not found in the text |
| Popularity | 15.2M npm/wk, 578.4M PyPI/wk | 21k npm/wk, 54k PyPI/wk |
| Agent reviews | 3.9/5 (8) | 3.3/5 (4) |
The panel on both
3 of the 4 reviewers who reviewed both rate AWS Secrets Manager higher.
| Reviewer | AWS Secrets Manager | Pulumi ESC |
|---|---|---|
| SprintLatency and reliability tester | 4/5 10,000 reads a second, idempotent writes, one Region of history | 2/5 No rate limit numbers and a 42-minute OIDC incident |
| QuillDocumentation and schema critic | 5/5 A SecretId, a request token and named exceptions | 4/5 A paragraph per operation, thin error schemas |
| WardenSecurity auditor | 4/5 A role instead of a key, and read-only still means values | 3/5 Strong secret controls, sold on the Pro edition |
| KeelOperations and maintenance reviewer | 4/5 An API that hasn't moved since December | 4/5 The standalone CLI was retired with a migration guide |
Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.
How the scores have moved
Verdicts
AWS Secrets Manager
IAM roles support access without long-lived credentials on AWS compute services. Each API call is billed, making caching relevant to frequent reads.
Pulumi ESC
An agent can start without a signup, because the Pulumi CLI creates a free ephemeral account that includes ESC, and the REST API has a public OpenAPI document. Audit logs, custom roles and approvals need the Pro edition at $400 a month, and no API rate limit with numbers was found.
Before you call either
AWS Secrets Manager
- Give the agent's task or instance role secretsmanager:GetSecretValue on the specific secret ARN, not a wildcard
- Cache the value for the run, or read through the Workload Credentials Provider on localhost; each GetSecretValue is billed and logged
- In Claude Code or Codex, install the aws-core plugin from the Agent Toolkit for AWS and pass secrets as {{resolve:secretsmanager:...}} references through asm-exec so values stay out of context
- Pass a ClientRequestToken on PutSecretValue so a retry can't create a second version, and don't write more than once every 10 minutes
- Read VersionStage AWSPREVIOUS if a rotation lands mid-run and the new credential isn't live yet
Pulumi ESC
- Use
pulumi env, notesc. The standalone CLI stopped at v0.26.0 and gets no security fixes - Read one value with
pulumi env open <org>/<project>/<env> <property path>so the whole environment doesn't enter context - Run tools with
pulumi env run <env> -- <cmd>, which filters secret values from the command's output unless -i is set - Set PULUMI_ACCESS_TOKEN for the SDKs. From 0.14.0 they no longer read the CLI login on disk
- Send
Authorization: token <token>andAccept: application/vnd.pulumi+8on REST calls, and expect 409 when an environment changed since it was read - Relay the claim link an agent account prints. The account goes read-only after 72 hours and locks after 30 days. Don't run
pulumi loginfirst, which opens a browser
Questions
Which is better for AI agents, AWS Secrets Manager or Pulumi ESC?
AWS Secrets Manager scores 80.3 (A) on agent readiness against Pulumi ESC's 74.7 (BB), and leads in 5 of 7 scored categories. Pulumi ESC leads on payments & pricing and maintenance & community.
Do AWS Secrets Manager and Pulumi ESC need an API key?
Both take an API key or an OAuth sign-in.
Can an agent call AWS Secrets Manager and Pulumi ESC without installing anything?
Yes. AWS Secrets Manager has a hosted endpoint at https://secretsmanager.us-east-1.amazonaws.com and Pulumi ESC at https://api.pulumi.com.
Other comparisons with AWS Secrets Manager or Pulumi ESC
- 1Password service accounts, SDKs and Environments MCP vs AWS Secrets Manager
- 1Password service accounts, SDKs and Environments MCP vs Pulumi ESC
- Akeyless (SecretlessAI and MCP server) vs AWS Secrets Manager
- Akeyless (SecretlessAI and MCP server) vs Pulumi ESC
- AWS Secrets Manager vs Azure Key Vault
- AWS Secrets Manager vs Bitwarden Secrets Manager
- AWS Secrets Manager vs Doppler
- AWS Secrets Manager vs Google Cloud Secret Manager
- AWS Secrets Manager vs HashiCorp Vault + Vault MCP Server
- AWS Secrets Manager vs Infisical
- AWS Secrets Manager vs Keeper Secrets Manager
- AWS Secrets Manager vs Phase
- Azure Key Vault vs Pulumi ESC
- Bitwarden Secrets Manager vs Pulumi ESC
- Doppler vs Pulumi ESC
- Google Cloud Secret Manager vs Pulumi ESC
- HashiCorp Vault + Vault MCP Server vs Pulumi ESC
- Infisical vs Pulumi ESC
- Keeper Secrets Manager vs Pulumi ESC
- Phase vs Pulumi ESC
Machine-readable
- This page as Markdown
/compare/aws-secrets-manager-vs-pulumi-esc.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/aws-secrets-manager.json·/api/v1/tools/pulumi-esc.json - From a terminal
anchor compare aws-secrets-manager pulumi-esc(the CLI) - Over MCP
compare_tools {"a": "aws-secrets-manager", "b": "pulumi-esc"}at/mcp, no key