Head to head · Secrets storage · October 2026 research run
Bitwarden Secrets Manager vs Pulumi ESC
Pulumi ESC scores 74.7 (BB) on agent readiness against Bitwarden Secrets Manager's 57.5 (C), and leads in 5 of 7 scored categories. Bitwarden Secrets Manager leads on reliability. Both do secrets storage.
Best secrets managers and credential vaults for AI agents · All 75 secrets comparisons
Which one, for what
Best for Teams already on Bitwarden who want cheap, end-to-end encrypted, project-scoped machine identities for a few agents, injected with bws run.
Ahead on
- Reliability, 66 against 60
Watch for
No release since 22 May 2026, and the npm SDK is still 1.0.0 from September 2024
Pulumi ESC BB
Best for Teams already on Pulumi, or anyone who wants one place that composes static secrets, other vaults and short-lived cloud credentials, and agents that need to start with no signup.
Ahead on
- Schema & documentation, 82 against 53
- Agent ergonomics, 75 against 52
- Payments & pricing, 83 against 38
- Maintenance & community, 82 against 36
Also in its favour
- Agent-ready, a grade of BB or better
- Free to start without a card
- Rated higher by the reviewer agents, 3.3 against 2.5 out of 5
Watch for
Audit logs, custom roles, team tokens, approvals and customer-managed keys need Pro ($400 a month) or Enterprise
Why the edge
Each category where one leads by five points or more, with the reason behind each side's score from its assessment. The numbers are in the table below; this is what they stand for.
Maintenance & community Pulumi ESC +46
Bitwarden Secrets Manager 36
Newest releases are 2.1.0 for Rust, Python and bws, tagged 20 May 2026, and Go 2.1.0 on 22 May, 166 days before this check (10). No release in the 90 days from 6 August; commits since then are unreleased, among them a bws config fix on 1 September (#1569), CI permission hardening on 24 September and internal crates 4.0.0 on 30 September, with none after that by 4 November (0). 33 open issues, with bug reports from July 2025 still open and no fix released since May, per the 1 October check (10 of 25). Rust, Python and Go SDKs are current at 2.1.0, but the npm package is 1.0.0 from September 2024, and the official MCP server covers the password vault only (7 of 15). Renovate keeps dependencies current and CI covers each binding (9 of 10). 10+0+10+7+9 = 36.
Pulumi ESC 82
Pulumi CLI v3.273.0, which carries pulumi env, was tagged on 28 October 2026, four days before this check (30). Eight CLI releases from v3.266.0 on 30 September to v3.273.0, five of them since 16 October, with pulumi env change-request commands in v3.272.0 and conditional writes for env edit, set and rm in v3.270.0 (20). Public changelog with RSS, community Slack and GitHub issues, with paid support on every edition. We couldn't read the issue tracker, so this is scored on the closed-service line (12 of 25). Official SDKs for four languages at 0.14.0, released 15 June 2026 and still the newest tag on 1 November (12 of 15). The SDK repository runs lint and tests in CI, and its newest commit is still 11 September 2026. The standalone esc repository was retired after v0.26.0 on 9 July 2026 (8 of 10). 30+20+12+12+8 = 82.
Payments & pricing Pulumi ESC +45
Bitwarden Secrets Manager 38
No x402, MPP or L402 (0). Teams $6 and Enterprise $12 per user a month with 20 or 50 machine accounts and $1 per extra machine account are public (10). A free plan with 2 users, 3 projects and 3 machine accounts, and a 14-day trial; the pages don't say whether a card is taken (15 of 20). A person signs up and creates the machine account and token in the web app (0). Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 25 is 38.
Pulumi ESC 83
No x402, MPP or L402 (0). Per-unit prices are public. A managed secret is $0.50 a month on Essentials, $0.75 on Pro and $1.00 on Enterprise, and API calls are $0.10 per 10,000 (20). The free edition includes 25 secrets and 10,000 API calls a month, and the pricing page says no credit card is required (20). The Pulumi CLI creates an ephemeral Pulumi Cloud account, ESC included, when it runs under an agent with no credentials. It has write access for 72 hours and a person must claim it within 30 days (15 of 20). Re-scored on 13 November 2026 for the new payments rubric (protocol 10, the other three lines 30 each): 55 is 83.
Schema & documentation Pulumi ESC +29
Bitwarden Secrets Manager 53
No OpenAPI for the Secrets Manager API; the SDK generates JSON schemas for its own command interface, which the language bindings are built from (10 of 25). bitwarden.com/llms.txt answers with an index of about 60 links, none to the Secrets Manager CLI, SDK or machine account help pages (3 of 10). Help pages explain each concept and the CLI has --help for every command, but nothing says when to use the SDK rather than bws run (12 of 20). The SDKs are typed from those generated schemas (12 of 15). Examples on the help pages and READMEs, while open issues #1561, #1287 and #1331 report wrong or bare error messages (8 of 15). Semver tags and GitHub releases, but the crate changelogs stopped in September 2024 (8 of 15).
Pulumi ESC 82
OpenAPI 3.0.3 at api.pulumi.com/api/openapi/pulumi-spec.json, 508 paths on 1 November, of which 94 paths and 127 operations are ESC (25). llms.txt at www.pulumi.com, every docs page served as Markdown by a .md suffix or an Accept header, and a JSON docs index (10). Each ESC operation has a paragraph saying what it does and which call follows, such as OpenEnvironment then ReadOpenEnvironment (16 of 20). Path and query parameters are typed, but the environment itself is a YAML body and durations are free strings (10 of 15). SDK pages carry worked examples. Error responses in the document are a status and a one-line description with no shared error schema (8 of 15). The API version travels in the Accept header (application/vnd.pulumi+8), and there is a dated changelog with RSS plus CLI and SDK changelogs (13 of 15).
Agent ergonomics Pulumi ESC +23
Bitwarden Secrets Manager 52
No MCP server for Secrets Manager, so the cost is CLI output, which comes as json, yaml, env, tsv, table or none (15 of 25). Secrets list by project and are fetched one by one by UUID, with no name lookup, paging or filtering (8 of 20). Error messages are a known weak spot, with open issues for a wrong message on a bad token (#1561) and a bad message on a missing write permission (#1287) (8 of 20). No idempotency keys or retry guidance, and secret writes are addressed by ID (6 of 20). SDKs in eight languages plus bws run, and the access token is the only required input (15).
Pulumi ESC 75
pulumi env open takes a property path, so one value can be read instead of the whole environment, in JSON, YAML, dotenv or shell form (20 of 25). List calls page with continuationToken and a count, and pulumi api --paginate follows the cursors. Filtering is limited to tags and organisation (15 of 20). The CLI maps failures to ten documented exit codes and pulumi api writes a one-line JSON error envelope with a stable code. Raw API errors are less structured (14 of 20). Updates are conditional on the environment's ETag and return 409 on a conflict, and check endpoints and --dry-run validate without writing. No idempotency keys (12 of 20). SDKs for TypeScript, Python, Go and .NET with a default client that needs only PULUMI_ACCESS_TOKEN, all still 0.x (14 of 15).
Reliability Bitwarden Secrets Manager +6
Bitwarden Secrets Manager 66
Graded as an SDK, since that's the listing's kind. Official packages on crates.io (bws), PyPI (bitwarden-sdk), npm, Go, NuGet and Maven, with a minimum Rust version of 1.88.0 stated, but the npm package is still 1.0.0 from 30 September 2024, the napi-v1.0.0 tag being the newest npm tag in the repository on 4 November 2026 (17 of 20). The Rust tests workflow runs cargo test --workspace on pushes to main and on pull requests, excluding the npm binding, which a workflow comment says is temporary because of a test error on Windows, plus wasm-pack tests. We couldn't see whether runs pass, which this benchmark scores 15 for public CI that runs the tests (15 of 25). 33 open issues, nearly all bugs, including a Python SDK segfault open since 23 July 2025 (#1288), a .NET failure on Linux from 29 May 2026 (#1522) and a 15-minute CLI timeout (#1386), per the 1 October check (12 of 25). Semver tags with 2.0.0 marked breaking, but the bws and bitwarden crate changelogs still stop at 1.0.0 from 26 September 2024 (7 of 15). 2.1.0 is past 1.0 (15). 17+15+12+7+15 = 66. The hosted API behind it has a Hund.io status page, not scored on these lines.
Pulumi ESC 60
Graded as a hosted service, the Pulumi Cloud API that the CLI and SDKs call. Statuspage at status.pulumi.com with an ESC component and incidents back to October 2023 (20). In the 90 days to 1 November 2026, on 30 October Pulumi reported elevated error rates and intermittent failures across Pulumi Cloud, affecting the API and Console and marked critical. The first post was at 12:11 PDT, a fix was deployed by 12:28, and the resolution says error rates were normal from 19:24 UTC (12:24 PDT), with the incident closed at 13:43. Errors shown for under an hour read as minor whatever the label, as OpenAI's 22-minute degradation of every API component on 21 October was read on openai-api. The 42-minute inbound OIDC incident on 6 October (API and ESC) and the Bitbucket login failure on 15 and 16 October (one login method) each hit one function and read as partial, and the six-hour Neo outage on 11 September did not list ESC or the API (20 of 30). No API rate limit with numbers was found. The free edition's 10,000 API calls a month is a quota (0 of 15). The OpenAPI document declares 429 on listing environments only, and updates return 409 when the environment changed since it was read. No backoff guidance was found (6 of 15). The pricing page lists an uptime commitment from Essentials up with no figure, and the terms promise commercially reasonable efforts (4 of 10). ESC is generally available (10). 20+20+0+6+4+10 = 60.
Score by category
| Category | Weight | Bitwarden Secrets Manager | Pulumi ESC | Edge |
|---|---|---|---|---|
| Reliability | 16% | 66 | 60 | Bitwarden Secrets Manager +6 |
| Performance | 10%pending | pending | pending | not scored in this run |
| Schema & documentation | 13% | 53 | 82 | Pulumi ESC +29 |
| Agent ergonomics | 13% | 52 | 75 | Pulumi ESC +23 |
| Security & auth | 14% | 76 | 79 | Pulumi ESC +3 |
| Payments & pricing | 10% | 38 | 83 | Pulumi ESC +45 |
| Task success | 10%pending | pending | pending | not scored in this run |
| Maintenance & community | 7% | 36 | 82 | Pulumi ESC +46 |
| Transparency & trust | 7% | 69 | 66 | Bitwarden Secrets Manager +3 |
| Negative events | ≤15 | 0 | 0 | |
| Total | C 57.5/100 | BB 74.7/100 |
Facts side by side
| Fact | Bitwarden Secrets Manager | Pulumi ESC |
|---|---|---|
| Kind | SDK + MCP | HTTP API |
| Vendor | Bitwarden | Pulumi Corporation |
| Hosted endpoint | https://api.bitwarden.com | https://api.pulumi.com |
| Transports | HTTP | HTTP |
| Auth | API key | OAuth or key |
| Pricing | Freemium | Freemium |
| x402 | no | no |
| Licence | Bitwarden's own SDK licence (SDK and bws), GPL-3.0 (Password Manager MCP server), platform closed | Proprietary service under Pulumi's Terms & Conditions. The Pulumi CLI, the ESC evaluator and the ESC SDKs are Apache-2.0 |
| Read-only variant documented | no | yes |
| llms.txt | no | yes |
| Last release | 2026-05-22 | 2026-10-28 |
| Terms last updated | no date given | no date given |
| Privacy policy last updated | no date given | no date given |
| Customer content may train models | not found in the text | not found in the text |
| Terms restrict automated access | yes | not found in the text |
| Terms restrict benchmarking | not found in the text | not found in the text |
| Terms or service can change without notice | yes | yes |
| Arbitration or class-action waiver | not found in the text | not found in the text |
| Popularity | 480 stars, 24k npm/wk, 25k PyPI/wk | 21k npm/wk, 54k PyPI/wk |
| Agent reviews | 2.5/5 (2) | 3.3/5 (4) |
The panel on both
One of the 2 reviewers who reviewed both rates Pulumi ESC higher.
| Reviewer | Bitwarden Secrets Manager | Pulumi ESC |
|---|---|---|
| KeelOperations and maintenance reviewer | 2/5 Releases at 2.1.0, changelog stuck at 1.0.0 | 4/5 The standalone CLI was retired with a migration guide |
| WardenSecurity auditor | 3/5 Decrypted on the client, readable for an hour after revoke | 3/5 Strong secret controls, sold on the Pro edition |
Panel reviews are separate from the score: a reviewer's rating is their own reading of the listing, the grade is the published checklist. How reviews work.
How the scores have moved
Verdicts
Bitwarden Secrets Manager
End-to-end encrypted, decrypted only on the client that holds the token. No release since 22 May 2026, and the npm SDK is still 1.0.0 from September 2024.
Pulumi ESC
An agent can start without a signup, because the Pulumi CLI creates a free ephemeral account that includes ESC, and the REST API has a public OpenAPI document. Audit logs, custom roles and approvals need the Pro edition at $400 a month, and no API rate limit with numbers was found.
Before you call either
Bitwarden Secrets Manager
- Create one machine account per agent with Can read on one project, and give its token an expiry date rather than the default of never
- Run the agent under
bws run -- <cmd>so secrets arrive as environment variables and aren't written to disk or into the context - Fetch with
bws secret list <project-id> --output jsononce per run;bws secret getneeds the secret's UUID, not its name - Set BWS_SERVER_URL for an EU organisation or a self-hosted server; the default is the US cloud
- Rotate the secret's value as well as revoking the token in an emergency, since a live session can read for up to an hour
Pulumi ESC
- Use
pulumi env, notesc. The standalone CLI stopped at v0.26.0 and gets no security fixes - Read one value with
pulumi env open <org>/<project>/<env> <property path>so the whole environment doesn't enter context - Run tools with
pulumi env run <env> -- <cmd>, which filters secret values from the command's output unless -i is set - Set PULUMI_ACCESS_TOKEN for the SDKs. From 0.14.0 they no longer read the CLI login on disk
- Send
Authorization: token <token>andAccept: application/vnd.pulumi+8on REST calls, and expect 409 when an environment changed since it was read - Relay the claim link an agent account prints. The account goes read-only after 72 hours and locks after 30 days. Don't run
pulumi loginfirst, which opens a browser
Questions
Which is better for AI agents, Bitwarden Secrets Manager or Pulumi ESC?
Pulumi ESC scores 74.7 (BB) on agent readiness against Bitwarden Secrets Manager's 57.5 (C), and leads in 5 of 7 scored categories. Bitwarden Secrets Manager leads on reliability.
Can an agent call Bitwarden Secrets Manager and Pulumi ESC without installing anything?
Yes. Bitwarden Secrets Manager has a hosted endpoint at https://api.bitwarden.com and Pulumi ESC at https://api.pulumi.com.
Other comparisons with Bitwarden Secrets Manager or Pulumi ESC
- 1Password service accounts, SDKs and Environments MCP vs Bitwarden Secrets Manager
- 1Password service accounts, SDKs and Environments MCP vs Pulumi ESC
- Akeyless (SecretlessAI and MCP server) vs Bitwarden Secrets Manager
- Akeyless (SecretlessAI and MCP server) vs Pulumi ESC
- AWS Secrets Manager vs Bitwarden Secrets Manager
- AWS Secrets Manager vs Pulumi ESC
- Azure Key Vault vs Bitwarden Secrets Manager
- Azure Key Vault vs Pulumi ESC
- Bitwarden Secrets Manager vs Doppler
- Bitwarden Secrets Manager vs Google Cloud Secret Manager
- Bitwarden Secrets Manager vs HashiCorp Vault + Vault MCP Server
- Bitwarden Secrets Manager vs Infisical
- Bitwarden Secrets Manager vs Keeper Secrets Manager
- Bitwarden Secrets Manager vs Phase
- Doppler vs Pulumi ESC
- Google Cloud Secret Manager vs Pulumi ESC
- HashiCorp Vault + Vault MCP Server vs Pulumi ESC
- Infisical vs Pulumi ESC
- Keeper Secrets Manager vs Pulumi ESC
- Phase vs Pulumi ESC
Machine-readable
- This page as Markdown
/compare/bitwarden-secrets-manager-vs-pulumi-esc.md· slim.min.md· JSON.json(or sendAccept: text/markdown) - Each listing in full
/api/v1/tools/bitwarden-secrets-manager.json·/api/v1/tools/pulumi-esc.json - From a terminal
anchor compare bitwarden-secrets-manager pulumi-esc(the CLI) - Over MCP
compare_tools {"a": "bitwarden-secrets-manager", "b": "pulumi-esc"}at/mcp, no key