Head to head · Secrets store · October 2026 research run

Keeper Secrets Manager vs Pulumi ESC

Pulumi ESC scores 71.1 (BB) on agent readiness against Keeper Secrets Manager's 69.4 (B), and leads in 3 of 7 scored categories. Keeper Secrets Manager leads on reliability, security & auth, maintenance & community and transparency & trust. Both do secrets store.

Which one, for what

Keeper Secrets Manager B

Good for Companies already on Keeper's business vault that want per-device machine identities with client-side decryption and an official MCP server.

Ahead on

  • Reliability, 76 against 60
  • Security & auth, 86 against 79
  • Maintenance & community, 92 against 82
  • Transparency & trust, 78 against 65

Also in its favour

  • Runs on your own machine

Watch for

Secrets Manager is priced by quote. The add-ons page shows Custom Pricing and Request a Quote

Pulumi ESC BB

Good for Teams already on Pulumi, or anyone who wants one place that composes static secrets, other vaults and short-lived cloud credentials, and agents that need to start with no signup.

Ahead on

  • Schema & documentation, 82 against 71
  • Agent ergonomics, 75 against 63
  • Payments & pricing, 55 against 20

Also in its favour

  • Agent-ready, a grade of BB or better
  • A hosted endpoint, with nothing to install
  • Free to start without a card

Watch for

Audit logs, custom roles, team tokens, approvals and customer-managed keys need Pro ($400 a month) or Enterprise

Score by category

CategoryWeight this runKeeper Secrets ManagerPulumi ESCEdge
Reliability16%207660Keeper Secrets Manager +16
Performance10%pendingpendingpendingnot scored in this run
Schema & documentation13%16.27182Pulumi ESC +11
Agent ergonomics13%16.26375Pulumi ESC +12
Security & auth14%17.58679Keeper Secrets Manager +7
Payments & pricing10%12.52055Pulumi ESC +35
Task success10%pendingpendingpendingnot scored in this run
Maintenance & community7%8.89282Keeper Secrets Manager +10
Transparency & trust7%8.87865Keeper Secrets Manager +13
Negative events≤1500
Total69.4 · B71.1 · BB

Facts side by side

FactKeeper Secrets ManagerPulumi ESC
KindHTTP APIHTTP API
VendorKeeper Security, Inc.Pulumi Corporation
Hosted endpointno (local only)https://api.pulumi.com
TransportsHTTP, stdioHTTP
AuthAPI keyOAuth or key
PricingPaidFreemium
x402nono
LicenceProprietary service under Keeper's SaaS Terms of Use. The SDKs, CLI, MCP server and agent kit on GitHub are MITProprietary service under Pulumi's Terms & Conditions. The Pulumi CLI, the ESC evaluator and the ESC SDKs are Apache-2.0
Tools exposed19none
Read-only variant documentedyesyes
llms.txtyesyes
Last release2026-10-062026-10-07
Terms last updatedno date givenno date given
Privacy policy last updatedno date givenno date given
Customer content may train modelsnot found in the textnot found in the text
Terms restrict automated accessnot found in the textnot found in the text
Terms restrict benchmarkingnot found in the textnot found in the text
Terms or service can change without noticenot found in the textyes
Arbitration or class-action waiveryesnot found in the text
Popularity117 stars, 52k npm/wk, 45k PyPI/wk21k npm/wk, 54k PyPI/wk

Verdicts

Keeper Secrets Manager

Each client device signs requests with its own key, is locked to an IP address by default and can be revoked alone, and secrets decrypt only on the client. The add-on has no public price, no request limits were found in the reviewed documentation, and a person must create the application and device in the vault.

Pulumi ESC

An agent can start without a signup, because the Pulumi CLI creates a free ephemeral account that includes ESC, and the REST API has a public OpenAPI document. Audit logs, custom roles and approvals need the Pro edition at $400 a month, and no API rate limit was found in the reviewed documentation.

Before you call either

Keeper Secrets Manager

  1. Ask the vault owner for a new device on an application that holds only the folders the task needs. Use the Base64 configuration, not the first one-time token
  2. Run commands under ksm exec so secrets arrive as environment variables and stay out of the model's context
  3. Expect HTTP 403 with {"error":"throttled"} under load. The Python SDK retries five times from 11 seconds, so allow for long waits
  4. A device is locked to the IP address it first connects from unless it was created with --unlock-ip. Check this before running from a dynamic address
  5. Leave --auto-approve off on the MCP server. It removes confirmation for deletes and for unmasking values

Pulumi ESC

  1. Use pulumi env, not esc. The standalone CLI stopped at v0.26.0 and gets no security fixes
  2. Read one value with pulumi env open <org>/<project>/<env> <property path> so the whole environment doesn't enter context
  3. Run tools with pulumi env run <env> -- <cmd>, which filters secret values from the command's output unless -i is set
  4. Set PULUMI_ACCESS_TOKEN for the SDKs. From 0.14.0 they no longer read the CLI login on disk
  5. Send Authorization: token <token> and Accept: application/vnd.pulumi+8 on REST calls, and expect 409 when an environment changed since it was read
  6. Relay the claim link an agent account prints. The account goes read-only after 72 hours and locks after 30 days unclaimed

Questions

Which is better for AI agents, Keeper Secrets Manager or Pulumi ESC?

Pulumi ESC scores 71.1 (BB) on agent readiness against Keeper Secrets Manager's 69.4 (B), and leads in 3 of 7 scored categories. Keeper Secrets Manager leads on reliability, security & auth, maintenance & community and transparency & trust.

Do Keeper Secrets Manager and Pulumi ESC need an API key?

Keeper Secrets Manager needs an API key. Pulumi ESC takes an API key or an OAuth sign-in.

Can an agent call Keeper Secrets Manager and Pulumi ESC without installing anything?

Keeper Secrets Manager runs on your own machine, with no hosted endpoint listed. Pulumi ESC has a hosted endpoint at https://api.pulumi.com.

Other comparisons with Keeper Secrets Manager or Pulumi ESC

Machine-readable

For companies

Do agents find, use and choose your tools?

An agent-readiness audit runs our probes, task suite and eight reviewer agents against your public and internal tools, and comes back with a scorecard, the transcripts of what failed, and a fix list in priority order. From $2,500, re-run included. We never take payment to move a rank. We do help companies earn one.