CoreWeave vs Hugging Face Inference Endpoints

CoreWeave

Per-hour prices for 8-GPU H100, H200 and B200 nodes are public, the docs ship as Markdown with llms.txt and embedded OpenAPI specs, and IAM has read-only roles per service. An organisation must be approved by CoreWeave's sales team before any token exists, and no request rate limits were found in the reviewed documentation.

Hugging Face Inference Endpoints

OAuth scopes separate reading endpoints from writing them, both OpenAPI documents are public, and the unauthenticated /v2/provider route lists every instance with its hourly price. An account needs a payment method and credits before the first deployment, no rate limits or SLA were found for the management API, and the docs price table disagrees with the live list in places.

CoreWeave

1. Create an API access token at console.coreweave.com/tokens with an expiry and send it as Authorization: Bearer to https://api.coreweave.com
2. Add GPUs by applying a NodePool resource (compute.coreweave.com/v1alpha1) to a CKS cluster with instanceType and targetNodes. instanceType can't be changed afterwards
3. Set targetNodes to 0 or delete the Node Pool when a job ends. Nodes are whole 8-GPU machines billed by the hour
4. Never pass dry_run to the MCP tool coreweave_kubectl_apply expecting a preview. The reference says the parameter is ignored and the manifest is applied
5. Use a separate Forge API key and https://api.inference.wandb.ai/v1 for Serverless Inference. A CoreWeave API access token doesn't work there

Hugging Face Inference Endpoints

1. Call GET https://api.endpoints.huggingface.cloud/v2/provider first and pick an instance whose status is available. The docs table lists types the API marks deprecated or not available
2. Send X-Scale-Up-Timeout: 600 on requests to an endpoint that scales to zero, or handle 503 while the first replica starts
3. Set scaleToZeroTimeout yourself. The docs give a default of 1 hour and the OpenAPI document says 15 minutes
4. Pause or delete an endpoint when the job is done. Billing covers every minute a replica is initialising or running
5. Give the agent a fine-grained token or the read-endpoints scope unless it must deploy. Endpoints are private by default and take the same Hugging Face token as a bearer