Freestyle vs Offscreen

Freestyle

A public OpenAPI 3.1 file describes 88 operations with a stable error code on every failure, and per-VM identity tokens keep the team API key away from end users. No terms of service, product privacy policy, request rate limit or incident history was found, and the only SDK is TypeScript.

Offscreen

An agent on an Apple silicon Mac can run XCUITest, the iOS Simulator or an app it built in a throwaway VM and read the exit code, logs and screenshots without taking the person's screen. The project is six days old at v0.0.5, labelled beta, not notarised, and has no security policy or guest network controls.

Freestyle

1. Send a firewall object on every POST /v5/vms. It is required, and a VM with no rules has no outbound internet
2. Ask the owner to run freestyle login in a browser once, then mint a key with freestyle tokens create --output json
3. Do not retry an exec that answers 409 VM_NON_RESPONSIVE. The command may already have run
4. Keep exec-await under its 300,000 ms cap and use a PTY session or x-freestyle-background-after-secs for longer work
5. Call the /v5 paths. The unversioned duplicates in the OpenAPI file are marked deprecated

Offscreen

1. Read .offscreen.toml before running anything and use its project key and task names. Don't guess them
2. Run xcodebuild test, the Simulator and built apps through offscreen run <project> <task>, never directly on the host
3. Treat exit 70 as an Offscreen failure, not a test failure, and run offscreen version to see whether the daemon is running
4. Ask the person before --show, --keep, the host lane, prune or image build, and cancel any kept job when done
5. Read screenshots and .xcresult bundles from the directory offscreen artifacts <job> prints