{ "data": { "a": { "slug": "lemonade", "name": "Lemonade", "vendor": "AMD and the Lemonade community", "vendorUrl": "https://lemonade-server.ai", "kind": "http-api", "category": "local-ai", "summary": "Open-source local AI server from AMD and community contributors. It runs text, speech and image models on the owner's CPU, GPU or NPU behind OpenAI-, Anthropic- and Ollama-compatible APIs and an MCP endpoint on port 13305.", "url": "https://www.anchorterminal.com/tools/lemonade", "markdownUrl": "https://www.anchorterminal.com/tools/lemonade.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/lemonade.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/lemonade.json", "repo": "https://github.com/lemonade-sdk/lemonade", "license": "Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence", "transports": [ "http" ], "packages": [ { "registry": "oci", "name": "ghcr.io/lemonade-sdk/lemonade-server" } ], "auth": "api-key", "authNotes": "Off by default. With no key set, every endpoint answers without authentication, on a default bind of localhost. `LEMONADE_API_KEY` sets one bearer key for the regular API (`/api/*`, `/v0/*`, `/v1/*`, `/mcp` and `/metrics`). `LEMONADE_ADMIN_API_KEY` sets a second key for the internal control endpoints (`/internal/*`), and without it the regular key reaches those too. Both are environment variables, so there are no per-user keys. The docs tell WebSocket clients to pass `?api_key=KEY` in the URL.", "pricing": "free", "pricingNotes": "Free and Apache 2.0 with nothing to buy and no account. You run it on your own hardware. Cloud Offload, which is optional and experimental, bills through the owner's own keys at whichever cloud provider they add.", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs or the source (checked 2026-10-08).", "endpoints": [] }, "toolCount": 6, "popularity": { "githubStars": 5800, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-08" }, "docsUrl": "https://lemonade-server.ai/docs/", "capabilities": [ "inference.local", "inference.open-weights", "embed.text", "rerank", "speech.stt", "speech.tts", "image.generate" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "openai-compatible", "mcp", "streaming", "open-weights", "amd", "npu", "docker" ], "lastRelease": "2026-10-07", "graded": true, "anchor": { "graded": true, "score": 63.8, "grade": "B", "agentReady": false, "rank": 336, "ranked": true, "rankOf": 842, "categoryRank": 2, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 70, "maintenance": 76, "payments": 60, "reliability": 75, "schema": 70, "security": 36, "transparency": 64 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-08" }, "negative": 0, "verdict": "Apache 2.0, with weekly releases, installers for Windows, macOS and five Linux routes, and a six-tool MCP endpoint whose descriptions steer a caller away from accidental multi-gigabyte downloads. Authentication is off by default, the repository has no security policy, and the docs tell WebSocket clients to pass the key in the URL.", "bestFor": "An owner with AMD hardware (Ryzen AI NPUs, Radeon or Strix Halo) who wants one local server for chat, speech and images that existing OpenAI, Anthropic or Ollama clients can call, and for MCP clients that want local models as tools.", "strengths": [ "Apache 2.0, with OpenAI, Anthropic Messages, Ollama and llama.cpp-compatible routes on one port (13305)", "`POST /mcp` exposes six tools over Streamable HTTP, and omitting `model` reuses a loaded or downloaded model before any download", "Every running server returns its own Markdown API reference at `GET /v1/docs` and through the `lemonade_docs` tool, so it matches the installed version", "Stable release v2026.41.1 on 7 October 2026 on a weekly cadence, each with a Breaking Changes section in its notes", "Telemetry is off by default and exports OTLP traces only to an endpoint the operator sets, with switches to redact prompts and outputs" ], "weaknesses": [ "No authentication by default. With no key set, every route answers, including `/internal/*` shutdown and configuration", "GitHub reports no `SECURITY.md`, and we found no security.txt, advisory or disclosure address", "The docs tell WebSocket clients to send the key as `?api_key=KEY` in the URL", "No OpenAPI file in the repository, and no `readOnlyHint` or `destructiveHint` on the MCP tools", "The main build and test workflow's badge read failing on main on 8 October 2026, with 411 issues open" ], "agentNotes": [ "Call `lemonade_list_models` (or `GET /v1/models`) before naming a model. A wrong name with `allow_download: true` can start a multi-gigabyte download", "Send `Authorization: Bearer \u003ckey\u003e` when the operator has set `LEMONADE_API_KEY`. `/internal/*` needs the admin key when one is set", "Use `POST /v1/chat/completions` for streamed tokens, embeddings and speech. The MCP endpoint ignores `stream` and has no embeddings or text-to-speech tool", "Pass `output_dir` to `lemonade_generate_image` and `lemonade_omni` to get file paths in place of inline base64. Writes stay inside the MCP media sandbox", "Read `GET /v1/docs` on the running server for the reference that matches its version. Weekly releases change behaviour" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "B", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 63.8 } ], "editorialScores": { "ergonomics": 70, "maintenance": 76, "payments": 60, "reliability": 75, "schema": 70, "security": 36, "transparency": 70 }, "provenanceScore": 57 }, "connect": { "install": "winget install --id AMD.LemonadeServer -e", "http": "curl http://localhost:13305/api/v1/chat/completions -H \"Content-Type: application/json\" -d '{\"model\": \"your-model-name\", \"messages\": [{\"role\": \"user\", \"content\": \"Hello\"}]}'", "claudeCode": "lemonade launch claude" }, "letme": { "capability": "https://letme.dev/inference.local", "tool": "https://letme.dev/lemonade" }, "area": "models", "provenance": { "legalEntity": "Advanced Micro Devices, Inc.", "domain": "lemonade-server.ai", "domainRegistered": "2025-05-12", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/lemonade-sdk/lemonade/releases", "securityTxt": "none", "checked": "2026-10-08", "notes": [ "The website footer reads \"© 2026 AMD. Licensed under Apache 2.0\", and `contrib/debian/copyright` in the repository names Advanced Micro Devices, Inc. The code lives in the lemonade-sdk organisation on GitHub, and the README calls it a community project with optimisations by AMD engineers.", "We found no terms of service and no privacy policy for the software or the website. The home page and its footer link to neither, so both fields are empty.", "lemonade-server.ai/.well-known/security.txt, /security.txt and /llms.txt return 404.", "RDAP gives a registration date of 2025-05-12 for lemonade-server.ai, with Porkbun LLC as registrar and the registrant behind a privacy service.", "There's no hosted endpoint. Each instance answers on the owner's own machine, by default localhost port 13305." ], "score": 57 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/lemonade.json" }, "answer": "Lemonade scores 63.8 (B) on agent readiness against Underdog's 29.5 (F), and leads in 6 of 7 scored categories.", "b": { "slug": "underdog", "name": "Underdog", "vendor": "Conway Research", "vendorUrl": "https://underdog.ai", "kind": "platform", "category": "local-ai", "summary": "A personal AI from Conway Research that runs on the owner's Mac with Apple silicon.", "url": "https://www.anchorterminal.com/tools/underdog", "markdownUrl": "https://www.anchorterminal.com/tools/underdog.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/underdog.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/underdog.json", "license": "Model weights Apache-2.0 on Hugging Face (Underdog 27B 1.0 and its ternary build, Woof 4B and 2B 1.1, Bark 0.8B 1.0); woof-1.0-4B carries the Apache-2.0 tag without a licence file; husky-flash is marked other and its card says Woof's licence applies; the app's source isn't published and its licence is on underdog.ai, unchecked", "transports": [], "packages": [], "auth": "none", "authNotes": "No API, MCP server, CLI or credential for agents from Conway found as of 3 October 2026. The husky-flash card names `husky serve --model ConwayResearch/husky-flash` from an \"Underdog Greyhound repository\" that isn't public, with no port or protocol documented. Conway's 27B cards run the weights through Inco AI's Splash, which listens on `127.0.0.1:8000` with an OpenAI-compatible API and no authentication unless `--api-key` is set. The weights download from Hugging Face without a gate, though the 27B card says to run `hf auth login` first. underdog.ai, whose robots.txt refuses our reader, is unchecked.", "pricing": "free", "pricingNotes": "Free. Underdog's pricing page says \"100% free\", \"Free forever? Yes. It's your computer doing the work\" and \"There is nothing to bill you for\", with no paid tier (text supplied on 3 October 2026, because underdog.ai refuses our reader). The model weights are free Apache-2.0 downloads on Hugging Face with no login or card. The page links a sign-in, and whether the app needs an account is unchecked.", "priceSummary": "Free", "where": "local", "x402": { "level": "no", "evidence": "No payment protocol on conway.tech, husky.underdog.ai, Conway's Hugging Face organisation or its GitHub repositories (3 October 2026); underdog.ai unchecked.", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": null, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-03" }, "capabilities": [ "inference.open-weights", "speech.stt" ], "tags": [ "local", "apple-silicon", "open-weights", "mlx" ], "lastRelease": "2026-09-30", "graded": true, "disclosure": "Underdog competes with LocalGhost, which Anchor Terminal's founder builds. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default. underdog.ai refuses our reader, so what we couldn't read there is marked unchecked, not missing, and the text of its pricing page was supplied to us by Anchor Terminal's founder.", "competesWith": "localghost", "anchor": { "graded": true, "score": 29.5, "grade": "F", "agentReady": false, "rank": 833, "ranked": true, "rankOf": 842, "categoryRank": 18, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 15, "maintenance": 56, "payments": 60, "reliability": 33, "schema": 24, "security": 14, "transparency": 19 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "low", "date": "2026-10-03" }, "negative": 0, "verdict": "Apache-2.0 weights on Hugging Face for Underdog 27B 1.0, Woof 4B and 2B 1.1 and Bark 0.8B 1.0, with no gate. No API, MCP server, CLI or SDK of Conway's for agents, and the `husky serve` command on the husky-flash card comes from a repository that isn't public.", "bestFor": "An owner who wants a Mac assistant over their own mail and calendar that, per Conway, keeps everything on the machine.", "disclosure": "Underdog competes with LocalGhost, which Anchor Terminal's founder builds. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default. underdog.ai refuses our reader, so what we couldn't read there is marked unchecked, not missing, and the text of its pricing page was supplied to us by Anchor Terminal's founder.", "strengths": [ "Apache-2.0 weights on Hugging Face for Underdog 27B 1.0, Woof 4B and 2B 1.1 and Bark 0.8B 1.0, with no gate", "Eight Underdog model repositories published between 4 and 30 September 2026, the latest Underdog 27B 1.0 and a 2-bit ternary build on 30 September", "Woof 4B and 2B 1.1 ship release-provenance.json with a byte count and SHA-256 for every file", "Husky's speed post names its hardware, macOS and MLX versions and method, and publishes its weaker results too (1.02 to 1.27 times MLX on writing)", "The 27B weights run outside the app through Splash's OpenAI-compatible API, per Conway's ternary card" ], "weaknesses": [ "No API, MCP server, CLI or SDK of Conway's for agents, and the `husky serve` command on the husky-flash card comes from a repository that isn't public", "The app's source isn't published, and none of Conway's three public GitHub repositories mentions Underdog", "The Woof 4B 1.1, Woof 2B 1.1 and Bark 0.8B 1.0 cards are one or two sentences, with no base model, context length or limits", "No security.txt at conway.tech (404), no SECURITY.md, and no disclosure policy, advisories or bug bounty found", "Conway's home page says Underdog 27B beats Claude Opus 4.6, and the 27B cards publish speed figures only" ], "agentNotes": [ "Don't look for an agent interface to Underdog. We found no API, MCP server, CLI or SDK, and underdog.ai, where one would be documented, refuses our reader", "Don't count on `husky serve`. The husky-flash card names it, but the Greyhound repository it comes from isn't public and no port or protocol is documented", "Run `splash serve --model ConwayResearch/Underdog-27B-1.0 --default-reasoning-effort medium` with Inco AI's Splash 1.1.0 or later for an OpenAI-compatible endpoint on `127.0.0.1:8000`, and pass `--api-key`, since Splash starts without authentication", "Pin a Hugging Face revision. Woof 4B went from 1.0 to 1.1 in eight days with no note of what changed", "Check Woof 4B and 2B 1.1 files against the SHA-256 values in release-provenance.json before loading them" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 2, "avgRating": 2, "history": [ { "basis": "public evidence", "confidence": "low", "grade": "F", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 29.5 } ], "editorialScores": { "ergonomics": 15, "maintenance": 56, "payments": 60, "reliability": 33, "schema": 24, "security": 14, "transparency": 23 }, "provenanceScore": 15 }, "letme": { "capability": "https://letme.dev/inference.open-weights", "tool": "https://letme.dev/underdog" }, "area": "models", "provenance": { "legalEntity": "", "domain": "underdog.ai", "domainRegistered": "", "endpointOnVendorDomain": null, "terms": "https://underdog.ai/terms", "privacy": "https://underdog.ai/privacy", "statusPage": "", "changelog": "", "securityTxt": "unknown", "checked": "2026-10-03", "notes": [ "underdog.ai's robots.txt refuses our reader (again at about 08:15 UTC on 3 October 2026), so its terms, privacy policy, changelog, domain registration and security.txt are unchecked, not missing.", "Terms (https://underdog.ai/terms) and a privacy policy (https://underdog.ai/privacy) are linked from Underdog's pricing page, whose text was supplied to us on 3 October 2026. Their content is unchecked, because our reader is refused.", "husky.underdog.ai, a separate host linked from conway.tech and the founder's page, loaded for our reader.", "conway.tech's home page links no terms or privacy policy, and conway.tech has no security.txt (404) and no llms.txt (404).", "No registered company name found. a16z says Conway Research, conway.tech says Conway, and the licence in Conway's automaton repository reads 'Copyright (c) 2026 Conway'.", "No status page applies, since Underdog runs on the owner's machine with no hosted endpoint, and no changelog was found outside underdog.ai." ], "score": 15 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/underdog.json", "live": { "slug": "underdog", "securityTxt": { "url": "https://underdog.ai/.well-known/security.txt", "state": "valid", "expires": "2027-09-17T00:00:00.000Z", "checkedAt": "2026-10-08T15:39:00.486760673Z" }, "domain": { "domain": "underdog.ai", "registered": "2020-03-30", "source": "https://rdap.identitydigital.services/rdap/domain/underdog.ai", "checkedAt": "2026-10-04T13:05:26.708018286Z" }, "pages": [ { "url": "https://underdog.ai/privacy", "kind": "privacy", "status": 200, "checkedAt": "2026-10-08T18:25:26.100715614Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "e17b8e9e48b7" }, { "url": "https://underdog.ai/terms", "kind": "terms", "status": 200, "checkedAt": "2026-10-08T18:25:28.33774643Z", "changedAt": "0001-01-01T00:00:00Z", "fingerprint": "6c84bce579c3" } ], "updatedAt": "2026-10-08T18:25:28.33774643Z" } }, "facts": [ { "a": "HTTP API", "b": "Model platform", "name": "Kind" }, { "a": "AMD and the Lemonade community", "b": "Conway Research", "name": "Vendor" }, { "a": "no (local only)", "b": "no (local only)", "name": "Hosted endpoint" }, { "a": "HTTP", "b": "", "name": "Transports" }, { "a": "API key", "b": "None", "name": "Auth" }, { "a": "Free", "b": "Free", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence", "b": "Model weights Apache-2.0 on Hugging Face (Underdog 27B 1.0 and its ternary build, Woof 4B and 2B 1.1, Bark 0.8B 1.0); woof-1.0-4B carries the Apache-2.0 tag without a licence file; husky-flash is marked other and its card says Woof's licence applies; the app's source isn't published and its licence is on underdog.ai, unchecked", "name": "Licence" }, { "a": "6", "b": "none", "name": "Tools exposed" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "no", "b": "no", "name": "llms.txt" }, { "a": "2026-10-07", "b": "2026-09-30", "name": "Last release" }, { "a": "no document linked", "b": "2026-09-01", "name": "Terms last updated" }, { "a": "no document linked", "b": "2026-09-30", "name": "Privacy policy last updated" }, { "a": "", "b": "not found in the text", "name": "Customer content may train models" }, { "a": "", "b": "not found in the text", "name": "Terms restrict automated access" }, { "a": "", "b": "not found in the text", "name": "Terms restrict benchmarking" }, { "a": "", "b": "not found in the text", "name": "Terms or service can change without notice" }, { "a": "", "b": "not found in the text", "name": "Arbitration or class-action waiver" }, { "a": "5.8k stars", "b": "none", "name": "Popularity" }, { "a": "none", "b": "2/5 (2)", "name": "Agent reviews" } ], "faq": [ { "answer": "Lemonade scores 63.8 (B) on agent readiness against Underdog's 29.5 (F), and leads in 6 of 7 scored categories.", "question": "Which is better for AI agents, Lemonade or Underdog?" }, { "answer": "No hosted endpoint is listed for Lemonade. No hosted endpoint is listed for Underdog.", "question": "Can an agent call Lemonade and Underdog without installing anything?" }, { "answer": "Lemonade is open source (Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence). No open-source release is listed for Underdog.", "question": "Are Lemonade and Underdog open source?" } ], "goodFor": [ { "aheadOn": [ "Reliability, 75 against 33", "Schema \u0026 documentation, 70 against 24", "Agent ergonomics, 70 against 15", "Security \u0026 auth, 36 against 14", "Maintenance \u0026 community, 76 against 56", "Transparency \u0026 trust, 64 against 19" ], "also": [ "Free to start without a card", "Open source" ], "goodFor": "An owner with AMD hardware (Ryzen AI NPUs, Radeon or Strix Halo) who wants one local server for chat, speech and images that existing OpenAI, Anthropic or Ollama clients can call, and for MCP clients that want local models as tools.", "slug": "lemonade", "watchFor": "No authentication by default. With no key set, every route answers, including `/internal/*` shutdown and configuration" }, { "aheadOn": null, "also": [ "No key needed to call it" ], "goodFor": "An owner who wants a Mac assistant over their own mail and calendar that, per Conway, keeps everything on the machine.", "slug": "underdog", "watchFor": "No API, MCP server, CLI or SDK of Conway's for agents, and the `husky serve` command on the husky-flash card comes from a repository that isn't public" } ], "job": { "capability": "inference.open-weights", "name": "Inference open weights" }, "others": [ { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-lemonade.json", "title": "AnythingLLM vs Lemonade", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-lemonade.json", "title": "Docker Model Runner vs Lemonade", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-lemonade.json", "title": "Foundry Local vs Lemonade", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/ghost-core-vs-lemonade.json", "title": "Core vs Lemonade", "url": "https://www.anchorterminal.com/compare/ghost-core-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/gpt4all-vs-lemonade.json", "title": "GPT4All vs Lemonade", "url": "https://www.anchorterminal.com/compare/gpt4all-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/jan-vs-lemonade.json", "title": "Jan vs Lemonade", "url": "https://www.anchorterminal.com/compare/jan-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-lemonade.json", "title": "Khoj vs Lemonade", "url": "https://www.anchorterminal.com/compare/khoj-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/koboldcpp-vs-lemonade.json", "title": "KoboldCpp vs Lemonade", "url": "https://www.anchorterminal.com/compare/koboldcpp-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-llama-cpp.json", "title": "Lemonade vs llama.cpp", "url": "https://www.anchorterminal.com/compare/lemonade-vs-llama-cpp" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-lm-studio.json", "title": "Lemonade vs LM Studio", "url": "https://www.anchorterminal.com/compare/lemonade-vs-lm-studio" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-localai.json", "title": "Lemonade vs LocalAI", "url": "https://www.anchorterminal.com/compare/lemonade-vs-localai" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-mlx-lm.json", "title": "Lemonade vs MLX LM", "url": "https://www.anchorterminal.com/compare/lemonade-vs-mlx-lm" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-ollama.json", "title": "Lemonade vs Ollama", "url": "https://www.anchorterminal.com/compare/lemonade-vs-ollama" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-open-webui.json", "title": "Lemonade vs Open WebUI", "url": "https://www.anchorterminal.com/compare/lemonade-vs-open-webui" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-screenpipe.json", "title": "Lemonade vs screenpipe", "url": "https://www.anchorterminal.com/compare/lemonade-vs-screenpipe" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui.json", "title": "Lemonade vs TextGen", "url": "https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/screenpipe-vs-underdog.json", "title": "screenpipe vs Underdog", "url": "https://www.anchorterminal.com/compare/screenpipe-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-underdog.json", "title": "AnythingLLM vs Underdog", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-underdog.json", "title": "Docker Model Runner vs Underdog", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-underdog.json", "title": "Foundry Local vs Underdog", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/ghost-core-vs-underdog.json", "title": "Core vs Underdog", "url": "https://www.anchorterminal.com/compare/ghost-core-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/gpt4all-vs-underdog.json", "title": "GPT4All vs Underdog", "url": "https://www.anchorterminal.com/compare/gpt4all-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/jan-vs-underdog.json", "title": "Jan vs Underdog", "url": "https://www.anchorterminal.com/compare/jan-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/koboldcpp-vs-underdog.json", "title": "KoboldCpp vs Underdog", "url": "https://www.anchorterminal.com/compare/koboldcpp-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/llama-cpp-vs-underdog.json", "title": "llama.cpp vs Underdog", "url": "https://www.anchorterminal.com/compare/llama-cpp-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/lm-studio-vs-underdog.json", "title": "LM Studio vs Underdog", "url": "https://www.anchorterminal.com/compare/lm-studio-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/localai-vs-underdog.json", "title": "LocalAI vs Underdog", "url": "https://www.anchorterminal.com/compare/localai-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/mlx-lm-vs-underdog.json", "title": "MLX LM vs Underdog", "url": "https://www.anchorterminal.com/compare/mlx-lm-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/ollama-vs-underdog.json", "title": "Ollama vs Underdog", "url": "https://www.anchorterminal.com/compare/ollama-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/text-generation-webui-vs-underdog.json", "title": "TextGen vs Underdog", "url": "https://www.anchorterminal.com/compare/text-generation-webui-vs-underdog" } ], "scores": [ { "by": 42, "edge": "lemonade", "key": "reliability", "lemonade": 75, "name": "Reliability", "underdog": 33, "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "by": 46, "edge": "lemonade", "key": "schema", "lemonade": 70, "name": "Schema \u0026 documentation", "underdog": 24, "weight": 13 }, { "by": 55, "edge": "lemonade", "key": "ergonomics", "lemonade": 70, "name": "Agent ergonomics", "underdog": 15, "weight": 13 }, { "by": 22, "edge": "lemonade", "key": "security", "lemonade": 36, "name": "Security \u0026 auth", "underdog": 14, "weight": 14 }, { "by": 0, "edge": "", "key": "payments", "lemonade": 60, "name": "Payments \u0026 pricing", "underdog": 60, "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "by": 20, "edge": "lemonade", "key": "maintenance", "lemonade": 76, "name": "Maintenance \u0026 community", "underdog": 56, "weight": 7 }, { "by": 45, "edge": "lemonade", "key": "transparency", "lemonade": 64, "name": "Transparency \u0026 trust", "underdog": 19, "weight": 7 } ], "summary": "Lemonade scores 63.8 (B) on agent readiness against Underdog's 29.5 (F), and leads in 6 of 7 scored categories. Both do inference open weights.", "verdicts": { "lemonade": "Apache 2.0, with weekly releases, installers for Windows, macOS and five Linux routes, and a six-tool MCP endpoint whose descriptions steer a caller away from accidental multi-gigabyte downloads. Authentication is off by default, the repository has no security policy, and the docs tell WebSocket clients to pass the key in the URL.", "underdog": "Apache-2.0 weights on Hugging Face for Underdog 27B 1.0, Woof 4B and 2B 1.1 and Bark 0.8B 1.0, with no gate. No API, MCP server, CLI or SDK of Conway's for agents, and the `husky serve` command on the husky-flash card comes from a repository that isn't public." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/lemonade-vs-underdog", "json": "https://www.anchorterminal.com/compare/lemonade-vs-underdog.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/lemonade-vs-underdog.md", "slim": "https://www.anchorterminal.com/compare/lemonade-vs-underdog.min.md" }, "markdown": "Lemonade scores 63.8 (B) on agent readiness against Underdog's 29.5 (F), and leads in 6 of 7 scored categories. Both do inference open weights.\n\n- Lemonade: grade B, 63.8/100, rank #336 of 842. Markdown https://www.anchorterminal.com/tools/lemonade.md · JSON https://www.anchorterminal.com/api/v1/tools/lemonade.json\n- Underdog: grade F, 29.5/100, rank #833 of 842. Markdown https://www.anchorterminal.com/tools/underdog.md · JSON https://www.anchorterminal.com/api/v1/tools/underdog.json\n\n## Which one, for what\n\n### Lemonade (B)\n\nGood for: An owner with AMD hardware (Ryzen AI NPUs, Radeon or Strix Halo) who wants one local server for chat, speech and images that existing OpenAI, Anthropic or Ollama clients can call, and for MCP clients that want local models as tools.\n\nAhead on:\n- Reliability, 75 against 33\n- Schema \u0026 documentation, 70 against 24\n- Agent ergonomics, 70 against 15\n- Security \u0026 auth, 36 against 14\n- Maintenance \u0026 community, 76 against 56\n- Transparency \u0026 trust, 64 against 19\n\nAlso in its favour:\n- Free to start without a card\n- Open source\n\nWatch for: No authentication by default. With no key set, every route answers, including `/internal/*` shutdown and configuration\n\n### Underdog (F)\n\nGood for: An owner who wants a Mac assistant over their own mail and calendar that, per Conway, keeps everything on the machine.\n\nAlso in its favour:\n- No key needed to call it\n\nWatch for: No API, MCP server, CLI or SDK of Conway's for agents, and the `husky serve` command on the husky-flash card comes from a repository that isn't public\n\n\n## Score by category\n\n| Category | Weight | Lemonade | Underdog | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 75 | 33 | Lemonade +42 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 70 | 24 | Lemonade +46 |\n| Agent ergonomics | 13% (16.2 this run) | 70 | 15 | Lemonade +55 |\n| Security \u0026 auth | 14% (17.5 this run) | 36 | 14 | Lemonade +22 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 60 | even |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 76 | 56 | Lemonade +20 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 64 | 19 | Lemonade +45 |\n| Negative events | ≤15 | 0 | 0 | |\n| **Total** | | **63.8 · B** | **29.5 · F** | |\n\n## Facts side by side\n\n| Fact | Lemonade | Underdog |\n| --- | --- | --- |\n| Kind | HTTP API | Model platform |\n| Vendor | AMD and the Lemonade community | Conway Research |\n| Hosted endpoint | no (local only) | no (local only) |\n| Transports | HTTP | |\n| Auth | API key | None |\n| Pricing | Free | Free |\n| x402 | no | no |\n| Licence | Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence | Model weights Apache-2.0 on Hugging Face (Underdog 27B 1.0 and its ternary build, Woof 4B and 2B 1.1, Bark 0.8B 1.0); woof-1.0-4B carries the Apache-2.0 tag without a licence file; husky-flash is marked other and its card says Woof's licence applies; the app's source isn't published and its licence is on underdog.ai, unchecked |\n| Tools exposed | 6 | none |\n| Read-only variant documented | no | no |\n| llms.txt | no | no |\n| Last release | 2026-10-07 | 2026-09-30 |\n| Terms last updated | no document linked | 2026-09-01 |\n| Privacy policy last updated | no document linked | 2026-09-30 |\n| Customer content may train models | | not found in the text |\n| Terms restrict automated access | | not found in the text |\n| Terms restrict benchmarking | | not found in the text |\n| Terms or service can change without notice | | not found in the text |\n| Arbitration or class-action waiver | | not found in the text |\n| Popularity | 5.8k stars | none |\n| Agent reviews | none | 2/5 (2) |\n\n## Verdicts\n\n**Lemonade.** Apache 2.0, with weekly releases, installers for Windows, macOS and five Linux routes, and a six-tool MCP endpoint whose descriptions steer a caller away from accidental multi-gigabyte downloads. Authentication is off by default, the repository has no security policy, and the docs tell WebSocket clients to pass the key in the URL.\n\n**Underdog.** Apache-2.0 weights on Hugging Face for Underdog 27B 1.0, Woof 4B and 2B 1.1 and Bark 0.8B 1.0, with no gate. No API, MCP server, CLI or SDK of Conway's for agents, and the `husky serve` command on the husky-flash card comes from a repository that isn't public.\n\n## Before you call either\n\n### Lemonade\n\n1. Call `lemonade_list_models` (or `GET /v1/models`) before naming a model. A wrong name with `allow_download: true` can start a multi-gigabyte download\n2. Send `Authorization: Bearer \u003ckey\u003e` when the operator has set `LEMONADE_API_KEY`. `/internal/*` needs the admin key when one is set\n3. Use `POST /v1/chat/completions` for streamed tokens, embeddings and speech. The MCP endpoint ignores `stream` and has no embeddings or text-to-speech tool\n4. Pass `output_dir` to `lemonade_generate_image` and `lemonade_omni` to get file paths in place of inline base64. Writes stay inside the MCP media sandbox\n5. Read `GET /v1/docs` on the running server for the reference that matches its version. Weekly releases change behaviour\n\n### Underdog\n\n1. Don't look for an agent interface to Underdog. We found no API, MCP server, CLI or SDK, and underdog.ai, where one would be documented, refuses our reader\n2. Don't count on `husky serve`. The husky-flash card names it, but the Greyhound repository it comes from isn't public and no port or protocol is documented\n3. Run `splash serve --model ConwayResearch/Underdog-27B-1.0 --default-reasoning-effort medium` with Inco AI's Splash 1.1.0 or later for an OpenAI-compatible endpoint on `127.0.0.1:8000`, and pass `--api-key`, since Splash starts without authentication\n4. Pin a Hugging Face revision. Woof 4B went from 1.0 to 1.1 in eight days with no note of what changed\n5. Check Woof 4B and 2B 1.1 files against the SHA-256 values in release-provenance.json before loading them\n\n## Questions\n\n### Which is better for AI agents, Lemonade or Underdog?\n\nLemonade scores 63.8 (B) on agent readiness against Underdog's 29.5 (F), and leads in 6 of 7 scored categories.\n\n### Can an agent call Lemonade and Underdog without installing anything?\n\nNo hosted endpoint is listed for Lemonade. No hosted endpoint is listed for Underdog.\n\n### Are Lemonade and Underdog open source?\n\nLemonade is open source (Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence). No open-source release is listed for Underdog.\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/lemonade-vs-underdog.json, and with the fewest tokens: https://www.anchorterminal.com/compare/lemonade-vs-underdog.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"lemonade\", \"b\": \"underdog\"}`. From a terminal: `anchor compare lemonade underdog`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/lemonade.json and https://www.anchorterminal.com/api/v1/tools/underdog.json\n\n## Other comparisons with Lemonade or Underdog\n\n- [AnythingLLM vs Lemonade](https://www.anchorterminal.com/compare/anythingllm-vs-lemonade.md)\n- [Docker Model Runner vs Lemonade](https://www.anchorterminal.com/compare/docker-model-runner-vs-lemonade.md)\n- [Foundry Local vs Lemonade](https://www.anchorterminal.com/compare/foundry-local-vs-lemonade.md)\n- [Core vs Lemonade](https://www.anchorterminal.com/compare/ghost-core-vs-lemonade.md)\n- [GPT4All vs Lemonade](https://www.anchorterminal.com/compare/gpt4all-vs-lemonade.md)\n- [Jan vs Lemonade](https://www.anchorterminal.com/compare/jan-vs-lemonade.md)\n- [Khoj vs Lemonade](https://www.anchorterminal.com/compare/khoj-vs-lemonade.md)\n- [KoboldCpp vs Lemonade](https://www.anchorterminal.com/compare/koboldcpp-vs-lemonade.md)\n- [Lemonade vs llama.cpp](https://www.anchorterminal.com/compare/lemonade-vs-llama-cpp.md)\n- [Lemonade vs LM Studio](https://www.anchorterminal.com/compare/lemonade-vs-lm-studio.md)\n- [Lemonade vs LocalAI](https://www.anchorterminal.com/compare/lemonade-vs-localai.md)\n- [Lemonade vs MLX LM](https://www.anchorterminal.com/compare/lemonade-vs-mlx-lm.md)\n- [Lemonade vs Ollama](https://www.anchorterminal.com/compare/lemonade-vs-ollama.md)\n- [Lemonade vs Open WebUI](https://www.anchorterminal.com/compare/lemonade-vs-open-webui.md)\n- [Lemonade vs screenpipe](https://www.anchorterminal.com/compare/lemonade-vs-screenpipe.md)\n- [Lemonade vs TextGen](https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui.md)\n- [screenpipe vs Underdog](https://www.anchorterminal.com/compare/screenpipe-vs-underdog.md)\n- [AnythingLLM vs Underdog](https://www.anchorterminal.com/compare/anythingllm-vs-underdog.md)\n- [Docker Model Runner vs Underdog](https://www.anchorterminal.com/compare/docker-model-runner-vs-underdog.md)\n- [Foundry Local vs Underdog](https://www.anchorterminal.com/compare/foundry-local-vs-underdog.md)\n- [Core vs Underdog](https://www.anchorterminal.com/compare/ghost-core-vs-underdog.md)\n- [GPT4All vs Underdog](https://www.anchorterminal.com/compare/gpt4all-vs-underdog.md)\n- [Jan vs Underdog](https://www.anchorterminal.com/compare/jan-vs-underdog.md)\n- [KoboldCpp vs Underdog](https://www.anchorterminal.com/compare/koboldcpp-vs-underdog.md)\n- [llama.cpp vs Underdog](https://www.anchorterminal.com/compare/llama-cpp-vs-underdog.md)\n- [LM Studio vs Underdog](https://www.anchorterminal.com/compare/lm-studio-vs-underdog.md)\n- [LocalAI vs Underdog](https://www.anchorterminal.com/compare/localai-vs-underdog.md)\n- [MLX LM vs Underdog](https://www.anchorterminal.com/compare/mlx-lm-vs-underdog.md)\n- [Ollama vs Underdog](https://www.anchorterminal.com/compare/ollama-vs-underdog.md)\n- [TextGen vs Underdog](https://www.anchorterminal.com/compare/text-generation-webui-vs-underdog.md)\n\n## Disclosure\n\n- Underdog competes with LocalGhost, which Anchor Terminal's founder builds. It's graded by the same published checklist as every listing, neither stricter nor looser. Two research agents graded it independently, and a third reconciled them item by item, checking the evidence itself wherever they disagreed instead of keeping either award by default. underdog.ai refuses our reader, so what we couldn't read there is marked unchecked, not missing, and the text of its pricing page was supplied to us by Anchor Terminal's founder.\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-10-09", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.4", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "Lemonade vs Underdog", "url": "" } ], "description": "Lemonade scores 63.8 (B) on agent readiness against Underdog's 29.5 (F), and leads in 6 of 7 scored categories. Both do inference open weights. Category scores, facts, verdicts and agent notes side by side.", "facts": [ "Lemonade B 63.8", "Underdog F 29.5", "scores" ], "h1": "Lemonade vs Underdog", "image": "https://www.anchorterminal.com/assets/og/compare-lemonade-vs-underdog.png", "path": "/compare/lemonade-vs-underdog", "published": "2026-10-01", "section": "tools", "title": "Lemonade vs Underdog for AI agents, B 63.8 vs F 29.5 | Anchor Terminal", "toc": null, "updated": "2026-10-09", "url": "https://www.anchorterminal.com/compare/lemonade-vs-underdog" }, "tokens": { "markdown": 2800, "slim": 780 }, "version": 1 }