{ "data": { "a": { "slug": "lemonade", "name": "Lemonade", "vendor": "AMD and the Lemonade community", "vendorUrl": "https://lemonade-server.ai", "kind": "http-api", "category": "local-ai", "summary": "Open-source local AI server from AMD and community contributors. It runs text, speech and image models on the owner's CPU, GPU or NPU behind OpenAI-, Anthropic- and Ollama-compatible APIs and an MCP endpoint on port 13305.", "url": "https://www.anchorterminal.com/tools/lemonade", "markdownUrl": "https://www.anchorterminal.com/tools/lemonade.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/lemonade.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/lemonade.json", "repo": "https://github.com/lemonade-sdk/lemonade", "license": "Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence", "transports": [ "http" ], "packages": [ { "registry": "oci", "name": "ghcr.io/lemonade-sdk/lemonade-server" } ], "auth": "api-key", "authNotes": "Off by default. With no key set, every endpoint answers without authentication, on a default bind of localhost. `LEMONADE_API_KEY` sets one bearer key for the regular API (`/api/*`, `/v0/*`, `/v1/*`, `/mcp` and `/metrics`). `LEMONADE_ADMIN_API_KEY` sets a second key for the internal control endpoints (`/internal/*`), and without it the regular key reaches those too. Both are environment variables, so there are no per-user keys. The docs tell WebSocket clients to pass `?api_key=KEY` in the URL.", "pricing": "free", "pricingNotes": "Free and Apache 2.0 with nothing to buy and no account. You run it on your own hardware. Cloud Offload, which is optional and experimental, bills through the owner's own keys at whichever cloud provider they add.", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the docs or the source (checked 2026-10-08).", "endpoints": [] }, "toolCount": 6, "popularity": { "githubStars": 5800, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-08" }, "docsUrl": "https://lemonade-server.ai/docs/", "capabilities": [ "inference.local", "inference.open-weights", "embed.text", "rerank", "speech.stt", "speech.tts", "image.generate" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "openai-compatible", "mcp", "streaming", "open-weights", "amd", "npu", "docker" ], "lastRelease": "2026-10-07", "graded": true, "anchor": { "graded": true, "score": 63.8, "grade": "B", "agentReady": false, "rank": 336, "ranked": true, "rankOf": 842, "categoryRank": 2, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 70, "maintenance": 76, "payments": 60, "reliability": 75, "schema": 70, "security": 36, "transparency": 64 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-08" }, "negative": 0, "verdict": "Apache 2.0, with weekly releases, installers for Windows, macOS and five Linux routes, and a six-tool MCP endpoint whose descriptions steer a caller away from accidental multi-gigabyte downloads. Authentication is off by default, the repository has no security policy, and the docs tell WebSocket clients to pass the key in the URL.", "bestFor": "An owner with AMD hardware (Ryzen AI NPUs, Radeon or Strix Halo) who wants one local server for chat, speech and images that existing OpenAI, Anthropic or Ollama clients can call, and for MCP clients that want local models as tools.", "strengths": [ "Apache 2.0, with OpenAI, Anthropic Messages, Ollama and llama.cpp-compatible routes on one port (13305)", "`POST /mcp` exposes six tools over Streamable HTTP, and omitting `model` reuses a loaded or downloaded model before any download", "Every running server returns its own Markdown API reference at `GET /v1/docs` and through the `lemonade_docs` tool, so it matches the installed version", "Stable release v2026.41.1 on 7 October 2026 on a weekly cadence, each with a Breaking Changes section in its notes", "Telemetry is off by default and exports OTLP traces only to an endpoint the operator sets, with switches to redact prompts and outputs" ], "weaknesses": [ "No authentication by default. With no key set, every route answers, including `/internal/*` shutdown and configuration", "GitHub reports no `SECURITY.md`, and we found no security.txt, advisory or disclosure address", "The docs tell WebSocket clients to send the key as `?api_key=KEY` in the URL", "No OpenAPI file in the repository, and no `readOnlyHint` or `destructiveHint` on the MCP tools", "The main build and test workflow's badge read failing on main on 8 October 2026, with 411 issues open" ], "agentNotes": [ "Call `lemonade_list_models` (or `GET /v1/models`) before naming a model. A wrong name with `allow_download: true` can start a multi-gigabyte download", "Send `Authorization: Bearer \u003ckey\u003e` when the operator has set `LEMONADE_API_KEY`. `/internal/*` needs the admin key when one is set", "Use `POST /v1/chat/completions` for streamed tokens, embeddings and speech. The MCP endpoint ignores `stream` and has no embeddings or text-to-speech tool", "Pass `output_dir` to `lemonade_generate_image` and `lemonade_omni` to get file paths in place of inline base64. Writes stay inside the MCP media sandbox", "Read `GET /v1/docs` on the running server for the reference that matches its version. Weekly releases change behaviour" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "B", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 63.8 } ], "editorialScores": { "ergonomics": 70, "maintenance": 76, "payments": 60, "reliability": 75, "schema": 70, "security": 36, "transparency": 70 }, "provenanceScore": 57 }, "connect": { "install": "winget install --id AMD.LemonadeServer -e", "http": "curl http://localhost:13305/api/v1/chat/completions -H \"Content-Type: application/json\" -d '{\"model\": \"your-model-name\", \"messages\": [{\"role\": \"user\", \"content\": \"Hello\"}]}'", "claudeCode": "lemonade launch claude" }, "letme": { "capability": "https://letme.dev/inference.local", "tool": "https://letme.dev/lemonade" }, "area": "models", "provenance": { "legalEntity": "Advanced Micro Devices, Inc.", "domain": "lemonade-server.ai", "domainRegistered": "2025-05-12", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/lemonade-sdk/lemonade/releases", "securityTxt": "none", "checked": "2026-10-08", "notes": [ "The website footer reads \"© 2026 AMD. Licensed under Apache 2.0\", and `contrib/debian/copyright` in the repository names Advanced Micro Devices, Inc. The code lives in the lemonade-sdk organisation on GitHub, and the README calls it a community project with optimisations by AMD engineers.", "We found no terms of service and no privacy policy for the software or the website. The home page and its footer link to neither, so both fields are empty.", "lemonade-server.ai/.well-known/security.txt, /security.txt and /llms.txt return 404.", "RDAP gives a registration date of 2025-05-12 for lemonade-server.ai, with Porkbun LLC as registrar and the registrant behind a privacy service.", "There's no hosted endpoint. Each instance answers on the owner's own machine, by default localhost port 13305." ], "score": 57 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/lemonade.json" }, "answer": "Lemonade scores 63.8 (B) on agent readiness against TextGen's 45.1 (E), and leads in 5 of 7 scored categories.", "b": { "slug": "text-generation-webui", "name": "TextGen", "vendor": "oobabooga", "vendorUrl": "https://github.com/oobabooga", "kind": "platform", "category": "local-ai", "summary": "Open-source desktop and browser app for running language models on the owner's hardware, formerly text-generation-webui. With `--api` it serves an OpenAI and Anthropic-compatible local API with tool calling, vision, embeddings and image generation.", "url": "https://www.anchorterminal.com/tools/text-generation-webui", "markdownUrl": "https://www.anchorterminal.com/tools/text-generation-webui.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/text-generation-webui.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/text-generation-webui.json", "repo": "https://github.com/oobabooga/textgen", "license": "AGPL-3.0", "transports": [ "http" ], "packages": [], "auth": "api-key", "authNotes": "The API takes one optional key from `--api-key`, off by default, sent as `Authorization: Bearer` on the OpenAI routes and as `x-api-key` on `/v1/messages`. A second key from `--admin-key` guards model and LoRA loading, unloading and listing, and equals the API key when unset. Keys are set at launch, have no scopes and change only with a restart. Without `--listen` or `--public-api` the server binds 127.0.0.1, rejects other Host headers and limits CORS to localhost. The web UI has no login unless `--gradio-auth` is set.", "pricing": "free", "pricingNotes": "Free and AGPL-3.0, with no account, card or paid edition. Portable builds and source are on GitHub (checked 2026-10-08).", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the README, the docs folder or the API source (checked 2026-10-08).", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 47700, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-08" }, "docsUrl": "https://github.com/oobabooga/textgen/wiki", "capabilities": [ "inference.local", "inference.open-weights", "agent.mcp-client", "embed.text", "image.generate" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "account-free", "openai-compatible", "open-weights", "streaming", "mcp", "docker", "no-telemetry" ], "lastRelease": "2026-05-20", "graded": true, "anchor": { "graded": true, "score": 45.1, "grade": "E", "agentReady": false, "rank": 775, "ranked": true, "rankOf": 842, "categoryRank": 15, "methodology": "0.4", "run": "2026-10-01", "scores": { "ergonomics": 50, "maintenance": 24, "payments": 60, "reliability": 51, "schema": 61, "security": 40, "transparency": 49 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-08" }, "negative": -4, "negativeNotes": [ "2026-03-18. Two Critical advisories at 9.1. GHSA-jg96-p5p6-q3cv (CVE-2026-35050) let a user of the web UI write Python files through a path traversal in extension settings and run them, in 4.1 and earlier, fixed in 4.1.1. GHSA-4p45-76cc-7p62 let a caller write or delete files through a character name on instances started with `--listen`, fixed in 4.0. Both fixed and published, -2. https://github.com/oobabooga/textgen/security/advisories/GHSA-jg96-p5p6-q3cv", "2026-03-18. GHSA-fpwc-4mvr-7jpr (High, 7.1). `/v1/chat/completions` and `/v1/completions` fetched any `image_url` from the server side, so a caller could reach internal addresses, in 4.1 and earlier. Fixed in 4.1.1 and published, -1. https://github.com/oobabooga/textgen/security/advisories/GHSA-fpwc-4mvr-7jpr", "2025-10-13 to 2026-04-03. Seven more advisories in the year, four High and three Moderate, among them a file read through an uploaded symbolic link, four path traversals in preset, grammar, template and prompt loading, an SSRF in the superbooga extensions and a Gradio path-check bypass fixed in 4.3. All published with fixes, -1. https://github.com/oobabooga/textgen/security" ], "verdict": "AGPL-3.0 with no telemetry, and a local API on 127.0.0.1:5000 that checks the Host header, limits CORS to localhost and separates an admin key from the caller's key. No release since v4.9 on 20 May 2026, no code commits since 31 May, no test suite, and ten security advisories in the year, all fixed.", "bestFor": "A person who wants one app for several backends (llama.cpp, ExLlamaV3, Transformers) with an OpenAI and Anthropic-compatible endpoint, LoRA training and image generation.", "strengths": [ "AGPL-3.0, with analytics switched off in the source and a README that states zero telemetry", "One server answers `/v1/chat/completions`, `/v1/completions` and Anthropic's `/v1/messages`, with tool calling and streaming", "Since v4.9 the API rejects Host headers other than localhost and 127.0.0.1 and limits CORS to localhost unless `--listen` or `--public-api` is set", "A separate `--admin-key` guards model and LoRA loading, apart from the `--api-key` callers use", "Ten security advisories published on GitHub with patched versions named, the newest on 3 April 2026" ], "weaknesses": [ "No release since v4.9 on 20 May 2026 and no code commit on `main` or `dev` since 31 May 2026", "No test suite. The seven GitHub workflows only build release packages on manual dispatch", "807 open issues and 40 open pull requests, with no SECURITY.md or disclosure address", "Two Critical advisories (9.1) published on 18 March 2026, both path traversals in the web UI, fixed in 4.0 and 4.1.1", "The API key is off by default, set only at launch, and has no scopes or per-client keys", "No rate limits, error list or published OpenAPI file in the docs. The schema is served only by a running server at `/docs`" ], "agentNotes": [ "Ask the owner to launch with `--api`. Nothing listens on port 5000 without it, and a model must be loaded first", "Call `http://127.0.0.1:5000/v1`. Any Host header other than localhost or 127.0.0.1 gets 400 `Invalid host header` unless `--listen` is set", "Send the key as `Authorization: Bearer` on OpenAI routes and as `x-api-key` on `/v1/messages`. Model loading needs the admin key", "Read `http://127.0.0.1:5000/docs` or `modules/api/typing.py` for parameters. `max_tokens` defaults to 512 on chat completions", "Run tool calls yourself. The API returns `finish_reason: \"tool_calls\"` and executes nothing on the server", "Use the repository name `oobabooga/textgen`. The old `text-generation-webui` URL redirects" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "E", "methodology": "0.4", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 45.1 } ], "editorialScores": { "ergonomics": 50, "maintenance": 24, "payments": 60, "reliability": 51, "schema": 61, "security": 40, "transparency": 70 }, "provenanceScore": 27 }, "connect": { "install": "git clone https://github.com/oobabooga/textgen\ncd textgen\npython -m venv venv\nsource venv/bin/activate\npip install -r requirements/portable/requirements.txt --upgrade\npython server.py --portable --api --auto-launch", "http": "curl http://127.0.0.1:5000/v1/chat/completions \\\n -H \"Content-Type: application/json\" \\\n -d '{\"messages\": [{\"role\": \"user\", \"content\": \"Hello!\"}], \"temperature\": 0.6, \"top_p\": 0.95, \"top_k\": 20}'" }, "letme": { "capability": "https://letme.dev/inference.local", "tool": "https://letme.dev/text-generation-webui" }, "area": "models", "provenance": { "legalEntity": "", "domain": "github.com/oobabooga", "domainRegistered": "", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/oobabooga/textgen/releases", "securityTxt": "none", "checked": "2026-10-08", "notes": [ "The project belongs to a developer who publishes as oobabooga. The LICENSE is the AGPL-3.0 text and names no legal entity, and the README acknowledges a grant from Andreessen Horowitz in August 2023.", "No vendor domain. The README links only the GitHub repository, its wiki, a subreddit, a Substack and a Hugging Face space.", "No terms of use and no privacy policy were found in the repository, the README or the wiki, so both fields are left out. The README states zero telemetry.", "No SECURITY.md (the Security tab says none is set up) and no security.txt of the project's own.", "There's no hosted endpoint. The API answers on the owner's machine, at 127.0.0.1:5000 by default." ], "score": 27 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/text-generation-webui.json" }, "facts": [ { "a": "HTTP API", "b": "Model platform", "name": "Kind" }, { "a": "AMD and the Lemonade community", "b": "oobabooga", "name": "Vendor" }, { "a": "no (local only)", "b": "no (local only)", "name": "Hosted endpoint" }, { "a": "HTTP", "b": "HTTP", "name": "Transports" }, { "a": "API key", "b": "API key", "name": "Auth" }, { "a": "Free", "b": "Free", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence", "b": "AGPL-3.0", "name": "Licence" }, { "a": "6", "b": "none", "name": "Tools exposed" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "no", "b": "no", "name": "llms.txt" }, { "a": "2026-10-07", "b": "2026-05-20", "name": "Last release" }, { "a": "no document linked", "b": "no document linked", "name": "Terms last updated" }, { "a": "no document linked", "b": "no document linked", "name": "Privacy policy last updated" }, { "a": "", "b": "", "name": "Customer content may train models" }, { "a": "", "b": "", "name": "Terms restrict automated access" }, { "a": "", "b": "", "name": "Terms restrict benchmarking" }, { "a": "", "b": "", "name": "Terms or service can change without notice" }, { "a": "", "b": "", "name": "Arbitration or class-action waiver" }, { "a": "5.8k stars", "b": "48k stars", "name": "Popularity" } ], "faq": [ { "answer": "Lemonade scores 63.8 (B) on agent readiness against TextGen's 45.1 (E), and leads in 5 of 7 scored categories.", "question": "Which is better for AI agents, Lemonade or TextGen?" }, { "answer": "No hosted endpoint is listed for Lemonade. No hosted endpoint is listed for TextGen.", "question": "Can an agent call Lemonade and TextGen without installing anything?" }, { "answer": "Yes. Lemonade is open source (Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence). TextGen is open source (AGPL-3.0).", "question": "Are Lemonade and TextGen open source?" } ], "goodFor": [ { "aheadOn": [ "Reliability, 75 against 51", "Schema \u0026 documentation, 70 against 61", "Agent ergonomics, 70 against 50", "Maintenance \u0026 community, 76 against 24", "Transparency \u0026 trust, 64 against 49" ], "also": [ "No incidents deducted, where TextGen loses 4 points for them" ], "goodFor": "An owner with AMD hardware (Ryzen AI NPUs, Radeon or Strix Halo) who wants one local server for chat, speech and images that existing OpenAI, Anthropic or Ollama clients can call, and for MCP clients that want local models as tools.", "slug": "lemonade", "watchFor": "No authentication by default. With no key set, every route answers, including `/internal/*` shutdown and configuration" }, { "aheadOn": null, "also": null, "goodFor": "A person who wants one app for several backends (llama.cpp, ExLlamaV3, Transformers) with an OpenAI and Anthropic-compatible endpoint, LoRA training and image generation.", "slug": "text-generation-webui", "watchFor": "No release since v4.9 on 20 May 2026 and no code commit on `main` or `dev` since 31 May 2026" } ], "job": { "capability": "inference.local", "name": "Local inference" }, "others": [ { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-lemonade.json", "title": "AnythingLLM vs Lemonade", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-text-generation-webui.json", "title": "AnythingLLM vs TextGen", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-lemonade.json", "title": "Docker Model Runner vs Lemonade", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-text-generation-webui.json", "title": "Docker Model Runner vs TextGen", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-lemonade.json", "title": "Foundry Local vs Lemonade", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-text-generation-webui.json", "title": "Foundry Local vs TextGen", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/ghost-core-vs-lemonade.json", "title": "Core vs Lemonade", "url": "https://www.anchorterminal.com/compare/ghost-core-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/ghost-core-vs-text-generation-webui.json", "title": "Core vs TextGen", "url": "https://www.anchorterminal.com/compare/ghost-core-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/gpt4all-vs-lemonade.json", "title": "GPT4All vs Lemonade", "url": "https://www.anchorterminal.com/compare/gpt4all-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/gpt4all-vs-text-generation-webui.json", "title": "GPT4All vs TextGen", "url": "https://www.anchorterminal.com/compare/gpt4all-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/jan-vs-lemonade.json", "title": "Jan vs Lemonade", "url": "https://www.anchorterminal.com/compare/jan-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/jan-vs-text-generation-webui.json", "title": "Jan vs TextGen", "url": "https://www.anchorterminal.com/compare/jan-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-lemonade.json", "title": "Khoj vs Lemonade", "url": "https://www.anchorterminal.com/compare/khoj-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui.json", "title": "Khoj vs TextGen", "url": "https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/koboldcpp-vs-lemonade.json", "title": "KoboldCpp vs Lemonade", "url": "https://www.anchorterminal.com/compare/koboldcpp-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/koboldcpp-vs-text-generation-webui.json", "title": "KoboldCpp vs TextGen", "url": "https://www.anchorterminal.com/compare/koboldcpp-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-llama-cpp.json", "title": "Lemonade vs llama.cpp", "url": "https://www.anchorterminal.com/compare/lemonade-vs-llama-cpp" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-lm-studio.json", "title": "Lemonade vs LM Studio", "url": "https://www.anchorterminal.com/compare/lemonade-vs-lm-studio" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-localai.json", "title": "Lemonade vs LocalAI", "url": "https://www.anchorterminal.com/compare/lemonade-vs-localai" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-mlx-lm.json", "title": "Lemonade vs MLX LM", "url": "https://www.anchorterminal.com/compare/lemonade-vs-mlx-lm" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-ollama.json", "title": "Lemonade vs Ollama", "url": "https://www.anchorterminal.com/compare/lemonade-vs-ollama" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-open-webui.json", "title": "Lemonade vs Open WebUI", "url": "https://www.anchorterminal.com/compare/lemonade-vs-open-webui" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-screenpipe.json", "title": "Lemonade vs screenpipe", "url": "https://www.anchorterminal.com/compare/lemonade-vs-screenpipe" }, { "json": "https://www.anchorterminal.com/compare/llama-cpp-vs-text-generation-webui.json", "title": "llama.cpp vs TextGen", "url": "https://www.anchorterminal.com/compare/llama-cpp-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/lm-studio-vs-text-generation-webui.json", "title": "LM Studio vs TextGen", "url": "https://www.anchorterminal.com/compare/lm-studio-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/localai-vs-text-generation-webui.json", "title": "LocalAI vs TextGen", "url": "https://www.anchorterminal.com/compare/localai-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/mlx-lm-vs-text-generation-webui.json", "title": "MLX LM vs TextGen", "url": "https://www.anchorterminal.com/compare/mlx-lm-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/ollama-vs-text-generation-webui.json", "title": "Ollama vs TextGen", "url": "https://www.anchorterminal.com/compare/ollama-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/open-webui-vs-text-generation-webui.json", "title": "Open WebUI vs TextGen", "url": "https://www.anchorterminal.com/compare/open-webui-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/screenpipe-vs-text-generation-webui.json", "title": "screenpipe vs TextGen", "url": "https://www.anchorterminal.com/compare/screenpipe-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/lemonade-vs-underdog.json", "title": "Lemonade vs Underdog", "url": "https://www.anchorterminal.com/compare/lemonade-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/text-generation-webui-vs-underdog.json", "title": "TextGen vs Underdog", "url": "https://www.anchorterminal.com/compare/text-generation-webui-vs-underdog" } ], "scores": [ { "by": 24, "edge": "lemonade", "key": "reliability", "lemonade": 75, "name": "Reliability", "text-generation-webui": 51, "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "by": 9, "edge": "lemonade", "key": "schema", "lemonade": 70, "name": "Schema \u0026 documentation", "text-generation-webui": 61, "weight": 13 }, { "by": 20, "edge": "lemonade", "key": "ergonomics", "lemonade": 70, "name": "Agent ergonomics", "text-generation-webui": 50, "weight": 13 }, { "by": 4, "edge": "text-generation-webui", "key": "security", "lemonade": 36, "name": "Security \u0026 auth", "text-generation-webui": 40, "weight": 14 }, { "by": 0, "edge": "", "key": "payments", "lemonade": 60, "name": "Payments \u0026 pricing", "text-generation-webui": 60, "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "by": 52, "edge": "lemonade", "key": "maintenance", "lemonade": 76, "name": "Maintenance \u0026 community", "text-generation-webui": 24, "weight": 7 }, { "by": 15, "edge": "lemonade", "key": "transparency", "lemonade": 64, "name": "Transparency \u0026 trust", "text-generation-webui": 49, "weight": 7 } ], "summary": "Lemonade scores 63.8 (B) on agent readiness against TextGen's 45.1 (E), and leads in 5 of 7 scored categories. Both do local inference.", "verdicts": { "lemonade": "Apache 2.0, with weekly releases, installers for Windows, macOS and five Linux routes, and a six-tool MCP endpoint whose descriptions steer a caller away from accidental multi-gigabyte downloads. Authentication is off by default, the repository has no security policy, and the docs tell WebSocket clients to pass the key in the URL.", "text-generation-webui": "AGPL-3.0 with no telemetry, and a local API on 127.0.0.1:5000 that checks the Host header, limits CORS to localhost and separates an admin key from the caller's key. No release since v4.9 on 20 May 2026, no code commits since 31 May, no test suite, and ten security advisories in the year, all fixed." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui", "json": "https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui.md", "slim": "https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui.min.md" }, "markdown": "Lemonade scores 63.8 (B) on agent readiness against TextGen's 45.1 (E), and leads in 5 of 7 scored categories. Both do local inference.\n\n- Lemonade: grade B, 63.8/100, rank #336 of 842. Markdown https://www.anchorterminal.com/tools/lemonade.md · JSON https://www.anchorterminal.com/api/v1/tools/lemonade.json\n- TextGen: grade E, 45.1/100, rank #775 of 842. Markdown https://www.anchorterminal.com/tools/text-generation-webui.md · JSON https://www.anchorterminal.com/api/v1/tools/text-generation-webui.json\n\n## Which one, for what\n\n### Lemonade (B)\n\nGood for: An owner with AMD hardware (Ryzen AI NPUs, Radeon or Strix Halo) who wants one local server for chat, speech and images that existing OpenAI, Anthropic or Ollama clients can call, and for MCP clients that want local models as tools.\n\nAhead on:\n- Reliability, 75 against 51\n- Schema \u0026 documentation, 70 against 61\n- Agent ergonomics, 70 against 50\n- Maintenance \u0026 community, 76 against 24\n- Transparency \u0026 trust, 64 against 49\n\nAlso in its favour:\n- No incidents deducted, where TextGen loses 4 points for them\n\nWatch for: No authentication by default. With no key set, every route answers, including `/internal/*` shutdown and configuration\n\n### TextGen (E)\n\nGood for: A person who wants one app for several backends (llama.cpp, ExLlamaV3, Transformers) with an OpenAI and Anthropic-compatible endpoint, LoRA training and image generation.\n\nWatch for: No release since v4.9 on 20 May 2026 and no code commit on `main` or `dev` since 31 May 2026\n\n\n## Score by category\n\n| Category | Weight | Lemonade | TextGen | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 75 | 51 | Lemonade +24 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 70 | 61 | Lemonade +9 |\n| Agent ergonomics | 13% (16.2 this run) | 70 | 50 | Lemonade +20 |\n| Security \u0026 auth | 14% (17.5 this run) | 36 | 40 | TextGen +4 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 60 | even |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 76 | 24 | Lemonade +52 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 64 | 49 | Lemonade +15 |\n| Negative events | ≤15 | 0 | -4 | |\n| **Total** | | **63.8 · B** | **45.1 · E** | |\n\n## Facts side by side\n\n| Fact | Lemonade | TextGen |\n| --- | --- | --- |\n| Kind | HTTP API | Model platform |\n| Vendor | AMD and the Lemonade community | oobabooga |\n| Hosted endpoint | no (local only) | no (local only) |\n| Transports | HTTP | HTTP |\n| Auth | API key | API key |\n| Pricing | Free | Free |\n| x402 | no | no |\n| Licence | Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence | AGPL-3.0 |\n| Tools exposed | 6 | none |\n| Read-only variant documented | no | no |\n| llms.txt | no | no |\n| Last release | 2026-10-07 | 2026-05-20 |\n| Terms last updated | no document linked | no document linked |\n| Privacy policy last updated | no document linked | no document linked |\n| Customer content may train models | | |\n| Terms restrict automated access | | |\n| Terms restrict benchmarking | | |\n| Terms or service can change without notice | | |\n| Arbitration or class-action waiver | | |\n| Popularity | 5.8k stars | 48k stars |\n\n## Verdicts\n\n**Lemonade.** Apache 2.0, with weekly releases, installers for Windows, macOS and five Linux routes, and a six-tool MCP endpoint whose descriptions steer a caller away from accidental multi-gigabyte downloads. Authentication is off by default, the repository has no security policy, and the docs tell WebSocket clients to pass the key in the URL.\n\n**TextGen.** AGPL-3.0 with no telemetry, and a local API on 127.0.0.1:5000 that checks the Host header, limits CORS to localhost and separates an admin key from the caller's key. No release since v4.9 on 20 May 2026, no code commits since 31 May, no test suite, and ten security advisories in the year, all fixed.\n\n## Before you call either\n\n### Lemonade\n\n1. Call `lemonade_list_models` (or `GET /v1/models`) before naming a model. A wrong name with `allow_download: true` can start a multi-gigabyte download\n2. Send `Authorization: Bearer \u003ckey\u003e` when the operator has set `LEMONADE_API_KEY`. `/internal/*` needs the admin key when one is set\n3. Use `POST /v1/chat/completions` for streamed tokens, embeddings and speech. The MCP endpoint ignores `stream` and has no embeddings or text-to-speech tool\n4. Pass `output_dir` to `lemonade_generate_image` and `lemonade_omni` to get file paths in place of inline base64. Writes stay inside the MCP media sandbox\n5. Read `GET /v1/docs` on the running server for the reference that matches its version. Weekly releases change behaviour\n\n### TextGen\n\n1. Ask the owner to launch with `--api`. Nothing listens on port 5000 without it, and a model must be loaded first\n2. Call `http://127.0.0.1:5000/v1`. Any Host header other than localhost or 127.0.0.1 gets 400 `Invalid host header` unless `--listen` is set\n3. Send the key as `Authorization: Bearer` on OpenAI routes and as `x-api-key` on `/v1/messages`. Model loading needs the admin key\n4. Read `http://127.0.0.1:5000/docs` or `modules/api/typing.py` for parameters. `max_tokens` defaults to 512 on chat completions\n5. Run tool calls yourself. The API returns `finish_reason: \"tool_calls\"` and executes nothing on the server\n6. Use the repository name `oobabooga/textgen`. The old `text-generation-webui` URL redirects\n\n## Questions\n\n### Which is better for AI agents, Lemonade or TextGen?\n\nLemonade scores 63.8 (B) on agent readiness against TextGen's 45.1 (E), and leads in 5 of 7 scored categories.\n\n### Can an agent call Lemonade and TextGen without installing anything?\n\nNo hosted endpoint is listed for Lemonade. No hosted endpoint is listed for TextGen.\n\n### Are Lemonade and TextGen open source?\n\nYes. Lemonade is open source (Apache 2.0. Each backend (llama.cpp, whisper.cpp, stable-diffusion.cpp, FastFlowLM and others) is downloaded separately under its own licence). TextGen is open source (AGPL-3.0).\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui.json, and with the fewest tokens: https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"lemonade\", \"b\": \"text-generation-webui\"}`. From a terminal: `anchor compare lemonade text-generation-webui`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/lemonade.json and https://www.anchorterminal.com/api/v1/tools/text-generation-webui.json\n\n## Other comparisons with Lemonade or TextGen\n\n- [AnythingLLM vs Lemonade](https://www.anchorterminal.com/compare/anythingllm-vs-lemonade.md)\n- [AnythingLLM vs TextGen](https://www.anchorterminal.com/compare/anythingllm-vs-text-generation-webui.md)\n- [Docker Model Runner vs Lemonade](https://www.anchorterminal.com/compare/docker-model-runner-vs-lemonade.md)\n- [Docker Model Runner vs TextGen](https://www.anchorterminal.com/compare/docker-model-runner-vs-text-generation-webui.md)\n- [Foundry Local vs Lemonade](https://www.anchorterminal.com/compare/foundry-local-vs-lemonade.md)\n- [Foundry Local vs TextGen](https://www.anchorterminal.com/compare/foundry-local-vs-text-generation-webui.md)\n- [Core vs Lemonade](https://www.anchorterminal.com/compare/ghost-core-vs-lemonade.md)\n- [Core vs TextGen](https://www.anchorterminal.com/compare/ghost-core-vs-text-generation-webui.md)\n- [GPT4All vs Lemonade](https://www.anchorterminal.com/compare/gpt4all-vs-lemonade.md)\n- [GPT4All vs TextGen](https://www.anchorterminal.com/compare/gpt4all-vs-text-generation-webui.md)\n- [Jan vs Lemonade](https://www.anchorterminal.com/compare/jan-vs-lemonade.md)\n- [Jan vs TextGen](https://www.anchorterminal.com/compare/jan-vs-text-generation-webui.md)\n- [Khoj vs Lemonade](https://www.anchorterminal.com/compare/khoj-vs-lemonade.md)\n- [Khoj vs TextGen](https://www.anchorterminal.com/compare/khoj-vs-text-generation-webui.md)\n- [KoboldCpp vs Lemonade](https://www.anchorterminal.com/compare/koboldcpp-vs-lemonade.md)\n- [KoboldCpp vs TextGen](https://www.anchorterminal.com/compare/koboldcpp-vs-text-generation-webui.md)\n- [Lemonade vs llama.cpp](https://www.anchorterminal.com/compare/lemonade-vs-llama-cpp.md)\n- [Lemonade vs LM Studio](https://www.anchorterminal.com/compare/lemonade-vs-lm-studio.md)\n- [Lemonade vs LocalAI](https://www.anchorterminal.com/compare/lemonade-vs-localai.md)\n- [Lemonade vs MLX LM](https://www.anchorterminal.com/compare/lemonade-vs-mlx-lm.md)\n- [Lemonade vs Ollama](https://www.anchorterminal.com/compare/lemonade-vs-ollama.md)\n- [Lemonade vs Open WebUI](https://www.anchorterminal.com/compare/lemonade-vs-open-webui.md)\n- [Lemonade vs screenpipe](https://www.anchorterminal.com/compare/lemonade-vs-screenpipe.md)\n- [llama.cpp vs TextGen](https://www.anchorterminal.com/compare/llama-cpp-vs-text-generation-webui.md)\n- [LM Studio vs TextGen](https://www.anchorterminal.com/compare/lm-studio-vs-text-generation-webui.md)\n- [LocalAI vs TextGen](https://www.anchorterminal.com/compare/localai-vs-text-generation-webui.md)\n- [MLX LM vs TextGen](https://www.anchorterminal.com/compare/mlx-lm-vs-text-generation-webui.md)\n- [Ollama vs TextGen](https://www.anchorterminal.com/compare/ollama-vs-text-generation-webui.md)\n- [Open WebUI vs TextGen](https://www.anchorterminal.com/compare/open-webui-vs-text-generation-webui.md)\n- [screenpipe vs TextGen](https://www.anchorterminal.com/compare/screenpipe-vs-text-generation-webui.md)\n- [Lemonade vs Underdog](https://www.anchorterminal.com/compare/lemonade-vs-underdog.md)\n- [TextGen vs Underdog](https://www.anchorterminal.com/compare/text-generation-webui-vs-underdog.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-10-09", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.4", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "Lemonade vs TextGen", "url": "" } ], "description": "Lemonade scores 63.8 (B) on agent readiness against TextGen's 45.1 (E), and leads in 5 of 7 scored categories. Both do local inference. Category scores, facts, verdicts and agent notes side by side.", "facts": [ "Lemonade B 63.8", "TextGen E 45.1", "scores" ], "h1": "Lemonade vs TextGen", "image": "https://www.anchorterminal.com/assets/og/compare-lemonade-vs-text-generation-webui.png", "path": "/compare/lemonade-vs-text-generation-webui", "published": "2026-10-01", "section": "tools", "title": "Lemonade vs TextGen for AI agents, B 63.8 vs E 45.1 | Anchor Terminal", "toc": null, "updated": "2026-10-09", "url": "https://www.anchorterminal.com/compare/lemonade-vs-text-generation-webui" }, "tokens": { "markdown": 2650, "slim": 580 }, "version": 1 }