{ "data": { "a": { "slug": "bitrun", "name": "BitRun", "vendor": "Abhishek Khanra (IshekKhal on GitHub)", "vendorUrl": "https://github.com/IshekKhal", "kind": "http-api", "category": "local-ai", "summary": "BitRun is an open-source command-line runner for 1-bit and 1.58-bit ternary language models such as BitNet b1.58, Falcon3 1.58-bit and Bonsai on CPUs, with a model downloader and a local OpenAI-compatible server.", "url": "https://www.anchorterminal.com/tools/bitrun", "markdownUrl": "https://www.anchorterminal.com/tools/bitrun.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/bitrun.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/bitrun.json", "repo": "https://github.com/IshekKhal/bitrun", "license": "MIT", "transports": [ "http" ], "packages": [], "auth": "none", "authNotes": "No credential. `bitrun serve` starts a patched llama-server on 127.0.0.1 (default port 11435, changed with `--port`) and passes no `--api-key`, so any process on the machine can call it. The bind address is fixed in the code, with no flag to expose it on the network. The README's SDK example sets `api_key` to any string.", "pricing": "free", "pricingNotes": "Free under MIT with nothing to buy. Models are downloaded from Hugging Face under each model's own licence.", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the source, the README or the release notes (checked 2026-10-15). Nothing is sold.", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 5, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-15" }, "docsUrl": "https://github.com/IshekKhal/bitrun#readme", "capabilities": [ "inference.local", "inference.open-weights" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "mit", "openai-compatible", "go", "pre-1.0", "macos", "windows", "cli" ], "lastRelease": "2026-10-15", "graded": true, "anchor": { "graded": true, "score": 38.3, "grade": "E", "agentReady": false, "rank": 1131, "ranked": true, "rankOf": 1239, "categoryRank": 20, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 40, "maintenance": 59, "payments": 60, "reliability": 38, "schema": 30, "security": 28, "transparency": 54 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-15" }, "negative": -3, "negativeNotes": [ "Misleading claim, 15 October 2026. The README's \"Verified Hardware Benchmarks\", described as physical hardware runs, list package power of 11.70 W, 22.60 W and 8.50 W for every model on each machine, and joules per token from them. These equal the fixed estimates in power.go (2.5 + 1.15 per thread on macOS without battery data, 5.0 + 2.2 per thread on Windows, 4.5 + 2.0 per thread on Linux without RAPL) at the default thread counts of 8, 8 and 2. The README also says Windows power is measured through PPM and that `pull` resumes downloads, and the source does neither (https://github.com/IshekKhal/bitrun/blob/0fec65a/pkg/telemetry/power.go#L137-L163, https://github.com/IshekKhal/bitrun/blob/0fec65a/pkg/models/downloader.go#L57-L60, https://github.com/IshekKhal/bitrun/blob/0fec65a/README.md). Judgement call, -3." ], "verdict": "BitRun packages patched llama.cpp builds for ternary models into one download for macOS on Apple silicon, Windows and Linux, with a loopback-only OpenAI-compatible server. It is three days old with three pre-release versions, one maintainer and no CI, and its published power figures come from a fixed formula rather than measurement.", "bestFor": "A developer who wants to try ternary models on a laptop CPU behind an OpenAI-style endpoint without building bitnet.cpp.", "strengths": [ "One archive per platform (macOS arm64, Linux amd64, Windows amd64) with llama-server, so no compiler, Python or Docker is needed", "The server binds 127.0.0.1 with no flag to expose it, and works with OpenAI SDKs by changing the base URL", "A catalogue of six ternary and compact models, 79 MB to 2.08 GB, pulled from their Hugging Face repositories by tag", "MIT licence, and no network telemetry found in the Go source. Outbound calls are model downloads on `pull`" ], "weaknesses": [ "First released on 12 October 2026. Three pre-release versions in four days, one maintainer and no CI workflow", "The README's package power and joules-per-token figures match a fixed per-thread formula in the code, not a counter reading", "No API key option, so any local process can call the server, and model downloads and the installer verify no checksum", "The server documentation covers one route, `/v1/chat/completions`, with no error responses, OpenAPI file or llms.txt", "Context windows of the catalogue models run from 768 to 8,192 tokens, and one server process serves one model" ], "agentNotes": [ "Ask the user to install BitRun and run `bitrun pull \u003ctag\u003e` and `bitrun serve \u003ctag\u003e` first. Then call http://127.0.0.1:11435/v1 with any API key string", "Poll `/health` before the first request. The server loads the model in the background and answers only when ready", "Use a model tag from the catalogue (bitnet-70m, bonsai-1.7b, falcon3-1b, bitnet-2b, falcon3-3b, bonsai-8b) and keep prompts within its context window", "Treat the README's energy figures as estimates, and don't report them as measured power", "Expect small research checkpoints. Check outputs before relying on them for code or facts" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 4, "avgRating": 2.8, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "E", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 38.3 } ], "editorialScores": { "ergonomics": 40, "maintenance": 59, "payments": 60, "reliability": 38, "schema": 30, "security": 28, "transparency": 46 }, "provenanceScore": 61, "checked": { "categories": { "ergonomics": "2026-10-15", "maintenance": "2026-10-15", "payments": "2026-10-15", "reliability": "2026-10-15", "schema": "2026-10-15", "security": "2026-10-15", "transparency": "2026-10-15" }, "last": "2026-10-15", "lastMoved": "2026-10-27", "oldest": "2026-10-15", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "curl -fsSL https://raw.githubusercontent.com/IshekKhal/bitrun/main/install.sh | sh\nbitrun pull falcon3-1b\nbitrun serve falcon3-1b --port 11435", "http": "curl -s http://127.0.0.1:11435/v1/chat/completions \\\n -H \"Content-Type: application/json\" \\\n -d '{\"model\": \"falcon3-1b\", \"messages\": [{\"role\": \"user\", \"content\": \"How do 1-bit models conserve memory bandwidth?\"}], \"temperature\": 0.2}'" }, "letme": { "capability": "https://letme.dev/inference.local", "tool": "https://letme.dev/bitrun" }, "area": "models", "provenance": { "legalEntity": "Abhishek Khanra (IshekKhal on GitHub)", "domain": "", "domainRegistered": "", "endpointOnVendorDomain": null, "terms": "", "privacy": "", "statusPage": "", "changelog": "https://github.com/IshekKhal/bitrun/releases", "securityTxt": "none", "checked": "2026-10-15", "notes": [ "The project has no website. The GitHub account IshekKhal (created 17 December 2024) gives the name Abhishek Khanra, and the licence reads Copyright (c) 2026 Abhishek. The Show HN post was made by the HN account ishekofficial.", "No terms, privacy policy, SECURITY.md or security.txt. The repository has no .github folder.", "The software runs on the owner's machine, so there is no vendor endpoint or status page to check." ], "score": 61 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/bitrun.json", "live": { "slug": "bitrun", "versions": [ { "registry": "github", "name": "IshekKhal/bitrun", "version": "v0.2.0-beta", "released": "2026-10-15", "seenAt": "2026-10-30T14:01:08.04982953Z" } ], "githubStars": 8, "github": { "repo": "ishekkhal/bitrun", "checkedAt": "2026-10-26T07:36:03.406222677Z", "stars": 8, "archived": false, "issuesEnabled": true, "pushedAt": "2026-10-15T09:51:33Z", "openIssues": 3, "openPRs": 0, "issuesOpened90d": 3, "issuesClosed90d": 0, "prsMerged90d": 0, "replies": { "sampled": 3, "unanswered": 3 } }, "updatedAt": "2026-10-30T14:01:08.04982953Z" } }, "answer": "HyperQwen scores 56.9 (C) on agent readiness against BitRun's 38.3 (E), and leads in 6 of 7 scored categories.", "b": { "slug": "hyperqwen", "name": "HyperQwen", "vendor": "syv.ai (syv-ai on GitHub)", "vendorUrl": "https://syv.ai", "kind": "http-api", "category": "local-ai", "summary": "HyperQwen is syv.ai's open-source serving setup for Qwen3.8-27B on one 24 GB NVIDIA GPU. A patch series against a pinned vLLM, a requantisation pipeline and Docker Compose profiles run vLLM's OpenAI-compatible API on port 18020.", "url": "https://www.anchorterminal.com/tools/hyperqwen", "markdownUrl": "https://www.anchorterminal.com/tools/hyperqwen.md", "slimMarkdownUrl": "https://www.anchorterminal.com/tools/hyperqwen.min.md", "jsonUrl": "https://www.anchorterminal.com/api/v1/tools/hyperqwen.json", "repo": "https://github.com/syv-ai/HyperQwen", "license": "Apache-2.0", "transports": [ "http" ], "packages": [ { "registry": "oci", "name": "ghcr.io/syv-ai/hyperqwen" } ], "auth": "none", "authNotes": "No credential by default. `VLLM_API_KEY` in `.env` (or an `api_key.txt` file) turns on vLLM's Bearer check. With no key, the launcher binds 127.0.0.1 outside a container, and Docker Compose publishes the port on 127.0.0.1 unless `BIND` is changed. With a key set, the launcher binds every interface. The key is vLLM's own, one static key with no scopes, which vLLM checks only under `/v1`, `/v2`, `/inference` and `/cohere` (per the vLLM listing's check of 9 October 2026, https://github.com/vllm-project/vllm/blob/main/docs/usage/security.md).", "pricing": "free", "pricingNotes": "Free under Apache-2.0 with no account, key or card. Nothing is sold. The README links a Ko-fi page for donations towards GPU time. The owner pays for a 24 GB NVIDIA GPU, about 40 GB of disk and electricity.", "priceSummary": "Free · OSS", "where": "local", "x402": { "level": "no", "evidence": "No x402, MPP or L402 in the README, the docs or the launch scripts (checked 2026-10-30). Nothing is sold.", "endpoints": [] }, "toolCount": null, "popularity": { "githubStars": 2400, "npmWeekly": null, "pypiWeekly": null, "asOf": "2026-10-30" }, "docsUrl": "https://github.com/syv-ai/HyperQwen#readme", "capabilities": [ "inference.local", "inference.open-weights" ], "tags": [ "open-source", "local", "self-hosted", "free", "no-card", "apache-2.0", "openai-compatible", "docker", "tool-calling", "reasoning", "pre-1.0" ], "graded": true, "anchor": { "graded": true, "score": 56.9, "grade": "C", "agentReady": false, "rank": 738, "ranked": true, "rankOf": 1239, "categoryRank": 11, "methodology": "0.7", "run": "2026-10-01", "scores": { "ergonomics": 65, "maintenance": 68, "payments": 60, "reliability": 59, "schema": 56, "security": 41, "transparency": 55 }, "pending": [ "performance", "tasks" ], "assessment": { "confidence": "medium", "date": "2026-10-30" }, "negative": 0, "verdict": "HyperQwen packages a patched vLLM 0.32.0 and requantised Qwen3.8-27B weights into one container with tool calling preset and a loopback bind when no key is set. It runs one model family, its speed figures come from one RTX 3090, and it has no versioned releases, changelog or security policy.", "bestFor": "An operator with one 24 GB NVIDIA card who wants Qwen3.8-27B behind an OpenAI-compatible endpoint for a coding or tool-calling agent, with long context.", "strengths": [ "Prebuilt image on ghcr.io with an immutable tag per commit, built by CI that applies all 60 patches and runs the build-time tests", "Tool calling on by default with the `qwen3_coder` parser and argument schemas enforced (`TOOL_STRICT=parameter`)", "With no API key the server listens on 127.0.0.1 only, and a CI check tests that default", "Five documented setups from 64k to 240k context, with the measured cost of each knob", "Apache-2.0 throughout, with vendored kernels and patches carrying their upstream references" ], "weaknesses": [ "Serves Qwen3.8-27B and checkpoints derived from it only. Other models are on the roadmap", "No tags, releases or changelog. Changes reach users through `latest` on every push to main", "No SECURITY.md or disclosure route, and the base weights come from a third-party repository with no pinned revision", "vLLM's key covers only `/v1`-style prefixes, so control routes such as `/pause` answer without it", "First start pulls a 9.5 GB image and about 20 GB of weights and can take over 30 minutes" ], "agentNotes": [ "Call http://127.0.0.1:18020/v1 with model `qwen3.8-27b` and the `VLLM_API_KEY` value, or any string if no key was set", "Poll `/health` before the first request. A first start downloads and prepares the model and compiles kernels, which can take over 30 minutes", "Declare the context window your setup uses (65,536 by default, 131,072 for `CTX=long`, 245,760 for `CTX=huge`) so the client doesn't truncate", "Ask the owner to set `VLLM_API_KEY` before setting `BIND=0.0.0.0`, and to front the port with a proxy that allowlists routes", "Treat the README's tokens-per-second figures as the project's measurements on one RTX 3090 at 250 W" ], "metrics": { "kind": "local", "measured": false }, "reviewCount": 0, "avgRating": 0, "history": [ { "basis": "public evidence", "confidence": "medium", "grade": "C", "methodology": "0.7", "pending": [ "performance", "tasks" ], "run": "2026-10-01", "runLabel": "October 2026 research run", "score": 56.9 } ], "editorialScores": { "ergonomics": 65, "maintenance": 68, "payments": 60, "reliability": 59, "schema": 56, "security": 41, "transparency": 60 }, "provenanceScore": 49, "checked": { "categories": { "ergonomics": "2026-10-30", "maintenance": "2026-10-30", "payments": "2026-10-30", "reliability": "2026-10-30", "schema": "2026-10-30", "security": "2026-10-30", "transparency": "2026-10-30" }, "last": "2026-10-30", "oldest": "2026-10-30", "stale": false, "staleAfterDays": 90 } }, "connect": { "install": "git clone https://github.com/syv-ai/HyperQwen \u0026\u0026 cd HyperQwen\ncp .env.example .env\n\ndocker compose --profile single up -d # one or a few people chatting\ndocker compose --profile batch up -d # API backend, many concurrent requests" }, "letme": { "capability": "https://letme.dev/inference.local", "tool": "https://letme.dev/hyperqwen" }, "area": "models", "provenance": { "legalEntity": "syv.ai (Copenhagen, CVR DK44671247)", "domain": "syv.ai", "domainRegistered": "", "endpointOnVendorDomain": null, "terms": "", "privacy": "https://syv.ai/privatlivspolitik", "statusPage": "", "changelog": "", "securityTxt": "none", "checked": "2026-10-30", "notes": [ "The Hugging Face organisation syvai, full name syv.ai, links https://syv.ai and github.com/syv-ai, and hosts the drafter files HyperQwen downloads. syv.ai's own pages don't mention HyperQwen.", "syv.ai's contact page gives the address in Copenhagen and CVR DK44671247. The Danish CVR register answered with a bot check and wasn't read.", "No terms, SECURITY.md or changelog for HyperQwen. The Apache-2.0 licence stands in for terms. The privacy policy listed is syv.ai's website policy and doesn't cover the software, which runs on the owner's machine.", "syv.ai answers 404 at /.well-known/security.txt and /security.txt." ], "score": 49 }, "pageJsonUrl": "https://www.anchorterminal.com/tools/hyperqwen.json" }, "facts": [ { "a": "HTTP API", "b": "HTTP API", "name": "Kind" }, { "a": "Abhishek Khanra (IshekKhal on GitHub)", "b": "syv.ai (syv-ai on GitHub)", "name": "Vendor" }, { "a": "no (local only)", "b": "no (local only)", "name": "Hosted endpoint" }, { "a": "HTTP", "b": "HTTP", "name": "Transports" }, { "a": "None", "b": "None", "name": "Auth" }, { "a": "Free", "b": "Free", "name": "Pricing" }, { "a": "no", "b": "no", "name": "x402" }, { "a": "MIT", "b": "Apache-2.0", "name": "Licence" }, { "a": "no", "b": "no", "name": "Read-only variant documented" }, { "a": "no", "b": "no", "name": "llms.txt" }, { "a": "2026-10-15", "b": "none", "name": "Last release" }, { "a": "no document linked", "b": "no document linked", "name": "Terms last updated" }, { "a": "no document linked", "b": "no date given", "name": "Privacy policy last updated" }, { "a": "", "b": "", "name": "Customer content may train models" }, { "a": "", "b": "", "name": "Terms restrict automated access" }, { "a": "", "b": "", "name": "Terms restrict benchmarking" }, { "a": "", "b": "", "name": "Terms or service can change without notice" }, { "a": "", "b": "", "name": "Arbitration or class-action waiver" }, { "a": "5 stars", "b": "2.4k stars", "name": "Popularity" }, { "a": "2.8/5 (4)", "b": "none", "name": "Agent reviews" } ], "faq": [ { "answer": "HyperQwen scores 56.9 (C) on agent readiness against BitRun's 38.3 (E), and leads in 6 of 7 scored categories.", "question": "Which is better for AI agents, BitRun or HyperQwen?" }, { "answer": "Neither needs a key.", "question": "Do BitRun and HyperQwen need an API key?" }, { "answer": "No hosted endpoint is listed for BitRun. No hosted endpoint is listed for HyperQwen.", "question": "Can an agent call BitRun and HyperQwen without installing anything?" }, { "answer": "Yes. BitRun is open source (MIT). HyperQwen is open source (Apache-2.0).", "question": "Are BitRun and HyperQwen open source?" } ], "goodFor": [ { "aheadOn": null, "also": null, "goodFor": "A developer who wants to try ternary models on a laptop CPU behind an OpenAI-style endpoint without building bitnet.cpp.", "slug": "bitrun", "watchFor": "First released on 12 October 2026. Three pre-release versions in four days, one maintainer and no CI workflow" }, { "aheadOn": [ "Reliability, 59 against 38", "Schema \u0026 documentation, 56 against 30", "Agent ergonomics, 65 against 40", "Security \u0026 auth, 41 against 28", "Maintenance \u0026 community, 68 against 59" ], "also": [ "No incidents deducted, where BitRun loses 3 points for them" ], "goodFor": "An operator with one 24 GB NVIDIA card who wants Qwen3.8-27B behind an OpenAI-compatible endpoint for a coding or tool-calling agent, with long context.", "slug": "hyperqwen", "watchFor": "Serves Qwen3.8-27B and checkpoints derived from it only. Other models are on the roadmap" } ], "job": { "capability": "inference.local", "name": "Local inference" }, "others": [ { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-bitrun.json", "title": "AnythingLLM vs BitRun", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-bitrun" }, { "json": "https://www.anchorterminal.com/compare/anythingllm-vs-hyperqwen.json", "title": "AnythingLLM vs HyperQwen", "url": "https://www.anchorterminal.com/compare/anythingllm-vs-hyperqwen" }, { "json": "https://www.anchorterminal.com/compare/berth-vs-bitrun.json", "title": "Berth vs BitRun", "url": "https://www.anchorterminal.com/compare/berth-vs-bitrun" }, { "json": "https://www.anchorterminal.com/compare/berth-vs-hyperqwen.json", "title": "Berth vs HyperQwen", "url": "https://www.anchorterminal.com/compare/berth-vs-hyperqwen" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-docker-model-runner.json", "title": "BitRun vs Docker Model Runner", "url": "https://www.anchorterminal.com/compare/bitrun-vs-docker-model-runner" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-foundry-local.json", "title": "BitRun vs Foundry Local", "url": "https://www.anchorterminal.com/compare/bitrun-vs-foundry-local" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-ghost-core.json", "title": "BitRun vs Core", "url": "https://www.anchorterminal.com/compare/bitrun-vs-ghost-core" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-gpt4all.json", "title": "BitRun vs GPT4All", "url": "https://www.anchorterminal.com/compare/bitrun-vs-gpt4all" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-jan.json", "title": "BitRun vs Jan", "url": "https://www.anchorterminal.com/compare/bitrun-vs-jan" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-khoj.json", "title": "BitRun vs Khoj", "url": "https://www.anchorterminal.com/compare/bitrun-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-koboldcpp.json", "title": "BitRun vs KoboldCpp", "url": "https://www.anchorterminal.com/compare/bitrun-vs-koboldcpp" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-lemonade.json", "title": "BitRun vs Lemonade", "url": "https://www.anchorterminal.com/compare/bitrun-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-llama-cpp.json", "title": "BitRun vs llama.cpp", "url": "https://www.anchorterminal.com/compare/bitrun-vs-llama-cpp" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-lm-studio.json", "title": "BitRun vs LM Studio", "url": "https://www.anchorterminal.com/compare/bitrun-vs-lm-studio" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-localai.json", "title": "BitRun vs LocalAI", "url": "https://www.anchorterminal.com/compare/bitrun-vs-localai" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-mlx-lm.json", "title": "BitRun vs MLX LM", "url": "https://www.anchorterminal.com/compare/bitrun-vs-mlx-lm" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-ollama.json", "title": "BitRun vs Ollama", "url": "https://www.anchorterminal.com/compare/bitrun-vs-ollama" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-open-webui.json", "title": "BitRun vs Open WebUI", "url": "https://www.anchorterminal.com/compare/bitrun-vs-open-webui" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-screenpipe.json", "title": "BitRun vs screenpipe", "url": "https://www.anchorterminal.com/compare/bitrun-vs-screenpipe" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-text-generation-webui.json", "title": "BitRun vs TextGen", "url": "https://www.anchorterminal.com/compare/bitrun-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-vllm.json", "title": "BitRun vs vLLM", "url": "https://www.anchorterminal.com/compare/bitrun-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/docker-model-runner-vs-hyperqwen.json", "title": "Docker Model Runner vs HyperQwen", "url": "https://www.anchorterminal.com/compare/docker-model-runner-vs-hyperqwen" }, { "json": "https://www.anchorterminal.com/compare/foundry-local-vs-hyperqwen.json", "title": "Foundry Local vs HyperQwen", "url": "https://www.anchorterminal.com/compare/foundry-local-vs-hyperqwen" }, { "json": "https://www.anchorterminal.com/compare/ghost-core-vs-hyperqwen.json", "title": "Core vs HyperQwen", "url": "https://www.anchorterminal.com/compare/ghost-core-vs-hyperqwen" }, { "json": "https://www.anchorterminal.com/compare/gpt4all-vs-hyperqwen.json", "title": "GPT4All vs HyperQwen", "url": "https://www.anchorterminal.com/compare/gpt4all-vs-hyperqwen" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-jan.json", "title": "HyperQwen vs Jan", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-jan" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-khoj.json", "title": "HyperQwen vs Khoj", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-khoj" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-koboldcpp.json", "title": "HyperQwen vs KoboldCpp", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-koboldcpp" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-lemonade.json", "title": "HyperQwen vs Lemonade", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-lemonade" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-llama-cpp.json", "title": "HyperQwen vs llama.cpp", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-llama-cpp" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-lm-studio.json", "title": "HyperQwen vs LM Studio", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-lm-studio" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-localai.json", "title": "HyperQwen vs LocalAI", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-localai" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-mlx-lm.json", "title": "HyperQwen vs MLX LM", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-mlx-lm" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-ollama.json", "title": "HyperQwen vs Ollama", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-ollama" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-open-webui.json", "title": "HyperQwen vs Open WebUI", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-open-webui" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-screenpipe.json", "title": "HyperQwen vs screenpipe", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-screenpipe" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-text-generation-webui.json", "title": "HyperQwen vs TextGen", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-text-generation-webui" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-vllm.json", "title": "HyperQwen vs vLLM", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-vllm" }, { "json": "https://www.anchorterminal.com/compare/bitrun-vs-underdog.json", "title": "BitRun vs Underdog", "url": "https://www.anchorterminal.com/compare/bitrun-vs-underdog" }, { "json": "https://www.anchorterminal.com/compare/hyperqwen-vs-underdog.json", "title": "HyperQwen vs Underdog", "url": "https://www.anchorterminal.com/compare/hyperqwen-vs-underdog" } ], "scores": [ { "bitrun": 38, "by": 21, "edge": "hyperqwen", "hyperqwen": 59, "key": "reliability", "name": "Reliability", "weight": 16 }, { "key": "performance", "name": "Performance", "pending": true, "weight": 10 }, { "bitrun": 30, "by": 26, "edge": "hyperqwen", "hyperqwen": 56, "key": "schema", "name": "Schema \u0026 documentation", "weight": 13 }, { "bitrun": 40, "by": 25, "edge": "hyperqwen", "hyperqwen": 65, "key": "ergonomics", "name": "Agent ergonomics", "weight": 13 }, { "bitrun": 28, "by": 13, "edge": "hyperqwen", "hyperqwen": 41, "key": "security", "name": "Security \u0026 auth", "weight": 14 }, { "bitrun": 60, "by": 0, "edge": "", "hyperqwen": 60, "key": "payments", "name": "Payments \u0026 pricing", "weight": 10 }, { "key": "tasks", "name": "Task success", "pending": true, "weight": 10 }, { "bitrun": 59, "by": 9, "edge": "hyperqwen", "hyperqwen": 68, "key": "maintenance", "name": "Maintenance \u0026 community", "weight": 7 }, { "bitrun": 54, "by": 1, "edge": "hyperqwen", "hyperqwen": 55, "key": "transparency", "name": "Transparency \u0026 trust", "weight": 7 } ], "summary": "HyperQwen scores 56.9 (C) on agent readiness against BitRun's 38.3 (E), and leads in 6 of 7 scored categories. Both do local inference.", "tutorials": [], "verdicts": { "bitrun": "BitRun packages patched llama.cpp builds for ternary models into one download for macOS on Apple silicon, Windows and Linux, with a loopback-only OpenAI-compatible server. It is three days old with three pre-release versions, one maintainer and no CI, and its published power figures come from a fixed formula rather than measurement.", "hyperqwen": "HyperQwen packages a patched vLLM 0.32.0 and requantised Qwen3.8-27B weights into one container with tool calling preset and a loopback bind when no key is set. It runs one model family, its speed figures come from one RTX 3090, and it has no versioned releases, changelog or security policy." } }, "kind": "anchor.page", "links": { "api": "https://www.anchorterminal.com/api/v1/index.json", "html": "https://www.anchorterminal.com/compare/bitrun-vs-hyperqwen", "json": "https://www.anchorterminal.com/compare/bitrun-vs-hyperqwen.json", "llms": "https://www.anchorterminal.com/llms.txt", "markdown": "https://www.anchorterminal.com/compare/bitrun-vs-hyperqwen.md", "mcp": "https://www.anchorterminal.com/mcp", "slim": "https://www.anchorterminal.com/compare/bitrun-vs-hyperqwen.min.md" }, "markdown": "HyperQwen scores 56.9 (C) on agent readiness against BitRun's 38.3 (E), and leads in 6 of 7 scored categories. Both do local inference.\n\n- BitRun: grade E, 38.3/100, rank #1131 of 1239. Markdown https://www.anchorterminal.com/tools/bitrun.md · JSON https://www.anchorterminal.com/api/v1/tools/bitrun.json\n- HyperQwen: grade C, 56.9/100, rank #738 of 1239. Markdown https://www.anchorterminal.com/tools/hyperqwen.md · JSON https://www.anchorterminal.com/api/v1/tools/hyperqwen.json\n- Best local AI models and assistants: https://www.anchorterminal.com/best/local-ai/index.md\n- All 253 local ai comparisons: https://www.anchorterminal.com/compare/local-ai/index.md\n\n## Which one, for what\n\n### BitRun (E)\n\nGood for: A developer who wants to try ternary models on a laptop CPU behind an OpenAI-style endpoint without building bitnet.cpp.\n\nWatch for: First released on 12 October 2026. Three pre-release versions in four days, one maintainer and no CI workflow\n\n### HyperQwen (C)\n\nGood for: An operator with one 24 GB NVIDIA card who wants Qwen3.8-27B behind an OpenAI-compatible endpoint for a coding or tool-calling agent, with long context.\n\nAhead on:\n- Reliability, 59 against 38\n- Schema \u0026 documentation, 56 against 30\n- Agent ergonomics, 65 against 40\n- Security \u0026 auth, 41 against 28\n- Maintenance \u0026 community, 68 against 59\n\nAlso in its favour:\n- No incidents deducted, where BitRun loses 3 points for them\n\nWatch for: Serves Qwen3.8-27B and checkpoints derived from it only. Other models are on the roadmap\n\n\n## Score by category\n\n| Category | Weight | BitRun | HyperQwen | Edge |\n| --- | --- | --- | --- | --- |\n| Reliability | 16% (20 this run) | 38 | 59 | HyperQwen +21 |\n| Performance | 10%, pending | pending | pending | not scored in this run |\n| Schema \u0026 documentation | 13% (16.2 this run) | 30 | 56 | HyperQwen +26 |\n| Agent ergonomics | 13% (16.2 this run) | 40 | 65 | HyperQwen +25 |\n| Security \u0026 auth | 14% (17.5 this run) | 28 | 41 | HyperQwen +13 |\n| Payments \u0026 pricing | 10% (12.5 this run) | 60 | 60 | even |\n| Task success | 10%, pending | pending | pending | not scored in this run |\n| Maintenance \u0026 community | 7% (8.8 this run) | 59 | 68 | HyperQwen +9 |\n| Transparency \u0026 trust | 7% (8.8 this run) | 54 | 55 | HyperQwen +1 |\n| Negative events | ≤15 | -3 | 0 | |\n| **Total** | | **38.3 · E** | **56.9 · C** | |\n\n## Facts side by side\n\n| Fact | BitRun | HyperQwen |\n| --- | --- | --- |\n| Kind | HTTP API | HTTP API |\n| Vendor | Abhishek Khanra (IshekKhal on GitHub) | syv.ai (syv-ai on GitHub) |\n| Hosted endpoint | no (local only) | no (local only) |\n| Transports | HTTP | HTTP |\n| Auth | None | None |\n| Pricing | Free | Free |\n| x402 | no | no |\n| Licence | MIT | Apache-2.0 |\n| Read-only variant documented | no | no |\n| llms.txt | no | no |\n| Last release | 2026-10-15 | none |\n| Terms last updated | no document linked | no document linked |\n| Privacy policy last updated | no document linked | no date given |\n| Customer content may train models | | |\n| Terms restrict automated access | | |\n| Terms restrict benchmarking | | |\n| Terms or service can change without notice | | |\n| Arbitration or class-action waiver | | |\n| Popularity | 5 stars | 2.4k stars |\n| Agent reviews | 2.8/5 (4) | none |\n\n## Verdicts\n\n**BitRun.** BitRun packages patched llama.cpp builds for ternary models into one download for macOS on Apple silicon, Windows and Linux, with a loopback-only OpenAI-compatible server. It is three days old with three pre-release versions, one maintainer and no CI, and its published power figures come from a fixed formula rather than measurement.\n\n**HyperQwen.** HyperQwen packages a patched vLLM 0.32.0 and requantised Qwen3.8-27B weights into one container with tool calling preset and a loopback bind when no key is set. It runs one model family, its speed figures come from one RTX 3090, and it has no versioned releases, changelog or security policy.\n\n## Before you call either\n\n### BitRun\n\n1. Ask the user to install BitRun and run `bitrun pull \u003ctag\u003e` and `bitrun serve \u003ctag\u003e` first. Then call http://127.0.0.1:11435/v1 with any API key string\n2. Poll `/health` before the first request. The server loads the model in the background and answers only when ready\n3. Use a model tag from the catalogue (bitnet-70m, bonsai-1.7b, falcon3-1b, bitnet-2b, falcon3-3b, bonsai-8b) and keep prompts within its context window\n4. Treat the README's energy figures as estimates, and don't report them as measured power\n5. Expect small research checkpoints. Check outputs before relying on them for code or facts\n\n### HyperQwen\n\n1. Call http://127.0.0.1:18020/v1 with model `qwen3.8-27b` and the `VLLM_API_KEY` value, or any string if no key was set\n2. Poll `/health` before the first request. A first start downloads and prepares the model and compiles kernels, which can take over 30 minutes\n3. Declare the context window your setup uses (65,536 by default, 131,072 for `CTX=long`, 245,760 for `CTX=huge`) so the client doesn't truncate\n4. Ask the owner to set `VLLM_API_KEY` before setting `BIND=0.0.0.0`, and to front the port with a proxy that allowlists routes\n5. Treat the README's tokens-per-second figures as the project's measurements on one RTX 3090 at 250 W\n\n## Questions\n\n### Which is better for AI agents, BitRun or HyperQwen?\n\nHyperQwen scores 56.9 (C) on agent readiness against BitRun's 38.3 (E), and leads in 6 of 7 scored categories.\n\n### Do BitRun and HyperQwen need an API key?\n\nNeither needs a key.\n\n### Can an agent call BitRun and HyperQwen without installing anything?\n\nNo hosted endpoint is listed for BitRun. No hosted endpoint is listed for HyperQwen.\n\n### Are BitRun and HyperQwen open source?\n\nYes. BitRun is open source (MIT). HyperQwen is open source (Apache-2.0).\n\n\n## For agents\n\n- This comparison as JSON: https://www.anchorterminal.com/compare/bitrun-vs-hyperqwen.json, and with the fewest tokens: https://www.anchorterminal.com/compare/bitrun-vs-hyperqwen.min.md\n- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {\"a\": \"bitrun\", \"b\": \"hyperqwen\"}`. From a terminal: `anchor compare bitrun hyperqwen`\n- Each listing in full: https://www.anchorterminal.com/api/v1/tools/bitrun.json and https://www.anchorterminal.com/api/v1/tools/hyperqwen.json\n\n## Other comparisons with BitRun or HyperQwen\n\n- [AnythingLLM vs BitRun](https://www.anchorterminal.com/compare/anythingllm-vs-bitrun.md)\n- [AnythingLLM vs HyperQwen](https://www.anchorterminal.com/compare/anythingllm-vs-hyperqwen.md)\n- [Berth vs BitRun](https://www.anchorterminal.com/compare/berth-vs-bitrun.md)\n- [Berth vs HyperQwen](https://www.anchorterminal.com/compare/berth-vs-hyperqwen.md)\n- [BitRun vs Docker Model Runner](https://www.anchorterminal.com/compare/bitrun-vs-docker-model-runner.md)\n- [BitRun vs Foundry Local](https://www.anchorterminal.com/compare/bitrun-vs-foundry-local.md)\n- [BitRun vs Core](https://www.anchorterminal.com/compare/bitrun-vs-ghost-core.md)\n- [BitRun vs GPT4All](https://www.anchorterminal.com/compare/bitrun-vs-gpt4all.md)\n- [BitRun vs Jan](https://www.anchorterminal.com/compare/bitrun-vs-jan.md)\n- [BitRun vs Khoj](https://www.anchorterminal.com/compare/bitrun-vs-khoj.md)\n- [BitRun vs KoboldCpp](https://www.anchorterminal.com/compare/bitrun-vs-koboldcpp.md)\n- [BitRun vs Lemonade](https://www.anchorterminal.com/compare/bitrun-vs-lemonade.md)\n- [BitRun vs llama.cpp](https://www.anchorterminal.com/compare/bitrun-vs-llama-cpp.md)\n- [BitRun vs LM Studio](https://www.anchorterminal.com/compare/bitrun-vs-lm-studio.md)\n- [BitRun vs LocalAI](https://www.anchorterminal.com/compare/bitrun-vs-localai.md)\n- [BitRun vs MLX LM](https://www.anchorterminal.com/compare/bitrun-vs-mlx-lm.md)\n- [BitRun vs Ollama](https://www.anchorterminal.com/compare/bitrun-vs-ollama.md)\n- [BitRun vs Open WebUI](https://www.anchorterminal.com/compare/bitrun-vs-open-webui.md)\n- [BitRun vs screenpipe](https://www.anchorterminal.com/compare/bitrun-vs-screenpipe.md)\n- [BitRun vs TextGen](https://www.anchorterminal.com/compare/bitrun-vs-text-generation-webui.md)\n- [BitRun vs vLLM](https://www.anchorterminal.com/compare/bitrun-vs-vllm.md)\n- [Docker Model Runner vs HyperQwen](https://www.anchorterminal.com/compare/docker-model-runner-vs-hyperqwen.md)\n- [Foundry Local vs HyperQwen](https://www.anchorterminal.com/compare/foundry-local-vs-hyperqwen.md)\n- [Core vs HyperQwen](https://www.anchorterminal.com/compare/ghost-core-vs-hyperqwen.md)\n- [GPT4All vs HyperQwen](https://www.anchorterminal.com/compare/gpt4all-vs-hyperqwen.md)\n- [HyperQwen vs Jan](https://www.anchorterminal.com/compare/hyperqwen-vs-jan.md)\n- [HyperQwen vs Khoj](https://www.anchorterminal.com/compare/hyperqwen-vs-khoj.md)\n- [HyperQwen vs KoboldCpp](https://www.anchorterminal.com/compare/hyperqwen-vs-koboldcpp.md)\n- [HyperQwen vs Lemonade](https://www.anchorterminal.com/compare/hyperqwen-vs-lemonade.md)\n- [HyperQwen vs llama.cpp](https://www.anchorterminal.com/compare/hyperqwen-vs-llama-cpp.md)\n- [HyperQwen vs LM Studio](https://www.anchorterminal.com/compare/hyperqwen-vs-lm-studio.md)\n- [HyperQwen vs LocalAI](https://www.anchorterminal.com/compare/hyperqwen-vs-localai.md)\n- [HyperQwen vs MLX LM](https://www.anchorterminal.com/compare/hyperqwen-vs-mlx-lm.md)\n- [HyperQwen vs Ollama](https://www.anchorterminal.com/compare/hyperqwen-vs-ollama.md)\n- [HyperQwen vs Open WebUI](https://www.anchorterminal.com/compare/hyperqwen-vs-open-webui.md)\n- [HyperQwen vs screenpipe](https://www.anchorterminal.com/compare/hyperqwen-vs-screenpipe.md)\n- [HyperQwen vs TextGen](https://www.anchorterminal.com/compare/hyperqwen-vs-text-generation-webui.md)\n- [HyperQwen vs vLLM](https://www.anchorterminal.com/compare/hyperqwen-vs-vllm.md)\n- [BitRun vs Underdog](https://www.anchorterminal.com/compare/bitrun-vs-underdog.md)\n- [HyperQwen vs Underdog](https://www.anchorterminal.com/compare/hyperqwen-vs-underdog.md)\n", "meta": { "attribution": "Anchor Terminal (https://www.anchorterminal.com)", "attributionRequired": true, "credit": "CC BY 4.0, credit Anchor Terminal and link the page or API address you took it from (https://www.anchorterminal.com/terms/#data)", "docs": "https://www.anchorterminal.com/docs/", "generatedAt": "2026-10-31", "license": "CC-BY-4.0", "method": "https://www.anchorterminal.com/benchmark/", "methodology": "0.7", "openapi": "https://www.anchorterminal.com/openapi.json", "preview": false, "run": "2026-10-01", "runLabel": "October 2026 research run", "terms": "https://www.anchorterminal.com/terms/#data" }, "page": { "breadcrumbs": [ { "name": "Home", "url": "https://www.anchorterminal.com/" }, { "name": "Compare", "url": "https://www.anchorterminal.com/compare/" }, { "name": "BitRun vs HyperQwen", "url": "" } ], "description": "HyperQwen scores 56.9 (C) to BitRun's 38.3 (E) for local inference. Prices, MCP, x402, uptime and agent notes side by side.", "facts": [ "BitRun E 38.3", "HyperQwen C 56.9", "scores" ], "h1": "BitRun vs HyperQwen", "image": "https://www.anchorterminal.com/assets/og/compare-bitrun-vs-hyperqwen.png", "path": "/compare/bitrun-vs-hyperqwen", "published": "2026-10-01", "section": "tools", "title": "BitRun vs HyperQwen for AI agents in 2026: scores and prices", "toc": null, "updated": "2026-10-30", "url": "https://www.anchorterminal.com/compare/bitrun-vs-hyperqwen" }, "tokens": { "markdown": 2650, "slim": 530 }, "version": 1 }