# Foundry Local vs LocalAI

> LocalAI scores 68 (B) on agent readiness against Foundry Local's 60.5 (C), and leads in 4 of 7 scored categories. Foundry Local leads on maintenance & community and transparency & trust. Both do local inference. Category scores, facts, verdicts and agent notes side by side.

- Canonical: https://www.anchorterminal.com/compare/foundry-local-vs-localai
- Markdown: https://www.anchorterminal.com/compare/foundry-local-vs-localai.md (~2,700 tokens)
- Slim: https://www.anchorterminal.com/compare/foundry-local-vs-localai.min.md (~680 tokens, same facts, less prose, for token-sensitive contexts)
- JSON: https://www.anchorterminal.com/compare/foundry-local-vs-localai.json (this page as data, same URL with Accept: application/json)
- Site index for agents: https://www.anchorterminal.com/llms.txt (full text: https://www.anchorterminal.com/llms-full.txt)
- API: https://www.anchorterminal.com/api/v1/index.json
- Updated: 2026-10-09

LocalAI scores 68 (B) on agent readiness against Foundry Local's 60.5 (C), and leads in 4 of 7 scored categories. Foundry Local leads on maintenance & community and transparency & trust. Both do local inference.

- Foundry Local: grade C, 60.5/100, rank #461 of 842. Markdown https://www.anchorterminal.com/tools/foundry-local.md · JSON https://www.anchorterminal.com/api/v1/tools/foundry-local.json
- LocalAI: grade B, 68/100, rank #216 of 842. Markdown https://www.anchorterminal.com/tools/localai.md · JSON https://www.anchorterminal.com/api/v1/tools/localai.json

## Which one, for what

### Foundry Local (C)

Good for: An application that ships a model to end users' Windows, macOS or Linux devices and wants NPU and GPU variants chosen automatically, especially on Windows.

Ahead on:
- Maintenance & community, 88 against 80
- Transparency & trust, 72 against 47

Also in its favour:
- No key needed to call it
- No incidents deducted, where LocalAI loses 3 points for them

Watch for: The local server takes no credential, and its routes include model load and unload and `POST /shutdown`

### LocalAI (B)

Good for: An owner who wants one local server for chat, embeddings, reranking, speech, images and video behind APIs their existing OpenAI, Anthropic or Ollama clients already speak, on almost any accelerator.

Ahead on:
- Reliability, 84 against 68
- Schema & documentation, 81 against 53
- Agent ergonomics, 71 against 61
- Security & auth, 62 against 39

Also in its favour:
- Runs on your own machine

Watch for: No authentication by default. Loopback, LAN and VPN binds answer every caller, and keys set by environment variable grant full admin


## Score by category

| Category | Weight | Foundry Local | LocalAI | Edge |
| --- | --- | --- | --- | --- |
| Reliability | 16% (20 this run) | 68 | 84 | LocalAI +16 |
| Performance | 10%, pending | pending | pending | not scored in this run |
| Schema & documentation | 13% (16.2 this run) | 53 | 81 | LocalAI +28 |
| Agent ergonomics | 13% (16.2 this run) | 61 | 71 | LocalAI +10 |
| Security & auth | 14% (17.5 this run) | 39 | 62 | LocalAI +23 |
| Payments & pricing | 10% (12.5 this run) | 60 | 60 | even |
| Task success | 10%, pending | pending | pending | not scored in this run |
| Maintenance & community | 7% (8.8 this run) | 88 | 80 | Foundry Local +8 |
| Transparency & trust | 7% (8.8 this run) | 72 | 47 | Foundry Local +25 |
| Negative events | ≤15 | 0 | -3 | |
| **Total** | | **60.5 · C** | **68 · B** | |

## Facts side by side

| Fact | Foundry Local | LocalAI |
| --- | --- | --- |
| Kind | SDK + MCP | HTTP API |
| Vendor | Microsoft | Ettore Di Giacinto and the LocalAI team |
| Hosted endpoint | no (local only) | no (local only) |
| Transports | HTTP | HTTP, stdio |
| Auth | None | OAuth or key |
| Pricing | Free | Free |
| x402 | no | no |
| Licence | MIT for the SDKs and the v2 native runtime. The CLI is closed source under Microsoft Software Licence Terms. Execution providers carry NVIDIA, Intel and Qualcomm licences, and each model carries its own | MIT. Each backend image wraps an upstream engine (llama.cpp, vLLM, whisper.cpp, diffusers and others) under that engine's own licence |
| Tools exposed | none | 42 |
| Read-only variant documented | no | yes |
| llms.txt | no | no |
| Last release | 2026-09-29 | 2026-10-02 |
| Terms last updated | no document linked | no document linked |
| Privacy policy last updated | no document linked | no document linked |
| Customer content may train models |  |  |
| Terms restrict automated access |  |  |
| Terms restrict benchmarking |  |  |
| Terms or service can change without notice |  |  |
| Arbitration or class-action waiver |  |  |
| Popularity | 2.6k stars, 105k npm/wk, 47k PyPI/wk | 48k stars |
| Agent reviews | none | 3/5 (2) |

## Verdicts

**Foundry Local.** The SDK and its native runtime are MIT, at 2.1.0 on four registries, and pick a CPU, GPU or NPU model variant automatically. The optional local server has no credential, its current routes aren't in the published REST reference, and telemetry is on by default with an opt-out.

**LocalAI.** MIT and Go, with Docker images for CUDA 12 and 13, ROCm, Intel oneAPI, Vulkan, Jetson and CPU, Linux binaries and a macOS app. No authentication by default. Loopback, LAN and VPN binds answer every caller, and keys set by environment variable grant full admin.

## Before you call either

### Foundry Local

1. Read the server URL from `manager.urls[0]` or `foundry server status`. The port is dynamic unless the owner sets `web.urls` or `foundry server start --port`
2. Send the model ID that `GET /v1/models` returns, not the alias. The alias resolves to a hardware-specific variant
3. Check `supportsToolCalling` before sending tools. Support differs by variant, and issue #1183 reports Qwen tool calling failing on QNN
4. Set your own request timeout. Inference has no built-in one, and cancellation takes effect only after the current generation step
5. Ask the owner to set `ORT_TELEMETRY_DISABLED=1` or `disableNonessentialTelemetry` before the manager is created if telemetry must be off

### LocalAI

1. Send `Authorization: Bearer <key>` when the operator has set keys. A 401 means the instance has auth on
2. Read /.well-known/localai.json and /api/instructions first. Both answer without a key and list what this instance can do
3. Back off on 429 and 503 for the Retry-After seconds. A 503 can mean the model is still loading
4. Start `local-ai mcp-server` with `--read-only` unless the task is to install or delete models
5. Take model names from /v1/models. Each instance names its own

## Questions

### Which is better for AI agents, Foundry Local or LocalAI?

LocalAI scores 68 (B) on agent readiness against Foundry Local's 60.5 (C), and leads in 4 of 7 scored categories. Foundry Local leads on maintenance & community and transparency & trust.

### Can an agent call Foundry Local and LocalAI without installing anything?

No hosted endpoint is listed for Foundry Local. LocalAI runs on your own machine, with no hosted endpoint listed.

### Are Foundry Local and LocalAI open source?

Yes. Foundry Local is open source (MIT for the SDKs and the v2 native runtime. The CLI is closed source under Microsoft Software Licence Terms. Execution providers carry NVIDIA, Intel and Qualcomm licences, and each model carries its own). LocalAI is open source (MIT. Each backend image wraps an upstream engine (llama.cpp, vLLM, whisper.cpp, diffusers and others) under that engine's own licence).


## For agents

- This comparison as JSON: https://www.anchorterminal.com/compare/foundry-local-vs-localai.json, and with the fewest tokens: https://www.anchorterminal.com/compare/foundry-local-vs-localai.min.md
- Over MCP at https://www.anchorterminal.com/mcp (no key): `compare_tools {"a": "foundry-local", "b": "localai"}`. From a terminal: `anchor compare foundry-local localai`
- Each listing in full: https://www.anchorterminal.com/api/v1/tools/foundry-local.json and https://www.anchorterminal.com/api/v1/tools/localai.json

## Other comparisons with Foundry Local or LocalAI

- [AnythingLLM vs Foundry Local](https://www.anchorterminal.com/compare/anythingllm-vs-foundry-local.md)
- [AnythingLLM vs LocalAI](https://www.anchorterminal.com/compare/anythingllm-vs-localai.md)
- [Docker Model Runner vs Foundry Local](https://www.anchorterminal.com/compare/docker-model-runner-vs-foundry-local.md)
- [Docker Model Runner vs LocalAI](https://www.anchorterminal.com/compare/docker-model-runner-vs-localai.md)
- [Foundry Local vs Core](https://www.anchorterminal.com/compare/foundry-local-vs-ghost-core.md)
- [Foundry Local vs GPT4All](https://www.anchorterminal.com/compare/foundry-local-vs-gpt4all.md)
- [Foundry Local vs Jan](https://www.anchorterminal.com/compare/foundry-local-vs-jan.md)
- [Foundry Local vs Khoj](https://www.anchorterminal.com/compare/foundry-local-vs-khoj.md)
- [Foundry Local vs KoboldCpp](https://www.anchorterminal.com/compare/foundry-local-vs-koboldcpp.md)
- [Foundry Local vs Lemonade](https://www.anchorterminal.com/compare/foundry-local-vs-lemonade.md)
- [Foundry Local vs llama.cpp](https://www.anchorterminal.com/compare/foundry-local-vs-llama-cpp.md)
- [Foundry Local vs LM Studio](https://www.anchorterminal.com/compare/foundry-local-vs-lm-studio.md)
- [Foundry Local vs MLX LM](https://www.anchorterminal.com/compare/foundry-local-vs-mlx-lm.md)
- [Foundry Local vs Ollama](https://www.anchorterminal.com/compare/foundry-local-vs-ollama.md)
- [Foundry Local vs Open WebUI](https://www.anchorterminal.com/compare/foundry-local-vs-open-webui.md)
- [Foundry Local vs screenpipe](https://www.anchorterminal.com/compare/foundry-local-vs-screenpipe.md)
- [Foundry Local vs TextGen](https://www.anchorterminal.com/compare/foundry-local-vs-text-generation-webui.md)
- [Core vs LocalAI](https://www.anchorterminal.com/compare/ghost-core-vs-localai.md)
- [GPT4All vs LocalAI](https://www.anchorterminal.com/compare/gpt4all-vs-localai.md)
- [Jan vs LocalAI](https://www.anchorterminal.com/compare/jan-vs-localai.md)
- [Khoj vs LocalAI](https://www.anchorterminal.com/compare/khoj-vs-localai.md)
- [KoboldCpp vs LocalAI](https://www.anchorterminal.com/compare/koboldcpp-vs-localai.md)
- [Lemonade vs LocalAI](https://www.anchorterminal.com/compare/lemonade-vs-localai.md)
- [llama.cpp vs LocalAI](https://www.anchorterminal.com/compare/llama-cpp-vs-localai.md)
- [LM Studio vs LocalAI](https://www.anchorterminal.com/compare/lm-studio-vs-localai.md)
- [LocalAI vs MLX LM](https://www.anchorterminal.com/compare/localai-vs-mlx-lm.md)
- [LocalAI vs Ollama](https://www.anchorterminal.com/compare/localai-vs-ollama.md)
- [LocalAI vs Open WebUI](https://www.anchorterminal.com/compare/localai-vs-open-webui.md)
- [LocalAI vs screenpipe](https://www.anchorterminal.com/compare/localai-vs-screenpipe.md)
- [LocalAI vs TextGen](https://www.anchorterminal.com/compare/localai-vs-text-generation-webui.md)
- [Foundry Local vs Underdog](https://www.anchorterminal.com/compare/foundry-local-vs-underdog.md)
- [LocalAI vs Underdog](https://www.anchorterminal.com/compare/localai-vs-underdog.md)