Compare · Models & inference

Local AI compared head to head

184 like-for-like comparisons of local AI models and assistants, each pair scored category by category with prices, facts and verdicts side by side. Pairs are made only when both do the same job.

184 comparisons
6 jobs
20 ranked

Local inference 152

AnythingLLM vs Docker Model Runner D 53.3 vs C 57.1
AnythingLLM vs Foundry Local D 53.3 vs C 60.5
AnythingLLM vs Core D 53.3 vs F 7.3
AnythingLLM vs GPT4All D 53.3 vs F 36.2
AnythingLLM vs Jan D 53.3 vs D 51.3
AnythingLLM vs Khoj D 53.3 vs E 38.5
AnythingLLM vs KoboldCpp D 53.3 vs C 60.5
AnythingLLM vs Lemonade D 53.3 vs B 63.8
AnythingLLM vs llama.cpp D 53.3 vs C 60.2
AnythingLLM vs LM Studio D 53.3 vs C 57.8
AnythingLLM vs LocalAI D 53.3 vs B 68
AnythingLLM vs MLX LM D 53.3 vs D 52.2
AnythingLLM vs Ollama D 53.3 vs C 56.3
AnythingLLM vs Open WebUI D 53.3 vs D 51.8
AnythingLLM vs screenpipe D 53.3 vs C 60.8
AnythingLLM vs TextGen D 53.3 vs E 45.1
AnythingLLM vs vLLM D 53.3 vs C 57.7
Docker Model Runner vs Foundry Local C 57.1 vs C 60.5
Docker Model Runner vs Core C 57.1 vs F 7.3
Docker Model Runner vs GPT4All C 57.1 vs F 36.2
Docker Model Runner vs Jan C 57.1 vs D 51.3
Docker Model Runner vs Khoj C 57.1 vs E 38.5
Docker Model Runner vs KoboldCpp C 57.1 vs C 60.5
Docker Model Runner vs Lemonade C 57.1 vs B 63.8
Docker Model Runner vs llama.cpp C 57.1 vs C 60.2
Docker Model Runner vs LM Studio C 57.1 vs C 57.8
Docker Model Runner vs LocalAI C 57.1 vs B 68
Docker Model Runner vs MLX LM C 57.1 vs D 52.2
Docker Model Runner vs Ollama C 57.1 vs C 56.3
Docker Model Runner vs Open WebUI C 57.1 vs D 51.8
Docker Model Runner vs screenpipe C 57.1 vs C 60.8
Docker Model Runner vs TextGen C 57.1 vs E 45.1
Docker Model Runner vs vLLM C 57.1 vs C 57.7
Foundry Local vs Core C 60.5 vs F 7.3
Foundry Local vs GPT4All C 60.5 vs F 36.2
Foundry Local vs Jan C 60.5 vs D 51.3
Foundry Local vs Khoj C 60.5 vs E 38.5
Foundry Local vs KoboldCpp C 60.5 vs C 60.5
Foundry Local vs Lemonade C 60.5 vs B 63.8
Foundry Local vs llama.cpp C 60.5 vs C 60.2
Foundry Local vs LM Studio C 60.5 vs C 57.8
Foundry Local vs LocalAI C 60.5 vs B 68
Foundry Local vs MLX LM C 60.5 vs D 52.2
Foundry Local vs Ollama C 60.5 vs C 56.3
Foundry Local vs Open WebUI C 60.5 vs D 51.8
Foundry Local vs screenpipe C 60.5 vs C 60.8
Foundry Local vs TextGen C 60.5 vs E 45.1
Foundry Local vs vLLM C 60.5 vs C 57.7
Core vs GPT4All F 7.3 vs F 36.2
Core vs Jan F 7.3 vs D 51.3
Core vs Khoj F 7.3 vs E 38.5
Core vs KoboldCpp F 7.3 vs C 60.5
Core vs Lemonade F 7.3 vs B 63.8
Core vs llama.cpp F 7.3 vs C 60.2
Core vs LM Studio F 7.3 vs C 57.8
Core vs LocalAI F 7.3 vs B 68
Core vs MLX LM F 7.3 vs D 52.2
Core vs Ollama F 7.3 vs C 56.3
Core vs Open WebUI F 7.3 vs D 51.8
Core vs screenpipe F 7.3 vs C 60.8
Core vs TextGen F 7.3 vs E 45.1
Core vs vLLM F 7.3 vs C 57.7
GPT4All vs Jan F 36.2 vs D 51.3
GPT4All vs Khoj F 36.2 vs E 38.5
GPT4All vs KoboldCpp F 36.2 vs C 60.5
GPT4All vs Lemonade F 36.2 vs B 63.8
GPT4All vs llama.cpp F 36.2 vs C 60.2
GPT4All vs LM Studio F 36.2 vs C 57.8
GPT4All vs LocalAI F 36.2 vs B 68
GPT4All vs MLX LM F 36.2 vs D 52.2
GPT4All vs Ollama F 36.2 vs C 56.3
GPT4All vs Open WebUI F 36.2 vs D 51.8
GPT4All vs screenpipe F 36.2 vs C 60.8
GPT4All vs TextGen F 36.2 vs E 45.1
GPT4All vs vLLM F 36.2 vs C 57.7
Jan vs Khoj D 51.3 vs E 38.5
Jan vs KoboldCpp D 51.3 vs C 60.5
Jan vs Lemonade D 51.3 vs B 63.8
Jan vs llama.cpp D 51.3 vs C 60.2
Jan vs LM Studio D 51.3 vs C 57.8
Jan vs LocalAI D 51.3 vs B 68
Jan vs MLX LM D 51.3 vs D 52.2
Jan vs Ollama D 51.3 vs C 56.3
Jan vs Open WebUI D 51.3 vs D 51.8
Jan vs screenpipe D 51.3 vs C 60.8
Jan vs TextGen D 51.3 vs E 45.1
Jan vs vLLM D 51.3 vs C 57.7
Khoj vs KoboldCpp E 38.5 vs C 60.5
Khoj vs Lemonade E 38.5 vs B 63.8
Khoj vs llama.cpp E 38.5 vs C 60.2
Khoj vs LM Studio E 38.5 vs C 57.8
Khoj vs LocalAI E 38.5 vs B 68
Khoj vs MLX LM E 38.5 vs D 52.2
Khoj vs Ollama E 38.5 vs C 56.3
Khoj vs Open WebUI E 38.5 vs D 51.8
Khoj vs TextGen E 38.5 vs E 45.1
Khoj vs vLLM E 38.5 vs C 57.7
KoboldCpp vs Lemonade C 60.5 vs B 63.8
KoboldCpp vs llama.cpp C 60.5 vs C 60.2
KoboldCpp vs LM Studio C 60.5 vs C 57.8
KoboldCpp vs LocalAI C 60.5 vs B 68
KoboldCpp vs MLX LM C 60.5 vs D 52.2
KoboldCpp vs Ollama C 60.5 vs C 56.3
KoboldCpp vs Open WebUI C 60.5 vs D 51.8
KoboldCpp vs screenpipe C 60.5 vs C 60.8
KoboldCpp vs TextGen C 60.5 vs E 45.1
KoboldCpp vs vLLM C 60.5 vs C 57.7
Lemonade vs llama.cpp B 63.8 vs C 60.2
Lemonade vs LM Studio B 63.8 vs C 57.8
Lemonade vs LocalAI B 63.8 vs B 68
Lemonade vs MLX LM B 63.8 vs D 52.2
Lemonade vs Ollama B 63.8 vs C 56.3
Lemonade vs Open WebUI B 63.8 vs D 51.8
Lemonade vs screenpipe B 63.8 vs C 60.8
Lemonade vs TextGen B 63.8 vs E 45.1
Lemonade vs vLLM B 63.8 vs C 57.7
llama.cpp vs LM Studio C 60.2 vs C 57.8
llama.cpp vs LocalAI C 60.2 vs B 68
llama.cpp vs MLX LM C 60.2 vs D 52.2
llama.cpp vs Ollama C 60.2 vs C 56.3
llama.cpp vs Open WebUI C 60.2 vs D 51.8
llama.cpp vs screenpipe C 60.2 vs C 60.8
llama.cpp vs TextGen C 60.2 vs E 45.1
llama.cpp vs vLLM C 60.2 vs C 57.7
LM Studio vs LocalAI C 57.8 vs B 68
LM Studio vs MLX LM C 57.8 vs D 52.2
LM Studio vs Ollama C 57.8 vs C 56.3
LM Studio vs Open WebUI C 57.8 vs D 51.8
LM Studio vs screenpipe C 57.8 vs C 60.8
LM Studio vs TextGen C 57.8 vs E 45.1
LM Studio vs vLLM C 57.8 vs C 57.7
LocalAI vs MLX LM B 68 vs D 52.2
LocalAI vs Ollama B 68 vs C 56.3
LocalAI vs Open WebUI B 68 vs D 51.8
LocalAI vs screenpipe B 68 vs C 60.8
LocalAI vs TextGen B 68 vs E 45.1
LocalAI vs vLLM B 68 vs C 57.7
MLX LM vs Ollama D 52.2 vs C 56.3
MLX LM vs Open WebUI D 52.2 vs D 51.8
MLX LM vs screenpipe D 52.2 vs C 60.8
MLX LM vs TextGen D 52.2 vs E 45.1
MLX LM vs vLLM D 52.2 vs C 57.7
Ollama vs Open WebUI C 56.3 vs D 51.8
Ollama vs screenpipe C 56.3 vs C 60.8
Ollama vs TextGen C 56.3 vs E 45.1
Ollama vs vLLM C 56.3 vs C 57.7
Open WebUI vs screenpipe D 51.8 vs C 60.8
Open WebUI vs TextGen D 51.8 vs E 45.1
Open WebUI vs vLLM D 51.8 vs C 57.7
screenpipe vs TextGen C 60.8 vs E 45.1
screenpipe vs vLLM C 60.8 vs C 57.7
TextGen vs vLLM E 45.1 vs C 57.7

Speech-to-text 1

screenpipe vs Underdog C 60.8 vs F 29.5

Agent memory 10

Amazon Bedrock AgentCore Memory vs LocalGhost A 79.4 vs D 52.6
Cognee vs LocalGhost C 54.6 vs D 52.6
Graphiti vs LocalGhost D 53.3 vs D 52.6
Hindsight vs LocalGhost D 50.2 vs D 52.6
Honcho vs LocalGhost B 64.1 vs D 52.6
LangMem vs LocalGhost D 47.9 vs D 52.6
LocalGhost vs Mem0 Platform + MCP D 52.6 vs C 56.1
LocalGhost vs Memory (MCP reference server) D 52.6 vs C 54.2
LocalGhost vs Supermemory API + MCP D 52.6 vs B 63.6
LocalGhost vs Zep D 52.6 vs B 69.3

Open-weight models 15

AnythingLLM vs Underdog D 53.3 vs F 29.5
Docker Model Runner vs Underdog C 57.1 vs F 29.5
Foundry Local vs Underdog C 60.5 vs F 29.5
Core vs Underdog F 7.3 vs F 29.5
GPT4All vs Underdog F 36.2 vs F 29.5
Jan vs Underdog D 51.3 vs F 29.5
KoboldCpp vs Underdog C 60.5 vs F 29.5
Lemonade vs Underdog B 63.8 vs F 29.5
llama.cpp vs Underdog C 60.2 vs F 29.5
LM Studio vs Underdog C 57.8 vs F 29.5
LocalAI vs Underdog B 68 vs F 29.5
MLX LM vs Underdog D 52.2 vs F 29.5
Ollama vs Underdog C 56.3 vs F 29.5
TextGen vs Underdog E 45.1 vs F 29.5
Underdog vs vLLM F 29.5 vs C 57.7

Memory search 5

AnythingLLM vs LocalGhost D 53.3 vs D 52.6
Core vs LocalGhost F 7.3 vs D 52.6
GPT4All vs LocalGhost F 36.2 vs D 52.6
Khoj vs LocalGhost E 38.5 vs D 52.6
Khoj vs screenpipe E 38.5 vs C 60.8

User memory 1

LocalGhost vs screenpipe D 52.6 vs C 60.8