Make0 Max mode · Experimental*
0.0%
Overall accuracy · 8s+ latency
Evaluated 10 Sep 2026
*100-question subset
Loading your app…
Make0 Max and Standard versus Zep, LangMem, Mem0, and OpenAI. Full Context is omitted. SWE-ContextBench retrieval is on its own page.
Make0 Max mode · Experimental*
0.0%
Overall accuracy · 8s+ latency
Evaluated 10 Sep 2026
*100-question subset
Make0 Standard
0.0%
Overall accuracy · 1–3s latency
Evaluated 25 Oct 2026
Retrieval
0.0%
Hit@10 · Make0 Standard
LLM-as-a-judge
Max mode is an experimental Make0 configuration with 8s+ retrieval latency and limited availability. Standard is available to all users and takes 1–3s. We are working to lower Max mode's latency. Competitor scores are published; Full Context is omitted. *Max mode was evaluated on a 100-question subset of LoCoMo, not the full 1,540 questions, so it is not directly comparable with full-benchmark scores.
Overall
LLM-as-a-judge score across all categories. Higher bars are better.
LoCoMo overall accuracy for Make0 Max, Make0 Standard, Zep, LangMem, Mem0, and OpenAI
Breakdown
Single-hop, multi-hop, world knowledge, temporal, and overall.
| Method | Single-hop | Multi-hop | World knowledge | Temporal | Overall |
|---|---|---|---|---|---|
| Make0 (Max mode · Experimental*)Evaluated 10 Sep 2026 | 94.4% | 90.6% | 76.9% | 97.3% | 92.0% |
| Make0 (Standard)Evaluated 25 Oct 2026 | 90.73% | 67.38% | 61.46% | 75.08% | 81.36% |
| Zep | 79.43% | 69.16% | 73.96% | 83.33% | 79.09% |
| LangMem | 74.47% | 61.06% | 67.71% | 86.92% | 78.05% |
| Mem0 | 62.41% | 57.32% | 44.79% | 66.47% | 62.47% |
| OpenAI | 63.79% | 42.92% | 62.29% | 21.71% | 52.9% |
Make0 Standard retrieval: Hit@10 98.4%.
Best score in each column is highlighted.
Tinted Make0 cells beat every published baseline, even when Max mode* scores higher.
Retrieval cost
Mean tokens per retrieval call on LoCoMo. Make0 Standard sends 2,629 memory tokens to the answering model, 90% fewer than passing the full conversation (26,031), and less than Zep (3,911) or OpenAI (4,437). Mem0's 2025 version retrieves less (1,764) and scores 62.47% overall, against 81.36% for Make0 Standard. Mem0's 2026 algorithm reports 6,956 tokens per call.
Retrieval cost
Context tokens sent to the answering model per LoCoMo question. Lower bars are better.
Mean retrieval tokens for Make0 Standard, Mem0 (2025 and 2026), Zep, OpenAI, and full-context
Make0 is the mean context tokens from the full Standard LoCoMo evaluation (evaluated 25 Oct 2026). Mem0 (2025), Zep, OpenAI, and Full-context figures are from Table 2 of Mem0's 2025 paper. Mem0 (2026) is self-reported on Mem0's research page.
Performance by category
These are lookup questions: a name, a plan, a reason, already said once in conversation.
Standard leads the published baselines here at 90.73% versus Zep (79.43%). Max mode* leads every category on its 100-question subset. Standard is just behind Zep on multi-hop and trails Zep and LangMem on open-domain (“would she…?”) and temporal (“when did…?”) questions.
A fact stated in one sitting. Max mode* leads at 94.4%, ahead of Zep (79.43%) and LangMem (74.47%). Standard also leads the published baselines here at 90.73%.
Piecing together details that never appear in one session. Max mode* leads at 90.6%, above Zep (69.16%) and LangMem (61.06%). Standard scores 67.38%, ahead of LangMem but just behind Zep.
A stored fact plus an inference the transcript never states. Max mode* scores 76.9%, just above Zep (73.96%). Standard is weaker here at 61.46%, behind Zep and LangMem (67.71%).
When something happened, or how long ago. Max mode* leads at 97.3%, ahead of LangMem (86.92%) and Zep (83.33%). Standard scores 75.08%, behind those two published systems.
Methodology
Evaluation
The benchmark covers single-hop, multi-hop, world knowledge, and temporal questions across long, multi-session conversations. Make0 answers and scoring both use GPT-5.6 Luna.
Standard · available now
The default setting for all users: 81.36% overall with 1–3s retrieval latency. Evaluated 25 Oct 2026.
Max · experimental*
A higher-capacity setting at 92.0% overall. It has 8s+ latency and limited availability while we work to reduce it. Evaluated 10 Sep 2026 on a 100-question subset of LoCoMo.
Notes
Start with one Brain
Free to startSign up, add a few memories, and connect your first agent. That's the whole setup.
Your BrainClaudeChatGPT
Grok Bot
Make0 Agent