From 4c02169fee7ed3ef5787f54ecbde288b1bff24cc Mon Sep 17 00:00:00 2001 From: Raffaele <74499579+Helldez@users.noreply.github.com> Date: Sat, 29 Aug 2026 21:01:34 +0200 Subject: [PATCH] docs(bench): tell contributors to check the mode line before reporting a number (#190) --- docs/community-benchmarks.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/docs/community-benchmarks.md b/docs/community-benchmarks.md index d1a0f48..4cfcf8f 100644 --- a/docs/community-benchmarks.md +++ b/docs/community-benchmarks.md @@ -82,6 +82,11 @@ Flags after the model path reach `bmoe-cli` verbatim (`--no-think` for gpt-oss, default row rather than replacing it. To understand the knobs first, see [benchmark-method.md](benchmark-method.md). +Whatever you run, check the `mode:` line before reporting a number. It says `expert streaming` when +the run measured this engine; if it says `mmap`, `--moe-stream` was missing and the run measured +stock llama.cpp instead. A row like that is still welcome as a baseline, it just has to be labelled +as one. + ### On a phone `bench-report.sh` is Linux and macOS only. On Android, push `bmoe-cli` (from