Concedo
0890a5ee77
Merge commit ' 033df86b69' into concedo_experimental
...
# Conflicts:
# docs/backend/SYCL.md
# docs/development/parsing.md
# examples/speculative-simple/speculative-simple.cpp
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/get-rows-ops.c
# ggml/src/ggml-hexagon/htp/get-rows-ops.h
# ggml/src/ggml-hexagon/htp/hmx-mm-kernels-tiled.h
# ggml/src/ggml-hexagon/htp/htp-ops.h
# ggml/src/ggml-hexagon/htp/hvx-erf.h
# ggml/src/ggml-hexagon/htp/main.c
# ggml/src/ggml-hexagon/htp/matmul-ops.c
# ggml/src/ggml-hexagon/htp/unary-ops.c
# ggml/src/ggml-hexagon/htp/unary-ops.h
# ggml/src/ggml-sycl/CMakeLists.txt
# ggml/src/ggml-sycl/common.hpp
# ggml/src/ggml-sycl/element_wise.cpp
# ggml/src/ggml-sycl/element_wise.hpp
# ggml/src/ggml-sycl/fusion.cpp
# ggml/src/ggml-sycl/fwht.cpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-sycl/im2col.hpp
# ggml/src/ggml-sycl/pad.hpp
# ggml/src/ggml-sycl/rope.hpp
# ggml/src/ggml-sycl/upscale.hpp
# scripts/snapdragon/run.py
# scripts/sync_vendor.py
# src/CMakeLists.txt
# tests/test-backend-ops.cpp
# tests/test-backend-sampler.cpp
# tests/test-chat.cpp
# tests/test-llama-archs.cpp
# tools/imatrix/imatrix.cpp
# tools/server/README.md
2026-10-10 13:19:02 +08:00
Concedo
deac43f7d1
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# ci/run.sh
# docs/backend/snapdragon/developer.md
# docs/ops.md
# docs/ops/CUDA.csv
# ggml/src/ggml-backend.cpp
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/concat-ops.c
# ggml/src/ggml-hexagon/htp/cpy-ops.c
# ggml/src/ggml-hexagon/htp/dma-copy.h
# ggml/src/ggml-hexagon/htp/hex-utils.h
# ggml/src/ggml-hexagon/htp/hvx-copy.h
# ggml/src/ggml-hip/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-opencl/kernels/gemm_xmem_f16_f32_os8.cl
# ggml/src/ggml-sycl/common.hpp
# ggml/src/ggml-sycl/fattn-common.hpp
# ggml/src/ggml-sycl/fattn-mkl.cpp
# ggml/src/ggml-sycl/fattn-vec.hpp
# ggml/src/ggml-sycl/fattn.cpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-sycl/memtrace.cpp
# ggml/src/ggml-sycl/memtrace.hpp
# ggml/src/ggml-sycl/mmvq.cpp
# ggml/src/ggml-webgpu/ggml-webgpu.cpp
# scripts/check-release-apiabi.sh
# tests/fusion/MTL.csv
# tests/test-backend-ops.cpp
# tests/test-chat.cpp
# tests/test-llama-archs.cpp
# tests/test-recurrent-state-rollback.cpp
# tools/mtmd/clip.cpp
# tools/server/README.md
2026-10-09 00:13:54 +08:00
Concedo
14cf69fa7a
Merge commit ' 63bef2728d' into concedo_experimental
...
# Conflicts:
# .github/workflows/build-apple.yml
# .github/workflows/docker.yml
# .github/workflows/make-release.yml
# .github/workflows/models-check.yml
# .github/workflows/winget.yml
# CMakeLists.txt
# docs/backend/OPENVINO.md
# docs/build-riscv64-spacemit.md
# ggml/CMakeLists.txt
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/CMakeLists.txt
# ggml/src/ggml-hexagon/htp/dma-queue.c
# ggml/src/ggml-hexagon/htp/dma-queue.h
# ggml/src/ggml-hexagon/htp/flash-attn-ops.c
# ggml/src/ggml-hexagon/htp/flash-attn-ops.h
# ggml/src/ggml-hexagon/htp/hmx-mm-kernels-tiled.h
# ggml/src/ggml-hexagon/htp/hmx-utils.h
# ggml/src/ggml-hexagon/htp/htp-ctx.h
# ggml/src/ggml-hexagon/htp/htp-ops.h
# ggml/src/ggml-hexagon/htp/main.c
# ggml/src/ggml-hexagon/htp/matmul-ops.c
# ggml/src/ggml-hexagon/htp/matmul-ops.h
# ggml/src/ggml-hexagon/htp/ssm-conv.c
# ggml/src/ggml-hexagon/htp/ssm-conv.h
# ggml/src/ggml-openvino/ggml-decoder.cpp
# ggml/src/ggml-openvino/ggml-decoder.h
# ggml/src/ggml-openvino/ggml-openvino-extra.cpp
# ggml/src/ggml-openvino/ggml-openvino.cpp
# ggml/src/ggml-openvino/openvino/op/fill.cpp
# ggml/src/ggml-openvino/openvino/op_table.cpp
# ggml/src/ggml-openvino/openvino/pass/fuse_moe_compressed.cpp
# ggml/src/ggml-openvino/openvino/translate_session.cpp
# ggml/src/ggml-openvino/utils.cpp
# ggml/src/ggml-openvino/utils.h
# scripts/make-release-checks.sh
# scripts/make-release-summary.txt
# scripts/snapdragon/run.py
# scripts/sync-ggml.last
# tests/CMakeLists.txt
# tests/test-backend-ops.cpp
# tests/test-recurrent-state-rollback.cpp
# tests/test-save-load-state.cpp
# tests/test-state-restore-fragmented.cpp
# tools/server/README.md
2026-10-08 23:43:45 +08:00
Leebr Data Consulting
033df86b69
server : preserve context checkpoints across slot save/restore ( #26004 )
...
* server : preserve context checkpoints across slot save/restore
Append the checkpoints after the packed server_tokens payload added in #26640
and count them in n_written / n_read, so a restored slot can still roll back to
a checkpoint instead of re-processing the whole prompt.
* server : drop draft checkpoint data that does not match the draft context
Restoring a slot saved with a different draft KV cache type aborted in
load_dft(). Test-load one draft checkpoint on restore and drop the draft
data if it does not fit, instead of crashing. Adds a regression test.
Co-authored-by: Igor Okulist <okigan@gmail.com>
* server : harden the checkpoint appendix of slot save files
Bound each blob size by the bytes left in the file before allocating, open the
file with UTF-8 paths on Windows like the llama state payload, fall back to full
prompt re-processing when a checkpoint restored from a slot file fails to load,
and replace the 1024 count cap by keeping the last n_ctx_checkpoints while reading.
* server : report an incomplete checkpoint appendix as a failed slot save
Return an error to the client when the appendix cannot be written, like a
failed payload write, and make the oversized-blob test declare a size that
cannot be allocated, so an unbounded allocation fails the test.
* server : reject an empty target state in the checkpoint appendix
A saved checkpoint always holds a target state, an empty blob would roll back
without restoring anything. Also log with the slot id, and load the draft test
model from the HF cache instead of a second download.
* common : return bool from checkpoint load_tgt / load_dft
A checkpoint restored from a slot file falls back to full prompt re-processing
when it fails to load, a checkpoint created in memory still aborts.
---------
Co-authored-by: Igor Okulist <okigan@gmail.com>
2026-10-08 13:18:20 +03:00
Tarek Dakhran
a657f7e981
model : add LiquidAI/d1-omni-600M decision model ( #30114 )
...
* model : add LiquidAI/d1-omni-600M decision model
Assisted-by: Claude Opus 5.5
* mtmd : keep conformer GLU sigmoid on CUDA
Assisted-by: Claude Opus 5.5
* server : take d1omni audio through images and input_audio, scope memory-less lfm2 to non-causal
Assisted-by: Claude Opus 5.5
* common : rename decision type d1omni to lfm2-d1-omni, server : make images an alias of files
Assisted-by: Claude Opus 5.5
2026-10-08 02:07:49 +02:00
Tarek Dakhran
88dcc460d6
model : add LiquidAI/d1-3B decision model ( #30110 )
...
* model : add LiquidAI/d1-3b decision model
mtmd : read LFM2 image resize algo from GGUF
Assisted-by: Claude Opus 5.5
* common : rename decision type d1 to lfm2-d1
Assisted-by: Claude Opus 5.5
2026-10-07 22:04:39 +02:00
Aman Gupta
d6cf9acb25
llama : add a GPU cache for MoE experts kept in host memory ( #29887 )
...
* llama : add a GPU cache for MoE experts kept in host memory
Assisted-by: Claude
* use llama_moe_cache_ptr
2026-10-07 21:07:45 +03:00
Concedo
acef3c226f
Merge commit ' ebe18bee5a' into concedo_experimental
...
# Conflicts:
# .devops/openvino.Dockerfile
# .github/workflows/ai-issues.yml
# .github/workflows/build-3rd-party.yml
# .github/workflows/build-and-test-snapdragon.yml
# .github/workflows/build-android.yml
# .github/workflows/build-apple.yml
# .github/workflows/build-cache.yml
# .github/workflows/build-cann.yml
# .github/workflows/build-cmake-pkg.yml
# .github/workflows/build-cpu.yml
# .github/workflows/build-cross.yml
# .github/workflows/build-cuda-ubuntu.yml
# .github/workflows/build-cuda-windows.yml
# .github/workflows/build-ibm.yml
# .github/workflows/build-msys.yml
# .github/workflows/build-opencl.yml
# .github/workflows/build-openvino.yml
# .github/workflows/build-riscv.yml
# .github/workflows/build-sanitize.yml
# .github/workflows/build-sycl.yml
# .github/workflows/build-virtgpu.yml
# .github/workflows/build-vulkan.yml
# .github/workflows/build-wasm.yml
# .github/workflows/build-webgpu.yml
# .github/workflows/check-vendor.yml
# .github/workflows/ci-self-hosted-cpu.yml
# .github/workflows/ci-self-hosted-cuda.yml
# .github/workflows/ci-self-hosted-kleidiai.yml
# .github/workflows/ci-self-hosted-metal.yml
# .github/workflows/ci-self-hosted-openvino.yml
# .github/workflows/ci-self-hosted-vulkan.yml
# .github/workflows/ci-self-hosted-webgpu.yml
# .github/workflows/close-issue.yml
# .github/workflows/code-style.yml
# .github/workflows/docker.yml
# .github/workflows/editorconfig.yml
# .github/workflows/gguf-publish.yml
# .github/workflows/hip-quality-check.yml
# .github/workflows/labeler.yml
# .github/workflows/make-release.yml
# .github/workflows/models-check.yml
# .github/workflows/pr-draft-label.yml
# .github/workflows/pre-tokenizer-hashes.yml
# .github/workflows/python-check-requirements.yml
# .github/workflows/python-lint.yml
# .github/workflows/python-type-check.yml
# .github/workflows/release.yml
# .github/workflows/server-sanitize.yml
# .github/workflows/server-self-hosted.yml
# .github/workflows/server.yml
# .github/workflows/ui-build-self-hosted.yml
# .github/workflows/ui-build.yml
# .github/workflows/ui-publish.yml
# .github/workflows/ui-self-hosted.yml
# .github/workflows/ui.yml
# .github/workflows/update-ops-docs.yml
# .github/workflows/winget.yml
# AGENTS.md
# docs/backend/OPENVINO.md
# ggml/src/ggml-metal/CMakeLists.txt
# ggml/src/ggml-openvino/CMakeLists.txt
# ggml/src/ggml-openvino/ggml-decoder.cpp
# ggml/src/ggml-openvino/ggml-decoder.h
# ggml/src/ggml-openvino/ggml-openvino-extra.cpp
# ggml/src/ggml-openvino/ggml-openvino-extra.h
# ggml/src/ggml-openvino/ggml-openvino.cpp
# ggml/src/ggml-openvino/model-cache.cpp
# ggml/src/ggml-openvino/model-cache.h
# ggml/src/ggml-openvino/openvino/node_context.h
# ggml/src/ggml-openvino/openvino/op/add.cpp
# ggml/src/ggml-openvino/openvino/op/argsort.cpp
# ggml/src/ggml-openvino/openvino/op/cpy.cpp
# ggml/src/ggml-openvino/openvino/op/flash_attn_ext.cpp
# ggml/src/ggml-openvino/openvino/op/gated_delta_net.cpp
# ggml/src/ggml-openvino/openvino/op/get_rows.cpp
# ggml/src/ggml-openvino/openvino/op/im2col.cpp
# ggml/src/ggml-openvino/openvino/op/l2_norm.cpp
# ggml/src/ggml-openvino/openvino/op/mul_mat_id.cpp
# ggml/src/ggml-openvino/openvino/op/reshape.cpp
# ggml/src/ggml-openvino/openvino/op/rms_norm.cpp
# ggml/src/ggml-openvino/openvino/op/rope.cpp
# ggml/src/ggml-openvino/openvino/op/scale.cpp
# ggml/src/ggml-openvino/openvino/op/view.cpp
# ggml/src/ggml-openvino/openvino/op_table.cpp
# ggml/src/ggml-openvino/openvino/op_table.h
# ggml/src/ggml-openvino/openvino/pass/fuse_moe_compressed.cpp
# ggml/src/ggml-openvino/openvino/pass/fuse_moe_compressed.h
# ggml/src/ggml-openvino/openvino/pass/fuse_to_conv.cpp
# ggml/src/ggml-openvino/openvino/translate_session.cpp
# ggml/src/ggml-openvino/openvino/utils.cpp
# ggml/src/ggml-openvino/openvino/utils.h
# ggml/src/ggml-openvino/utils.cpp
# ggml/src/ggml-openvino/utils.h
# ggml/src/ggml-webgpu/ggml-webgpu-shader-lib.hpp
# ggml/src/ggml-webgpu/ggml-webgpu.cpp
# ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_vec_q_acc.tmpl
# ggml/src/ggml-webgpu/wgsl-shaders/quantize_q8.wgsl
# ggml/src/ggml-webgpu/wgsl-shaders/set_rows.wgsl
# ggml/src/ggml-webgpu/wgsl-shaders/set_rows_quant.wgsl
# scripts/sync_vendor.py
# tests/CMakeLists.txt
# tests/test-backend-ops.cpp
# tests/test-batch-alloc.cpp
# tests/test-chat.cpp
# tests/test-llama-archs.cpp
# tools/imatrix/README.md
# tools/imatrix/imatrix.cpp
# tools/server/README.md
2026-10-07 23:18:17 +08:00
Xuan-Son Nguyen
da263e7275
models: support pplx-decider ( #30044 )
2026-10-06 16:07:46 +02:00
Adrien Gallouët
4d60b4d087
common, server : report model input/output modalities in GET /models ( #29987 )
...
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-10-05 17:08:29 +02:00
Pascal
a7fb71fab8
log, server: self contained colors, split child commands from logs in router mode ( #29895 )
...
* log, server: make router child lines carry their own colors
The logger writes the color reset after the trailing newline, so the
reset opens the next line. On the shared pipe of a router child it lands
in front of the next state command, which the router then misses, and
the line break that works around it shows up as an empty log line on
every progress update.
The reset now goes before the trailing newlines, so every line is self
contained and the command goes back to its plain framing. The router
passes its effective color setting to its children, whose output ends
up in its terminal, and leaves that option out when comparing presets
on reload.
* log: enable ANSI colors on the Windows console
A Windows console renders ANSI sequences only in virtual terminal mode,
which nothing turns on for the logger, so llama-server prints raw escape
codes on the Windows 10 console while llama-cli, whose console code
enables it, shows colors. The logger now enables virtual terminal mode
on stdout and stderr when it turns colors on, and keeps colors off when
a console cannot render them. Pipes and files take the sequences as is.
* server: separate the router child commands from its logs
The child sent its state commands on the same pipe as its logs, so the
router had to pick them out of the log stream by a line prefix, and any
unterminated write in front of a command made the router miss it. This
resolves the TODO at the spawn that called for splitting stdout and
stderr.
The child now keeps stdout for the commands and points everything else
written to stdout at stderr, before anything is written. The router
reads both pipes, handles the commands from stdout and forwards stderr
as the log, and warns about any other line on the command pipe.
* server: address review from ngxson
The single server_child is now created first in the entry point and its
constructor keeps stdout for the commands, so the stream is a member of
the instance instead of a static, and init() is gone. The instance is
passed down to the server, while the CLI entry point creates its own.
* Update tools/server/server.cpp
---------
Co-authored-by: Xuan-Son Nguyen <thichthat@gmail.com>
2026-10-05 01:59:37 +02:00
Ed Addario
0504396140
imatrix: calculate activation-based statistics for new format (GGUF) imatrices ( #14891 )
...
* Use activations to calculate the stats
* Determine calculation mode
* Compute entropy for activations
* Compute cosine similarity based on activations
* Compute l2 norm
* Add compute_layer_statistics() function
* Update aggregated statistic report layout
* Fix printing l2 norm when calc_mode = 1
* Refactor variable name
* Compute aggregated (per layer) l2 norm
* Update aggregated sum of squared activations per layer
* Make ZD Score two-tailed
* Update report layout
* Reverse conditional logic to match convention
* Rename report heading
* Add --activation-statistics parameter
* Add Euclidean–Cosine Score (ECS)
* Add --activation-statistics logic to avoid doubling the imatrix size by default
* Update stats output sort based on imatrix type
* Process external NextN draft files (-md / --model-draft)
* Refactor to use new llama_batch_ext
Co-authored-by: compilade <git@compilade.net>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@huggingface.co>
2026-10-04 11:24:53 +02:00
Adrien Gallouët
6716df694b
common : prepare load_from_models_dir() for path conversion ( #29674 )
...
This is part of the fs::path modernization series.
That was also the opportunity to remove fs_list().
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-10-04 11:35:33 +03:00
Nik Bogatyrev
1537a0a8b2
server : fix laya abort by limiting n_batch to n_ubatch ( #29903 )
...
* server : fix laya abort by limiting n_batch to n_ubatch
Fixes #29902
Assisted-by: Claude
* fix(review) : rm tests, embeddings cond
2026-10-03 17:19:13 +02:00
Adrien Gallouët
edd6e2bbda
common : add common_is_tty() helper and fix deprecated warnings on Windows ( #29860 )
...
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-10-03 15:48:24 +02:00
Concedo
4d27749c93
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .github/workflows/build-cuda-ubuntu.yml
# .github/workflows/build-cuda-windows.yml
# .github/workflows/build-ibm.yml
# .github/workflows/ci-self-hosted-cuda.yml
# .github/workflows/release.yml
# .github/workflows/server-self-hosted.yml
# AGENTS.md
# README.md
# ci/run.sh
# docs/autoparser.md
# docs/backend/SYCL.md
# docs/build.md
# docs/development/HOWTO-add-model.md
# docs/function-calling.md
# docs/ops.md
# docs/ops/CPU.csv
# ggml/CMakeLists.txt
# ggml/src/ggml-blas/CMakeLists.txt
# ggml/src/ggml-cann/ggml-cann.cpp
# ggml/src/ggml-cpu/amx/amx.cpp
# ggml/src/ggml-cpu/kleidiai/kleidiai.cpp
# ggml/src/ggml-cuda/CMakeLists.txt
# ggml/src/ggml-et/ggml-et.cpp
# ggml/src/ggml-hexagon/CMakeLists.txt
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/allreduce-ops.c
# ggml/src/ggml-hexagon/htp/allreduce-ops.h
# ggml/src/ggml-hexagon/htp/concat-ops.c
# ggml/src/ggml-hexagon/htp/cpy-ops.c
# ggml/src/ggml-hexagon/htp/hmx-mm-kernels-tiled.h
# ggml/src/ggml-hexagon/htp/htp-ops.h
# ggml/src/ggml-hexagon/htp/hvx-mm-kernels-tiled.h
# ggml/src/ggml-hexagon/htp/matmul-ops.c
# ggml/src/ggml-hexagon/htp/matmul-ops.h
# ggml/src/ggml-hexagon/htp/work-queue.c
# ggml/src/ggml-metal/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-openvino/ggml-openvino.cpp
# ggml/src/ggml-sycl/common.hpp
# ggml/src/ggml-sycl/dmmv.cpp
# ggml/src/ggml-sycl/fattn-common.hpp
# ggml/src/ggml-sycl/fattn-onednn.cpp
# ggml/src/ggml-sycl/fattn-vec.hpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-sycl/mmvq.cpp
# ggml/src/ggml-sycl/vecdotq.hpp
# ggml/src/ggml-virtgpu/ggml-backend-buffer-type.cpp
# ggml/src/ggml-vulkan/ggml-vulkan.cpp
# ggml/src/ggml-webgpu/ggml-webgpu-shader-lib.hpp
# ggml/src/ggml-webgpu/ggml-webgpu.cpp
# ggml/src/ggml-webgpu/wgsl-shaders/common_decls.tmpl
# ggml/src/ggml-webgpu/wgsl-shaders/get_rows.wgsl
# ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_decls.tmpl
# ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_vec_acc.tmpl
# ggml/src/ggml-webgpu/wgsl-shaders/ssm_scan.wgsl
# ggml/src/ggml-zdnn/ggml-zdnn.cpp
# pyproject.toml
# scripts/snapdragon/run.py
# skills/code-review/SKILL.md
# tests/fusion/MTL.csv
# tests/test-alloc.cpp
# tests/test-backend-ops.cpp
# tests/test-chat.cpp
# tests/test-llama-archs.cpp
# tests/test-model-resolution.cpp
# tests/test-quantize-fns.cpp
# tests/test-recurrent-state-rollback.cpp
# tools/llama-bench/README.md
# tools/llama-bench/llama-bench.cpp
# tools/server/CMakeLists.txt
# tools/server/README.md
2026-10-03 17:59:14 +08:00
Xuan-Son Nguyen
99b95488ca
model: add support for clef decision model (text-only) ( #29831 )
...
* init support for clef (text only)
* more static graph
* clean up
* nits
* nits 2
* Update gguf-py/gguf/constants.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@huggingface.co>
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@huggingface.co>
2026-10-03 02:50:48 +02:00
Concedo
945df48dd3
Merge commit ' 60e9cf7a7b' into concedo_experimental
...
# Conflicts:
# examples/batched/batched.cpp
# examples/debug/debug.cpp
# examples/eval-callback/eval-callback.cpp
# examples/idle/idle.cpp
# examples/llama.android/lib/src/main/cpp/ai_chat.cpp
# examples/lookahead/lookahead.cpp
# examples/lookup/lookup.cpp
# examples/parallel/parallel.cpp
# examples/passkey/passkey.cpp
# examples/retrieval/retrieval.cpp
# examples/simple-chat/simple-chat.cpp
# examples/simple/simple.cpp
# examples/speculative-simple/speculative-simple.cpp
# examples/speculative/speculative.cpp
# tests/test-backend-sampler.cpp
# tests/test-fusion.cpp
# tests/test-llama-archs.cpp
# tests/test-recurrent-state-rollback.cpp
# tests/test-save-load-state.cpp
# tests/test-state-restore-fragmented.cpp
# tests/test-thread-safety.cpp
# tools/batched-bench/batched-bench.cpp
# tools/cvector-generator/cvector-generator.cpp
# tools/imatrix/imatrix.cpp
# tools/llama-bench/llama-bench.cpp
# tools/perplexity/perplexity.cpp
# tools/results/results.cpp
2026-10-03 01:14:19 +08:00
Concedo
2374751a07
Merge commit ' 19e28a2770' into concedo_experimental
...
# Conflicts:
# .devops/intel.Dockerfile
# .devops/musa.Dockerfile
# .github/workflows/build-cuda-ubuntu.yml
# .github/workflows/build-ibm.yml
# .github/workflows/build-sycl.yml
# .github/workflows/release.yml
# ci/README-MUSA.md
# ci/run.sh
# docs/backend/SYCL.md
# examples/simple-chat/simple-chat.cpp
# examples/simple/simple.cpp
# examples/speculative-simple/speculative-simple.cpp
# ggml/include/ggml-zdnn.h
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/act-ops.c
# ggml/src/ggml-hexagon/htp/concat-ops.c
# ggml/src/ggml-hexagon/htp/htp-ops.h
# ggml/src/ggml-hexagon/htp/hvx-arith.h
# ggml/src/ggml-hexagon/htp/hvx-base.h
# ggml/src/ggml-hexagon/htp/hvx-sigmoid.h
# ggml/src/ggml-hexagon/htp/hvx-utils.h
# ggml/src/ggml-hexagon/htp/main.c
# ggml/src/ggml-hexagon/htp/unary-ops.c
# ggml/src/ggml-hexagon/htp/unary-ops.h
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-openvino/ggml-openvino.cpp
# ggml/src/ggml-zdnn/ggml-zdnn.cpp
# scripts/hip/gcn-cdna-vgpr-check.py
# scripts/snapdragon/ggml-hexagon-trace.py
# src/llama-context.cpp
# tests/gguf-model-data.cpp
# tests/test-chat.cpp
# tests/test-fusion.cpp
# tests/test-gguf.cpp
# tools/cli/cli.cpp
# tools/server/README.md
# vendor/stb/CMakeLists.txt
2026-10-03 00:31:12 +08:00
Xuan-Son Nguyen
46ca246de9
model: support nimble decision model ( #29844 )
2026-10-02 14:56:53 +02:00
Xuan-Son Nguyen
a4cb4c61fd
llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) ( #29818 )
...
* init conversion
* convert: ok
* model loaded
* add server code
* improve conversion script
* support shared prompt prefix
* add docs, imorove UX a bit
* add vision support
* add openjev tiny model for testing
* add dev docs
* support lev & kev
* clean up
* fix lev noul
* fix py lint
* nits docs
* clarify about not supporting date_facts
2026-10-02 11:56:04 +02:00
Adrien Gallouët
70849ee82c
common : remove fs_open_ifstream() by using u8path() ( #29841 )
...
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-10-02 11:43:45 +02:00
Adrien Gallouët
f1cee9941b
common,rpc : fix cache dir creation through symlinks on buggy libstdc++ ( #29816 )
...
See https://gcc.gnu.org/bugzilla/show_bug.cgi?id=101510
Close #29759
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-10-01 20:15:02 +02:00
Xuan-Son Nguyen
60e9cf7a7b
batch: migrate the rest of examples to llama_batch_ext ( #29601 )
...
* migrate the rest
* test-thread-safety
* rm common_batch_staged
2026-09-30 18:08:43 +02:00
Concedo
3cee526a68
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .devops/musa.Dockerfile
# .github/workflows/build-apple.yml
# .github/workflows/build-cpu.yml
# .github/workflows/build-vulkan.yml
# .github/workflows/python-type-check.yml
# CODEOWNERS
# docs/backend/snapdragon/CMakeUserPresets.json
# docs/build.md
# docs/docker.md
# docs/ops.md
# docs/ops/Hexagon.csv
# ggml/cmake/common.cmake
# ggml/src/ggml-cpu/CMakeLists.txt
# ggml/src/ggml-cpu/ggml-cpu.c
# ggml/src/ggml-cuda/CMakeLists.txt
# ggml/src/ggml-hexagon/CMakeLists.txt
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp-opnode.h
# ggml/src/ggml-hexagon/htp/argsort-ops.c
# ggml/src/ggml-hexagon/htp/binary-ops.c
# ggml/src/ggml-hexagon/htp/binary-ops.h
# ggml/src/ggml-hexagon/htp/cpy-ops.c
# ggml/src/ggml-hexagon/htp/dma-queue.h
# ggml/src/ggml-hexagon/htp/get-rows-ops.c
# ggml/src/ggml-hexagon/htp/get-rows-ops.h
# ggml/src/ggml-hexagon/htp/htp-ctx.h
# ggml/src/ggml-hexagon/htp/htp-ops.h
# ggml/src/ggml-hexagon/htp/hvx-arith.h
# ggml/src/ggml-hexagon/htp/hvx-base.h
# ggml/src/ggml-hexagon/htp/hvx-reduce.h
# ggml/src/ggml-hexagon/htp/main.c
# ggml/src/ggml-hexagon/htp/sum-rows-ops.c
# ggml/src/ggml-hexagon/htp/unary-ops.c
# ggml/src/ggml-hexagon/htp/unary-ops.h
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-sycl/fwht.cpp
# ggml/src/ggml-webgpu/ggml-webgpu.cpp
# scripts/hip/gcn-cdna-vgpr-check.py
# scripts/snapdragon/ggml-hexagon-inspect.py
# tests/CMakeLists.txt
# tests/test-backend-ops.cpp
# tests/test-jinja.cpp
# tests/test-recurrent-state-rollback.cpp
# tests/test-save-load-state.cpp
# tests/test-state-restore-fragmented.cpp
# tools/llama-bench/README.md
# tools/llama-bench/llama-bench.cpp
# tools/mtmd/CMakeLists.txt
2026-09-29 23:24:34 +08:00
Adrien Gallouët
00af63567a
common : use fs::path for config dir ( #29649 )
...
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-09-29 17:22:49 +02:00
Concedo
bd39978ced
Merge commit ' 171e8846b4' into concedo_experimental
...
# Conflicts:
# .github/workflows/build-cuda-ubuntu.yml
# .github/workflows/server-sanitize.yml
# .pi/gg/SYSTEM.md
# ci/README-MUSA.md
# ci/run.sh
# docs/backend/SYCL.md
# docs/build.md
# ggml/CMakeLists.txt
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/concat-ops.c
# ggml/src/ggml-hexagon/htp/cpy-ops.c
# ggml/src/ggml-hexagon/htp/hmx-mm-kernels-tiled.h
# ggml/src/ggml-hexagon/htp/htp-ops.h
# ggml/src/ggml-hexagon/htp/hvx-mm-kernels-tiled.h
# ggml/src/ggml-hexagon/htp/matmul-ops.c
# ggml/src/ggml-hexagon/htp/matmul-ops.h
# ggml/src/ggml-metal/CMakeLists.txt
# ggml/src/ggml-opencl/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-sycl/fattn.cpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# scripts/sync-ggml.last
# scripts/sync_vendor.py
# tests/test-backend-ops.cpp
# tests/test-batch-alloc.cpp
# tests/test-mtmd-impl.cpp
# tests/test-rpc-multi-server.cpp
2026-09-29 22:31:17 +08:00
Adrien Gallouët
31385c9ceb
common : add fs_write_atomic() ( #29642 )
...
- Check for buffered write errors when closing downloaded files.
- Use UTF-8 paths when writing ETag files on Windows.
- Write in binary mode on Windows.
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-09-29 13:46:53 +02:00
Adrien Gallouët
76a5bc86d1
common : use fs::path for cache dirs ( #29595 )
...
- Avoid useless string conversions on Windows.
- No need for BSD or emscripten special cases.
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-09-29 07:24:03 +02:00
Xuan-Son Nguyen
f1ea206218
batch: migrate speculative, mtmd and server to batch_ext ( #29385 )
...
* adapt common
* add common_batch
* wip
* wip: spec
* cont
* common_speculative_process
* server_batch to use common_batch
* rm some stale calls
Assisted-by: Claude Fable 5.1
* migrate mtmd
* handle imrope, handle return val of add()/add_embd()
* add spec zeros vector
* add warning on zero fill path
2026-09-28 19:52:45 +02:00
Adrien Gallouët
6c7a87f7e5
common : fix HF cache paths on Windows ( #29475 )
...
Check Pre-Tokenizer Hashes / pre-tokenizer-hashes (push) Has been cancelled
Python Type-Check / python type-check (push) Has been cancelled
Update Operations Documentation / update-ops-docs (push) Has been cancelled
Supersedes #29158
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-09-28 16:25:24 +02:00
Adrien Gallouët
4b1a27fa0e
common,rpc : simplify fs_create_directory_with_parents() ( #29432 )
...
The original function was broken on Windows for some unicode paths
Paths without a trailing separator now create the last directory too,
matching the function name. All current callers already include a
trailing separator, so this change does not affect them.
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-09-25 20:33:37 +02:00
Adrien Gallouët
27b20ba8b1
common : extract shared unicode path/string helpers ( #29415 )
...
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2026-09-25 11:40:41 +02:00
Xuan-Son Nguyen
fc343a84bb
llama: add llama_batch_ext ( #24669 )
...
* (wip) add llama_batch_ext
* wip
* updated design
* updated impl
* change signature
* unused var
* demo common_prompt_batch_decode
* fix pos
* tmp disable test-batch-alloc
* fix compat
* nits: add const
* no more pos_max
* add comment about llama_batch_ext_set_embd_state
* handle n_embd_out properly
* rename api --> embd_token
* llama_embd
* stub llama_batch_ext_set_embd_state
* support both token + embd + state in batch
* llama_batch_ext_add_embd
* upstream some changes
* nits
* fix test-batch-alloc
* add test for compat
2026-09-24 16:25:07 +02:00
Concedo
c43b36bcb5
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .github/workflows/build-ibm.yml
# .github/workflows/build-self-hosted.yml
# .github/workflows/code-style.yml
# .github/workflows/editorconfig.yml
# .github/workflows/fusion.yml
# .github/workflows/release.yml
# .github/workflows/server-sanitize.yml
# .pi/gg/SYSTEM.md
# CMakeLists.txt
# ci/run.sh
# common/CMakeLists.txt
# docs/backend/SYCL.md
# ggml/CMakeLists.txt
# ggml/src/ggml-cpu/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-sycl/CMakeLists.txt
# ggml/src/ggml-sycl/backend.hpp
# ggml/src/ggml-sycl/base.hpp
# ggml/src/ggml-sycl/common.hpp
# ggml/src/ggml-sycl/gemm.hpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-sycl/mem.cpp
# scripts/sync-ggml.last
# src/CMakeLists.txt
# tests/CMakeLists.txt
# tests/snapshots/nvidia-nemotron-3-nano-30b-a3b.schema
# tests/test-backend-ops.cpp
# tests/test-chat.cpp
# tests/test-llama-archs.cpp
# tests/test-quant-type-selection.cpp
# tools/mtmd/CMakeLists.txt
# tools/server/CMakeLists.txt
2026-09-14 22:44:04 +08:00
Concedo
a4f7e70b9f
Merge commit ' acecd56032' into concedo_experimental
...
# Conflicts:
# .github/workflows/build-cpu.yml
# common/CMakeLists.txt
# common/chat-auto-parser-generator.cpp
# docs/development/parsing.md
# grammars/README.md
# json_to_gbnf.py
# tests/CMakeLists.txt
# tests/test-chat-peg-parser.cpp
# tests/test-chat.cpp
# tests/test-grammar-integration.cpp
# tests/test-json-schema-to-grammar.cpp
# tools/cli/README.md
# tools/completion/README.md
# tools/server/README.md
2026-09-14 22:35:27 +08:00
Daniel Bevenius
093a2f86c3
common : move llama_n_rs_seq to before llama_decode ( #28749 )
...
This commit moves the llama_n_rs_seq function call to before the
llama_decode call and returns directly if the check is true, removing
the setting of res and the goto statement.
The motivation for this change is to avoid the llama_decode call if it
is not needed.
2026-09-14 05:24:05 +02:00
Concedo
4e3a25f3bc
Merge commit ' 9e54e687cb' into concedo_experimental
...
# Conflicts:
# docs/backend/snapdragon/windows.md
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp-drv.cpp
# ggml/src/ggml-hexagon/htp-drv.h
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-sycl/fattn-common.hpp
# ggml/src/ggml-sycl/fattn-onednn.cpp
# ggml/src/ggml-sycl/fattn-onednn.hpp
# ggml/src/ggml-sycl/fattn.cpp
# ggml/src/ggml-sycl/fattn.hpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-virtgpu/ggml-backend.cpp
# scripts/snapdragon/build.py
# tests/test-alloc.cpp
# tests/test-backend-ops.cpp
# tools/llama-bench/README.md
# tools/llama-bench/llama-bench.cpp
2026-08-31 18:05:39 +08:00
Xuan-Son Nguyen
50f068ffff
bench: add --tensor-read-lazy ( #27881 )
...
* bench: add --tensor-read-lazy
* rm the alias
* rename to LLAMA_LAZY_MODE_*
2026-08-28 20:51:05 +02:00
Concedo
8d223ab855
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .devops/openvino.Dockerfile
# .github/workflows/build-cache.yml
# .github/workflows/build-openvino.yml
# .github/workflows/build-self-hosted.yml
# .github/workflows/release.yml
# ci/run.sh
# docs/backend/OPENVINO.md
# docs/speculative.md
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/htp-ops.h
# ggml/src/ggml-hexagon/htp/hvx-arith.h
# ggml/src/ggml-hexagon/htp/hvx-log.h
# ggml/src/ggml-hexagon/htp/main.c
# ggml/src/ggml-hexagon/htp/unary-ops.c
# ggml/src/ggml-hexagon/htp/unary-ops.h
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-openvino/CMakeLists.txt
# ggml/src/ggml-openvino/ggml-decoder.cpp
# ggml/src/ggml-openvino/ggml-decoder.h
# ggml/src/ggml-openvino/ggml-openvino-extra.cpp
# ggml/src/ggml-openvino/ggml-openvino.cpp
# ggml/src/ggml-openvino/openvino/op/cpy.cpp
# ggml/src/ggml-openvino/openvino/op/flash_attn_ext.cpp
# ggml/src/ggml-openvino/openvino/op/gated_delta_net.cpp
# ggml/src/ggml-openvino/openvino/op/view.cpp
# ggml/src/ggml-openvino/openvino/op_table.cpp
# ggml/src/ggml-openvino/openvino/op_table.h
# ggml/src/ggml-openvino/openvino/translate_session.cpp
# ggml/src/ggml-openvino/openvino/utils.cpp
# ggml/src/ggml-openvino/utils.cpp
# ggml/src/ggml-openvino/utils.h
# ggml/src/ggml-sycl/fattn-onednn.cpp
# ggml/src/ggml-sycl/fattn.cpp
# scripts/pr2wt.sh
# src/CMakeLists.txt
# src/llama-mmap.cpp
# src/llama-quant.cpp
# tests/CMakeLists.txt
# tests/test-arg-parser.cpp
# tests/test-backend-ops.cpp
# tests/test-llama-archs.cpp
# tests/test-save-load-state.cpp
# tools/cli/README.md
# tools/completion/README.md
# tools/server/README.md
2026-08-28 22:29:03 +08:00
Xuan-Son Nguyen
fac889fb38
llama: model_loader: add TENSOR_READ_LAZY ( #27794 )
...
* llama: model_loader: add TENSOR_GET_ROW_LAZY
* add --tensor-read-lazy
* rename to TENSOR_READ_LAZY
* gen docs
* address comments
2026-08-27 15:14:34 +02:00
Concedo
4447017602
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .github/actions/ccache-clear/action.yml
# .github/workflows/build-apple.yml
# .github/workflows/build-cpu.yml
# .github/workflows/build-cuda-ubuntu.yml
# .github/workflows/build-opencl.yml
# .github/workflows/build-openvino.yml
# .github/workflows/build-sycl.yml
# .github/workflows/build-vulkan.yml
# .github/workflows/build-wasm.yml
# .github/workflows/build-webgpu.yml
# .github/workflows/hip-quality-check.yml
# .github/workflows/server.yml
# CONTRIBUTING.md
# README.md
# ci/run.sh
# common/CMakeLists.txt
# common/chat.cpp
# docs/autoparser.md
# ggml/src/ggml-webgpu/wgsl-shaders/flash_attn.wgsl
# ggml/src/ggml-webgpu/wgsl-shaders/flash_attn_tile.wgsl
# ggml/src/ggml-webgpu/wgsl-shaders/flash_attn_vec_split.wgsl
# scripts/sync_vendor.py
# tests/CMakeLists.txt
# tests/peg-parser/test-json-serialization.cpp
# tests/peg-parser/tests.h
# tests/test-chat-auto-parser.cpp
# tests/test-chat-peg-parser.cpp
# tests/test-chat-template.cpp
# tests/test-chat.cpp
# tests/test-grammar-integration.cpp
# tests/test-jinja.cpp
# tests/test-json-schema-to-grammar.cpp
# tests/test-llama-archs.cpp
# tests/test-model-resolution.cpp
# tests/test-recurrent-state-rollback.cpp
# tools/CMakeLists.txt
2026-08-25 20:44:34 +08:00
Concedo
3265983620
Merge commit ' 2fb989b9e7' into concedo_experimental
...
# Conflicts:
# .github/actions/ccache-clear/action.yml
# .github/workflows/build-cpu.yml
# .github/workflows/make-release.yml
# .github/workflows/release.yml
# .pi/gg/SYSTEM.md
# AGENTS.md
# README.md
# docs/build.md
# ggml/src/ggml-opencl/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-opencl/kernels/moe_combine.cl
# ggml/src/ggml-sycl/convert.cpp
# ggml/src/ggml-sycl/dequantize.hpp
# ggml/src/ggml-sycl/dmmv.cpp
# ggml/src/ggml-sycl/esimd.hpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-sycl/mmvq.cpp
# ggml/src/ggml-sycl/quants.hpp
# ggml/src/ggml-sycl/vecdotq.hpp
# src/CMakeLists.txt
# tests/test-llama-archs.cpp
# tools/llama-bench/llama-bench.cpp
# tools/mtmd/CMakeLists.txt
2026-08-25 20:30:15 +08:00
Bartosz Taudul
ba8e0eddfb
common : skip device_info loop if it's not going to be printed ( #26692 )
...
The device_info loop iterates over the discovered devices and gets
the available and total memory counts. With the CUDA backend (and
possibly others too) this requires creating a GPU context, which,
in case of CUDA, results in a 550 MB VRAM allocation.
For this information to be used in any way, the log verbosity must
be set to LOG_LEVEL_TRACE. If it's not, including in the default
configuration, the contexts get created, memory sizes get queried,
then the log function quietly discards the data.
In certain cases the user may not want to use any GPU resources.
The device_loop iteration is the only place touching the GPU that
cannot be skipped.
Fix by checking the verbosity level and skipping the loop if there
would be no output.
2026-08-23 14:39:16 +02:00
Xuan-Son Nguyen
2fb989b9e7
fit: also take into account n_streams ( #27496 )
...
* fit: also take into account n_streams
* server: make the draft context follow the target context
With a non-unified KV cache the target context now holds n_ctx_train
tokens per sequence, while the draft context was still created with
n_ctx = 0 and fell back to n_ctx_train / n_streams per sequence. A slot
filled beyond that point makes the draft batch fail to decode, and the
server answers 500 on the request.
The draft context now takes its size from the target context, so both
hold the same number of tokens per sequence. Contexts that share their
cells with the target no longer need the kv_size override.
The memory reserved for the draft model before fitting is measured at
the largest context the target can take, since the draft context grows
with the target and a fixed byte margin cannot express that.
* fit: take an optional second model into account
Illustrates the alternative discussed on the draft context fix. The
memory of a draft or MTP context is currently handed to the fit as a
fixed byte margin, which cannot express a memory that grows with the
context the fit is still deciding on.
common_fit_params now takes an optional second model that shares the
devices of the main one. Its context follows the main context and its
memory is measured again whenever that context changes, so the reduce
path stays exact instead of conservative. A model that cannot be
measured on its own, such as a shared cell MTP context, is skipped with
a warning and the main model is fitted alone.
This drops the reservation block in the server, which no longer has to
probe the trained context size of the target to guess an upper bound.
---------
Co-authored-by: Pascal <admin@serveurperso.com>
2026-08-22 16:16:06 +02:00
Concedo
8c732ca2cc
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .devops/openvino.Dockerfile
# .github/actions/windows-setup-cuda/action.yml
# .github/workflows/build-cache.yml
# .github/workflows/build-cpu.yml
# .github/workflows/build-cuda-windows.yml
# .github/workflows/build-openvino.yml
# .github/workflows/build-self-hosted.yml
# .github/workflows/build-vulkan.yml
# .github/workflows/docker.yml
# .github/workflows/make-release.yml
# .github/workflows/release.yml
# AUTHORS
# CMakeLists.txt
# README.md
# build-xcframework.sh
# ci/run.sh
# common/CMakeLists.txt
# docs/backend/OPENVINO.md
# examples/gguf-hash/CMakeLists.txt
# examples/gguf-hash/gguf-hash.cpp
# ggml/CMakeLists.txt
# ggml/src/ggml-cann/ggml-cann.cpp
# ggml/src/ggml-et/ggml-et.cpp
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/flash-attn-ops.c
# ggml/src/ggml-hexagon/htp/flash-attn-ops.h
# ggml/src/ggml-opencl/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-opencl/kernels/flash_attn_f16.cl
# ggml/src/ggml-opencl/kernels/flash_attn_f32.cl
# ggml/src/ggml-opencl/kernels/moe_sort_by_expert.cl
# ggml/src/ggml-openvino/ggml-openvino.cpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-webgpu/ggml-webgpu-shader-lib.hpp
# ggml/src/ggml-webgpu/ggml-webgpu.cpp
# ggml/src/ggml-webgpu/wgsl-shaders/common_decls.tmpl
# ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_decls.tmpl
# ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_reg_tile.wgsl
# ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_subgroup_matrix.wgsl
# ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_vec.wgsl
# ggml/src/ggml-webgpu/wgsl-shaders/mul_mat_vec_acc.tmpl
# scripts/sync-ggml.last
# tests/CMakeLists.txt
# tests/test-backend-ops.cpp
# tests/test-llama-archs.cpp
# tools/mtmd/CMakeLists.txt
# tools/mtmd/mtmd-helper.cpp
# tools/perplexity/perplexity.cpp
# tools/server/README.md
# tools/ui/src/lib/hooks/use-tools-panel.svelte.ts
# vendor/hash/CMakeLists.txt
2026-08-21 23:27:27 +08:00
Niklas Wenzel
3e7344670a
Revert "common: share thread pools when n_threads differ ( #27138 )" ( #27337 )
...
* Revert "common: share thread pools when `n_threads` differ (#27138 )"
This reverts commit 04b569142d
2026-08-19 18:05:48 +03:00
Niklas Wenzel
04b569142d
common: share thread pools when n_threads differ ( #27138 )
2026-08-18 16:23:43 +02:00
Concedo
886a42d446
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .github/workflows/build-cache.yml
# .github/workflows/build-cmake-pkg.yml
# .github/workflows/build-cpu.yml
# .github/workflows/build-cuda-windows.yml
# .github/workflows/build-sanitize.yml
# .github/workflows/release.yml
# .github/workflows/winget.yml
# CMakeLists.txt
# README.md
# app/llama.cpp
# cmake/llama-config.cmake.in
# cmake/llama.pc.in
# common/CMakeLists.txt
# common/build-info.h
# docs/backend/OPENVINO.md
# docs/backend/SYCL.md
# docs/preset.md
# ggml/CMakeLists.txt
# ggml/cmake/ggml-config.cmake.in
# ggml/src/ggml-cpu/kleidiai/kleidiai.cpp
# ggml/src/ggml-hip/CMakeLists.txt
# ggml/src/ggml-openvino/ggml-decoder.cpp
# ggml/src/ggml-openvino/ggml-decoder.h
# ggml/src/ggml-openvino/ggml-openvino-extra.cpp
# ggml/src/ggml-openvino/ggml-openvino-extra.h
# ggml/src/ggml-openvino/ggml-openvino.cpp
# ggml/src/ggml-openvino/ggml-quants.cpp
# ggml/src/ggml-openvino/ggml-quants.h
# ggml/src/ggml-openvino/openvino/decoder.h
# ggml/src/ggml-openvino/openvino/node_context.h
# ggml/src/ggml-openvino/openvino/op/cpy.cpp
# ggml/src/ggml-openvino/openvino/op/gated_delta_net.cpp
# ggml/src/ggml-openvino/openvino/op/get_rows.cpp
# ggml/src/ggml-openvino/openvino/op/l2_norm.cpp
# ggml/src/ggml-openvino/openvino/op/mul_mat_id.cpp
# ggml/src/ggml-openvino/openvino/op/repeat.cpp
# ggml/src/ggml-openvino/openvino/op/reshape.cpp
# ggml/src/ggml-openvino/openvino/op/rms_norm.cpp
# ggml/src/ggml-openvino/openvino/op/rope.cpp
# ggml/src/ggml-openvino/openvino/op/scale.cpp
# ggml/src/ggml-openvino/openvino/op/set_rows.cpp
# ggml/src/ggml-openvino/openvino/op/ssm_conv.cpp
# ggml/src/ggml-openvino/openvino/op/view.cpp
# ggml/src/ggml-openvino/openvino/op_table.cpp
# ggml/src/ggml-openvino/openvino/op_table.h
# ggml/src/ggml-openvino/openvino/translate_session.cpp
# ggml/src/ggml-openvino/openvino/utils.cpp
# ggml/src/ggml-openvino/openvino/utils.h
# ggml/src/ggml-openvino/utils.cpp
# ggml/src/ggml-openvino/utils.h
# ggml/src/ggml-sycl/common.hpp
# ggml/src/ggml-sycl/concat.cpp
# ggml/src/ggml-sycl/dmmv.cpp
# ggml/src/ggml-sycl/element_wise.cpp
# ggml/src/ggml-sycl/element_wise.hpp
# ggml/src/ggml-sycl/fusion.cpp
# ggml/src/ggml-sycl/fusion.hpp
# ggml/src/ggml-sycl/gated_delta_net.cpp
# ggml/src/ggml-sycl/gated_delta_net.hpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-sycl/mmvq.cpp
# ggml/src/ggml-sycl/mmvq.hpp
# scripts/sync-ggml.last
# src/CMakeLists.txt
# tests/test-backend-ops.cpp
# tests/test-chat.cpp
# tests/test-gguf.cpp
# tests/test-quantize-stats.cpp
# tools/cvector-generator/cvector-generator.cpp
# tools/mtmd/CMakeLists.txt
# tools/ui/src/lib/components/app/chat/ChatForm/ChatFormActions/ChatFormActionModels.svelte
2026-08-14 18:10:18 +08:00
Niklas Wenzel
a94d563ed8
common: apply CPU parameters across tools ( #27026 )
2026-08-13 20:40:59 +02:00
