mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-10-31 19:01:39 +00:00
8bb3cf0d21
* hexagon: move the converting CPY in blocks of rows per DMA descriptor so short rows are not DMA-latency bound * hex-cpy: cleanup cpy cursor handling * hex-cpy-concat: introduce threaded dma/hvx gather-row helper Co-authored-by: Ruslan Karymov <67752306+karusrus@users.noreply.github.com> * hex-cpy: remove leftover rejections for extended buffers * hex-cpy: relax the gate for fast-path * hex-cpy: remove scalar divs and vtcm access and use explicit gather_sync * hex-cpy: add proper support for mdev work splitting to fastpath * hex-cpy: optimize dense gather-row tasks * hex-cpy: unroll gather-rows loops * hex-cpy: add fastpath for f16 * hex-cpy-concat: support for colapsing 3/4D dims * hex-cpy: double-buffer support * hex-cpy: factor out gather-rows into more of an op by itself * hex-cpy-concat: dedup kernel-params * hex-cpy-concat: step-down nr to fit instead of hard fail * hex-gather: replace div with a mask * hex-gather-rows: cleanup dma pipeline and remove the stalls * hex-gather: specialize compute funcs * hex-gather: reduce scalar reg.spills and func calls * hex-gather: do not recompute rows-per-thread on the npu * hex-build: add support for building/installing just hexagon * hex-cpy-concat: remove redundant barrier in concat and move cpy barrier under fence * hex-gather: annotations for dma-out * hex-mdev: make all key vtcm_acquire sync state atomic (fixes random hangs in mdev setups) --------- Co-authored-by: Yiwei Shao <yiwei@aizip.ai> Co-authored-by: Ruslan Karymov <67752306+karusrus@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| apple | ||
| hip | ||
| jinja | ||
| snapdragon | ||
| bench-models.sh | ||
| build-info.sh | ||
| build-profile.ps1 | ||
| build-profile.sh | ||
| ccache-clear.sh | ||
| check-apiabi-compat.sh | ||
| check-release-apiabi.sh | ||
| check-requirements.sh | ||
| compare-commits.sh | ||
| compare-llama-bench.py | ||
| compare-logprobs.py | ||
| create_ops_docs.py | ||
| debug-test.sh | ||
| gen-authors.sh | ||
| gen-unicode-data.py | ||
| get-flags.mk | ||
| get-hellaswag.sh | ||
| get-pg.sh | ||
| get-wikitext-2.sh | ||
| get-winogrande.sh | ||
| get_chat_template.py | ||
| git-bisect-run.sh | ||
| git-bisect.sh | ||
| hf.sh | ||
| install-oneapi.bat | ||
| make-release-checks.sh | ||
| make-release-desc.sh | ||
| make-release-summary.txt | ||
| pr2wt.sh | ||
| release.sh | ||
| serve-static.js | ||
| server-bench.py | ||
| server-test-function-call.py | ||
| server-test-model.py | ||
| server-test-parallel-tc.py | ||
| server-test-structured.py | ||
| sync-ggml-am.sh | ||
| sync-ggml.last | ||
| sync-ggml.sh | ||
| sync_vendor.py | ||
| tool_bench.py | ||
| tool_bench.sh | ||
| ui-assets.cmake | ||
| verify-checksum-models.py | ||
| wc2wt.sh | ||