vrr/koboldcpp
2
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-10-23 14:50:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
koboldcpp/kcpp_src
History
askmyteapot 43e511ef6e
Expose lazy tensor loading and the upstream MoE GPU cache (#2544) 
* model: add native lazy-loading and MoE cache inputs

* model: propagate lazy mode and target-only MoE cache

* launcher: expose lazy tensors and MoE cache in GUI, CLI and configs

* tests: cover memory option defaults, validation and config round trips

* docs: explain lazy tensor loading and experimental expert cache

* docs: trim trailing blank line

* Delete tests/test_model_memory_options.py

* docs: clarify temporary validation checks were removed

* logging: keep scheduler reallocation traces in verbose mode

* model: append new memory fields to native input struct

* launcher: append memory fields in matching ctypes order

* docs: remove guide already covered upstream
2026-10-18 11:51:26 +08:00
..
bin refactor: cleanup project root 3 2026-09-29 00:08:43 +08:00
lib refactor: cleanup project root 1 2026-09-28 23:53:06 +08:00
packaging relocate environment files for conda 2026-09-29 00:13:46 +08:00
expose.cpp refactor: cleanup project root 1 2026-09-28 23:53:06 +08:00
expose.h Expose lazy tensor loading and the upstream MoE GPU cache (#2544) 2026-10-18 11:51:26 +08:00
gpttype_adapter.cpp Expose lazy tensor loading and the upstream MoE GPU cache (#2544) 2026-10-18 11:51:26 +08:00
hash.cpp refactor: cleanup project root 1 2026-09-28 23:53:06 +08:00
json_to_gbnf.py refactor: cleanup project root 3 2026-09-29 00:08:43 +08:00
kcpp_backend.cpp refactor: cleanup project root 1 2026-09-28 23:53:06 +08:00
kcpp_backend.h refactor: cleanup project root 1 2026-09-28 23:53:06 +08:00
model_adapter.cpp refactor: cleanup project root 1 2026-09-28 23:53:06 +08:00
model_adapter.h refactor: cleanup project root 1 2026-09-28 23:53:06 +08:00
README.md relocate environment files for conda 2026-09-29 00:13:46 +08:00
simplecpuinfo.cpp refactor: cleanup project root 1 2026-09-28 23:53:06 +08:00

README.md

KoboldCpp native sources

This directory contains KoboldCpp-owned implementation and build-support code. Upstream-synced llama.cpp and ggml sources remain in their original directories so upstream updates can continue to be merged without path-only conflicts.

Prebuilt helper programs and link inputs used by KoboldCpp builds live under bin/ and lib/, respectively. Release version metadata and its generation scripts live under packaging/; Conda environment definitions are kept in packaging/environments/.