koboldcpp/tools/mtmd
Concedo 8826b9c532 Merge branch 'upstream' into concedo_experimental
# Conflicts:
#	.devops/cann.Dockerfile
#	.devops/cpu.Dockerfile
#	.devops/cuda.Dockerfile
#	.devops/intel.Dockerfile
#	.devops/musa.Dockerfile
#	.devops/rocm.Dockerfile
#	.devops/vulkan.Dockerfile
#	.devops/zendnn.Dockerfile
#	.github/workflows/build-sycl.yml
#	.github/workflows/python-type-check.yml
#	.github/workflows/release.yml
#	.pi/gg/SYSTEM.md
#	CMakeLists.txt
#	docs/backend/snapdragon/developer.md
#	docs/backend/zDNN.md
#	examples/sycl/build.sh
#	examples/sycl/win-build-sycl.bat
#	ggml/CMakeLists.txt
#	ggml/src/ggml-hexagon/CMakeLists.txt
#	ggml/src/ggml-hexagon/ggml-hexagon.cpp
#	ggml/src/ggml-hexagon/htp-opnode.h
#	ggml/src/ggml-hexagon/htp/CMakeLists.txt
#	ggml/src/ggml-hexagon/htp/flash-attn-ops.c
#	ggml/src/ggml-hexagon/htp/get-rows-ops.c
#	ggml/src/ggml-hexagon/htp/get-rows-ops.h
#	ggml/src/ggml-hexagon/htp/hmx-mm-kernels-tiled.h
#	ggml/src/ggml-hexagon/htp/htp-ctx.h
#	ggml/src/ggml-hexagon/htp/htp-dcache.c
#	ggml/src/ggml-hexagon/htp/htp-ops.h
#	ggml/src/ggml-hexagon/htp/htp-tensor.h
#	ggml/src/ggml-hexagon/htp/hvx-mm-kernels-float.h
#	ggml/src/ggml-hexagon/htp/hvx-mm-kernels-tiled.h
#	ggml/src/ggml-hexagon/htp/hvx-quant.h
#	ggml/src/ggml-hexagon/htp/main.c
#	ggml/src/ggml-hexagon/htp/matmul-ops.c
#	ggml/src/ggml-hexagon/htp/matmul-ops.h
#	ggml/src/ggml-metal/CMakeLists.txt
#	ggml/src/ggml-opencl/ggml-opencl.cpp
#	ggml/src/ggml-opencl/kernels/clamp.cl
#	ggml/src/ggml-opencl/kernels/flash_attn_f16.cl
#	ggml/src/ggml-opencl/kernels/flash_attn_f32.cl
#	ggml/src/ggml-opencl/kernels/flash_attn_f32_f16.cl
#	ggml/src/ggml-opencl/kernels/flash_attn_f32_q4_0.cl
#	ggml/src/ggml-opencl/kernels/flash_attn_f32_q8_0.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_iq4_nl_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q1_0_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q4_0_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q4_0_f32_spec.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q4_1_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q4_k_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q4_k_f32_o4.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q5_0_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q5_1_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q5_k_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q6_k_f32.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q6_k_f32_o4.cl
#	ggml/src/ggml-opencl/kernels/gemv_noshuffle_q8_0_f32.cl
#	ggml/src/ggml-openvino/openvino/op/glu_swiglu.cpp
#	ggml/src/ggml-sycl/CMakeLists.txt
#	ggml/src/ggml-sycl/convert.cpp
#	ggml/src/ggml-sycl/dequantize.hpp
#	ggml/src/ggml-sycl/ggml-sycl.cpp
#	ggml/src/ggml-sycl/mmvq.cpp
#	ggml/src/ggml-sycl/quants.hpp
#	ggml/src/ggml-sycl/vecdotq.hpp
#	scripts/server-bench.py
#	scripts/snapdragon/run.py
#	scripts/sync-ggml.last
#	src/llama-vocab.cpp
#	tests/llama-context/cases-kv.cpp
#	tests/test-backend-ops.cpp
#	tests/test-chat.cpp
#	tests/test-jinja.cpp
#	tests/test-llama-archs.cpp
#	tests/test-mtmd-impl.cpp
#	tests/test-thread-safety.cpp
#	tests/test-unicode.cpp
#	tools/cli/README.md
#	tools/mtmd/CMakeLists.txt
#	tools/server/README.md
2026-10-16 13:43:20 +08:00
..
debug Merge commit '873e5d8e39' into concedo_experimental 2026-08-24 21:15:18 +08:00
legacy-models chore : correct typos [no ci] (#20041) 2026-03-05 08:50:21 +01:00
models mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629) 2026-10-16 01:46:42 +02:00
tests sampler : remove "full-context windows" from history-based samplers (#26524) 2026-08-04 21:28:55 +03:00
clip-graph.h model : support MiniCPM-V 4.7 (#29416) 2026-10-10 20:41:59 +02:00
clip-impl.h Merge branch 'upstream' into concedo_experimental 2026-10-16 13:43:20 +08:00
clip-model.h model: add Muse Spark Open (text, vision and audio) (#30616) 2026-10-15 23:27:12 +02:00
clip.cpp Merge branch 'upstream' into concedo_experimental 2026-10-16 13:43:20 +08:00
clip.h mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629) 2026-10-16 01:46:42 +02:00
deprecation-warning.cpp llama : add missing headers (#28566) 2026-09-08 12:59:53 +02:00
llava.h updated to handle changes for clip_is_mrope 2026-04-21 19:34:32 +08:00
mtmd-audio.cpp mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629) 2026-10-16 01:46:42 +02:00
mtmd-audio.h mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629) 2026-10-16 01:46:42 +02:00
mtmd-cli.cpp mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629) 2026-10-16 01:46:42 +02:00
mtmd-helper-common.h mtmd: fix GCC 15 stringop-overflow in decode_embd_batch (#29607) 2026-09-29 01:21:37 +02:00
mtmd-helper-gen.cpp batch: migrate speculative, mtmd and server to batch_ext (#29385) 2026-09-28 19:52:45 +02:00
mtmd-helper.cpp Merge commit 'ebe18bee5a' into concedo_experimental 2026-10-07 23:18:17 +08:00
mtmd-helper.h batch: migrate speculative, mtmd and server to batch_ext (#29385) 2026-09-28 19:52:45 +02:00
mtmd-image.cpp mtmd: lightonocr does not require longest edge to always be 1540, native resolution is the default (#30600) 2026-10-15 23:53:02 +02:00
mtmd-image.h mtmd: lightonocr does not require longest edge to always be 1540, native resolution is the default (#30600) 2026-10-15 23:53:02 +02:00
mtmd-internal.h mtmd: add mtmd_tokenize_from_parts() (#28250) 2026-09-02 21:20:10 +02:00
mtmd.cpp mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629) 2026-10-16 01:46:42 +02:00
mtmd.h mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629) 2026-10-16 01:46:42 +02:00
README-dev.md skill: note about model-specific CLI arguments + testings (#29808) 2026-10-01 19:53:23 +02:00
requirements.txt requirements: use stable torch packages on s390x (#26864) 2026-08-11 21:58:53 +08:00
test-1.jpeg mtmd : rename llava directory to mtmd (#13311) 2025-05-05 16:02:55 +02:00
test-2.mp3 mtmd : support Qwen 2.5 Omni (input audio+vision, no audio output) (#13784) 2025-05-27 14:06:10 +02:00
tests.sh mtmd: add batching for mtmd-cli, add video tests (#24778) 2026-06-18 21:55:04 +02:00