Gaurav Garg dd1ea52433 llama : support multi-output backend sampling (#25532) ... * Enable backend sampling with token speculation * Clamp the mask sum before converting it into the sampled index * Add a numeric context parameter declaring the maximum outputs one sequence * More fixes * Don't reuse memory for output views. * Match dist between CPU and GPU * Fix CPU and backend sampling mismatches * Simpify some of the changes * Fix tests on Vulkan * More test fixes * Rebase changes * Rebase and address review comments * Address review comments * Address review comments * Update src/llama-sampler.cpp Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>		2026-08-10 16:58:56 +03:00
..
test_basic.py	server: remove all internal mentions about "webui" (#24817)	2026-06-19 22:12:46 +02:00
test_chat_completion.py	server: add "verbose" field to schema (#24864)	2026-06-21 13:03:14 +02:00
test_compat_anthropic.py	server : fix image blocks in tool_result being dropped during Anthropic OpenAI conversion (#22536)	2026-07-12 17:43:51 +02:00
test_compat_gcp.py	server: support Vertex AI compatible API (#22545)	2026-05-08 15:23:04 +02:00
test_compat_oai_responses.py	server : add timings and progress to /responses API stream (#25348)	2026-07-07 16:13:03 +02:00
test_completion.py	server : add missing task parameters(adaptive_target, adaptive_decay) in generation_settings (#25830)	2026-07-25 20:53:08 +02:00
test_ctx_shift.py	memory : remove KV cache size padding (#16812)	2025-10-28 20:19:44 +02:00
test_embedding.py	llama : fix pooling assertion crash in chunked GDN detection path (#20468)	2026-03-13 20:53:42 +02:00
test_ignore_eos.py	server: respect the ignore eos flag (#21203)	2026-04-08 17:12:15 +02:00
test_infill.py	server : support unified cache across slots (#16736)	2025-11-02 18:14:04 +02:00
test_kv_keep_only_active.py	server: rename debug tags to match --cache-idle-slots naming (#22292)	2026-04-24 09:28:44 +03:00
test_lora.py	server : disable context shift by default (#15416)	2025-08-19 16:46:37 +03:00
test_mcp_servers.py	server: support MCP stdio (#26062)	2026-07-26 01:08:49 +02:00
test_proxy.py	server: fix empty response for /cors-proxy (#26656)	2026-08-06 15:07:22 +02:00
test_rerank.py	server / ranking : add sorting and management of top_n (#16403)	2025-10-11 16:39:04 +03:00
test_router.py	tests : speed-up server test suite 3x (#26734)	2026-08-07 21:38:32 +03:00
test_security.py	server: add --cors-* options (#25655)	2026-07-14 17:23:44 +02:00
test_sleep.py	server: add auto-sleep after N seconds of idle (#18228)	2025-12-21 02:24:42 +01:00
test_slot_save.py	server : allow text-only slot save/restore with mtmd (#25076)	2026-07-16 15:26:44 +03:00
test_speculative.py	llama : support multi-output backend sampling (#25532)	2026-08-10 16:58:56 +03:00
test_stream.py	server + ui: fix stream routes for model names containing a slash (#26137)	2026-07-27 07:34:47 +02:00
test_template.py	tests : use reasoning instead of reasoning_budget in server tests (#20432)	2026-03-12 13:41:01 +01:00
test_tokenize.py	server : disable context shift by default (#15416)	2025-08-19 16:46:37 +03:00
test_tool_call.py	common/autoparser: fixes for newline handling / forced tool calls (#22654)	2026-05-04 13:18:11 +02:00
test_tools_builtin.py	server: add more tool isolation support (ssh remote + podman rootless) (#26774)	2026-08-10 13:31:09 +02:00
test_vision_api.py	mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)	2026-06-06 11:06:51 +02:00