Pascal 23b0202a18 server: leave a busy slot untouched when a request pins it (#30295) ...

A request asking for a busy id_slot still ran the prompt cache update
on that slot before being deferred. When the RAM cache held a better
match, it was loaded into the slot while another request was still
generating there, and that generation continued on the wrong context.

The busy slot is now returned as is and the request waits for it.

2026-10-10 21:25:38 +02:00

..

test_basic.py

server: Add support for binding to multiple addresses (#28690)

2026-09-22 15:16:40 +02:00

test_chat_completion.py

server: add "verbose" field to schema (#24864)

2026-06-21 13:03:14 +02:00

test_compat_anthropic.py

server : use pytest-xdist for server tests (#28298)

2026-09-03 15:04:30 +02:00

test_compat_gcp.py

server: support Vertex AI compatible API (#22545)

2026-05-08 15:23:04 +02:00

test_compat_oai_responses.py

server : add timings and progress to /responses API stream (#25348)

2026-07-07 16:13:03 +02:00

test_completion.py

server: leave a busy slot untouched when a request pins it (#30295)

2026-10-10 21:25:38 +02:00

test_ctx_shift.py

memory : remove KV cache size padding (#16812)

2025-10-28 20:19:44 +02:00

test_embedding.py

server: return HTTP 400 for invalid embedding requests (#29060)

2026-10-01 16:52:43 +02:00

test_ignore_eos.py

server: respect the ignore eos flag (#21203)

2026-04-08 17:12:15 +02:00

test_infill.py

server : support unified cache across slots (#16736)

2025-11-02 18:14:04 +02:00

test_kv_keep_only_active.py

server: rename debug tags to match --cache-idle-slots naming (#22292)

2026-04-24 09:28:44 +03:00

test_lora.py

server : disable context shift by default (#15416)

2025-08-19 16:46:37 +03:00

test_mcp_servers.py

server : use pytest-xdist for server tests (#28298)

2026-09-03 15:04:30 +02:00

test_metrics.py

server: refactor + correctness fixes for metrics (#26920)

2026-08-13 10:02:01 +02:00

test_proxy.py

server: fix empty response for /cors-proxy (#26656)

2026-08-06 15:07:22 +02:00

test_rerank.py

server / ranking : add sorting and management of top_n (#16403)

2025-10-11 16:39:04 +03:00

test_router.py

server: Dedup the draft HF model via dedup-cache-models (#27934)

2026-09-23 12:57:53 +02:00

test_security.py

server : make models endpoints private when authentication is enabled (#26347)

2026-08-19 20:44:42 +02:00

test_sleep.py

server: fix token counting API crash on sleep (#29309)

2026-09-23 15:28:49 +02:00

test_slot_save.py

server : preserve context checkpoints across slot save/restore (#26004)

2026-10-08 13:18:20 +03:00

test_speculative.py

spec: Add benchmark-only synthetic speculative acceptance options (#27711)

2026-08-27 13:53:42 +03:00

test_stream.py

server + ui: fix stream routes for model names containing a slash (#26137)

2026-07-27 07:34:47 +02:00

test_systemone.py

llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) (#29818)

2026-10-02 11:56:04 +02:00

test_template.py

tests : use reasoning instead of reasoning_budget in server tests (#20432)

2026-03-12 13:41:01 +01:00

test_tokenize.py

server : disable context shift by default (#15416)

2025-08-19 16:46:37 +03:00

test_tool_call.py

server : use pytest-xdist for server tests (#28298)

2026-09-03 15:04:30 +02:00

test_tools_builtin.py

server : use pytest-xdist for server tests (#28298)

2026-09-03 15:04:30 +02:00

test_vision_api.py

server : support typed content (vision/audio/video) input for /v1/embeddings endpoint (#29556)

2026-09-28 21:40:38 +02:00