Pascal e09a78a25d tests: fix CI flakes in server cancel and sleep tests (#31330) ...

test_cancel_request enables context shift so the generation only ends
when the request is cancelled, then polls /slots with a deadline.
Without context shift the generation fills the context and frees the
slot on its own on fast machines, so the test passes even with
cancellation disabled.

test_server_sleep uses the existing wait_for_sleep helper instead of a
fixed sleep.

2026-10-29 01:35:01 +01:00

..

test_basic.py

server: Add support for binding to multiple addresses (#28690)

2026-09-22 15:16:40 +02:00

test_chat_completion.py

server : fix usage.completion_tokens undercount with n > 1 (#29486)

2026-10-21 01:19:54 +02:00

test_compat_anthropic.py

common : support deferred tools and tool_reference content parts (#31256)

2026-10-27 18:39:11 +01:00

test_compat_gcp.py

server: support Vertex AI compatible API (#22545)

2026-05-08 15:23:04 +02:00

test_compat_oai_responses.py

server : add timings and progress to /responses API stream (#25348)

2026-07-07 16:13:03 +02:00

test_completion.py

tests: fix CI flakes in server cancel and sleep tests (#31330)

2026-10-29 01:35:01 +01:00

test_ctx_shift.py

memory : remove KV cache size padding (#16812)

2025-10-28 20:19:44 +02:00

test_embedding.py

server: return HTTP 400 for invalid embedding requests (#29060)

2026-10-01 16:52:43 +02:00

test_ignore_eos.py

server: respect the ignore eos flag (#21203)

2026-04-08 17:12:15 +02:00

test_infill.py

server : support unified cache across slots (#16736)

2025-11-02 18:14:04 +02:00

test_kv_keep_only_active.py

server: rename debug tags to match --cache-idle-slots naming (#22292)

2026-04-24 09:28:44 +03:00

test_lora.py

server : disable context shift by default (#15416)

2025-08-19 16:46:37 +03:00

test_mcp_servers.py

server : use pytest-xdist for server tests (#28298)

2026-09-03 15:04:30 +02:00

test_metrics.py

server: refactor + correctness fixes for metrics (#26920)

2026-08-13 10:02:01 +02:00

test_proxy.py

server: fix empty response for /cors-proxy (#26656)

2026-08-06 15:07:22 +02:00

test_rerank.py

server: save only restorable slot states to the prompt cache (#30498)

2026-10-15 06:30:17 +02:00

test_router.py

server: add router device memory margin parameter for dynamic unloading (#21231)

2026-10-27 12:14:42 +01:00

test_security.py

server : make models endpoints private when authentication is enabled (#26347)

2026-08-19 20:44:42 +02:00

test_sleep.py

tests: fix CI flakes in server cancel and sleep tests (#31330)

2026-10-29 01:35:01 +01:00

test_slot_save.py

server: fix the off-by-two in the SWA reuse threshold (#30580)

2026-10-15 16:25:19 +03:00

test_speculative.py

server: Support logprobs with speculative decoding (#27196)

2026-10-20 19:36:14 +02:00

test_stream.py

server + ui: fix stream routes for model names containing a slash (#26137)

2026-07-27 07:34:47 +02:00

test_systemone.py

server: prefer empty slots and keep states overwritten by child tasks (#30567)

2026-10-15 16:24:01 +03:00

test_template.py

tests : use reasoning instead of reasoning_budget in server tests (#20432)

2026-03-12 13:41:01 +01:00

test_tokenize.py

server : disable context shift by default (#15416)

2025-08-19 16:46:37 +03:00

test_tool_call.py

common : support deferred tools and tool_reference content parts (#31256)

2026-10-27 18:39:11 +01:00

test_tools_builtin.py

server : use pytest-xdist for server tests (#28298)

2026-09-03 15:04:30 +02:00

test_vision_api.py

server : support typed content (vision/audio/video) input for /v1/embeddings endpoint (#29556)

2026-09-28 21:40:38 +02:00