 wmantly
|
7269a96313
|
fix(proxy): dynamically report exact 128K context window (131072) and Q5_K_P quantization across all API endpoints
|
2026-09-18 02:10:00 +00:00 |
|
|
wmantly
|
aebc82e403
|
fix(proxy): handle client aborts and broken pipe disconnections gracefully without 500 errors
|
2026-09-16 00:34:14 +00:00 |
|
|
wmantly
|
05720793ad
|
fix(proxy): add safe_json_loads to prevent 500 errors on streaming tool call decoding
|
2026-09-13 02:18:52 +00:00 |
|
|
wmantly
|
cd989b3e70
|
feat: update to Q5_K_P @ 128K ctx, non-blocking proxy sessions, and full multi-GPU benchmark suite
|
2026-09-13 02:14:25 +00:00 |
|
|
wmantly
|
cfeac35ad6
|
Configure HauhauCS FastMTP 32K draft head, reasoning parameters, and non-thinking mode
|
2026-09-06 22:46:11 +00:00 |
|
|
wmantly
|
2af141b38e
|
fix(proxy): expose /props with vision modality and architecture meta in /v1/models for Maki local discovery
|
2026-09-05 02:42:20 +00:00 |
|
|
wmantly
|
096fb421d1
|
fix(proxy): add input_modalities: [text, image] in /v1/models for Maki vision discovery
|
2026-09-04 20:55:12 +00:00 |
|
|
wmantly
|
ac66e70c89
|
feat: advertise clip family and vision capabilities in Ollama metadata and handle Anthropic image blocks
|
2026-09-04 20:51:11 +00:00 |
|
|
wmantly
|
9ab0583cab
|
feat: implement session-managed persistent KV cache architecture with slot persistence and management API
|
2026-09-04 02:53:54 +00:00 |
|
|
wmantly
|
c30f4772f9
|
Fix power governor active retention during long prompt evaluations and remove redundant proxy governor thread
|
2026-09-01 14:40:19 +00:00 |
|
|
wmantly
|
aeb72cecfa
|
Initial commit: Complete deployment scripts, power governor, systemd units, and architecture documentation for Turing multi-GPU LLM rig
|
2026-09-01 01:55:19 +00:00 |
|