wmantly/turing-multi-gpu-llm-server
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: update to Q5_K_P @ 128K ctx, non-blocking proxy sessions, and full multi-GPU benchmark suite

Browse Source
This commit is contained in:
wmantly committed 2026-09-13 02:14:25 +00:00
1 parent cfeac35ad6
commit cd989b3e70
5 files changed
+406 -37
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

README.md
+3 -1
View File
@@ -78,7 +78,9 @@ Pick **`qwen:fast`** for instant answers (0 thinking delay) or **`qwen:think`**
---
## 📜 Documentation Links
## 📜 Documentation & Benchmark Links
* [Comprehensive Multi-GPU Benchmark Results (Q4/Q5/Q6/Gemma4 MoE)](benchmarks/BENCHMARK_RESULTS.md)
* [Detailed Client Usage Guide (OpenWebUI, Ollama, OpenAI, Anthropic, Continue.dev)](docs/USAGE-CLIENTS.md)
* [Detailed Step-by-Step Setup Guide](docs/SETUP_GUIDE.md)
* [Proxmox LXC Passthrough & Permissions Guide](docs/PROXMOX_LXC_GUIDE.md)
* [Hardware Architecture & CMP Learnings](docs/HARDWARE_LEARNINGS.md)