This website requires JavaScript.
Explore
Help
Sign In
wmantly
/
turing-multi-gpu-llm-server
Watch
1
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
Wiki
Activity
Files
4a03c7571026cdec3f4015be74db43c3d45de463
turing-multi-gpu-llm-server
/
scripts
T
History
wmantly
4a03c75710
Perf: Enable native MTP speculative decoding (draft-n-max 2), achieving 38.73 tok/s (+120% speedup) at 64.8% draft acceptance
2026-09-02 01:00:57 +00:00
..
build-nccl-llama.sh
Initial commit: Complete deployment scripts, power governor, systemd units, and architecture documentation for Turing multi-GPU LLM rig
2026-09-01 01:55:19 +00:00
ollama-proxy.py
Fix power governor active retention during long prompt evaluations and remove redundant proxy governor thread
2026-09-01 14:40:19 +00:00
power-governor.py
Enhancement: Integrate NVAPI P8 deep idle downclocking into power governor script
2026-09-02 00:05:23 +00:00
start-server.sh
Perf: Enable native MTP speculative decoding (draft-n-max 2), achieving 38.73 tok/s (+120% speedup) at 64.8% draft acceptance
2026-09-02 01:00:57 +00:00
tune-gpus.sh
Initial commit: Complete deployment scripts, power governor, systemd units, and architecture documentation for Turing multi-GPU LLM rig
2026-09-01 01:55:19 +00:00