diff --git a/README.md b/README.md index a8ade35..4e0560b 100644 --- a/README.md +++ b/README.md @@ -9,9 +9,9 @@ A production-grade, highly optimized software and hardware configuration for run * **Model**: `Qwen3.8-27B-Uncensored` (`Q4_K_P` Quantization, 16.68 GB weights) * **Context Window**: **`262,144 tokens` (Full 256K Context)** with zero OOM crashes * **Multimodal Vision**: Active (`mmproj` ViT GGUF projector for image recognition) -* **Decode Speed**: **`17.66 – 18.03 tok/s`** (sustained across 3 GPUs in NCCL tensor parallel) -* **Prompt Processing Speed**: **`140.3 – 179.4 tok/s`** (2x speedup using low-latency NCCL ring buffers & Flash Attention) -* **Idle Power**: Automatically downclocks CMP cards to 300–600 MHz, cutting idle draw from **200W+ down to ~100W** (~100W wall power savings!) +* **Decode Speed**: **`38.7 – 44.6 tok/s`** 🚀 *(2.2x speedup using native Multi-Token Prediction (MTP) speculation & kernel unlocks)* +* **Prompt Processing Speed**: **`325.0 – 502.6 tok/s`** ⚡ *(0.5k tok/s prefill on 4k context with ubatch 512 & PCIe Gen2)* +* **Idle Power**: Driver unlock & NVAPI P-state governor drop idle power from **~240W down to `~33W total`** across all 3 GPUs! * **API Compatibility**: Fully compatible with **Ollama** (`http://:11434`), **OpenAI** (`/v1/chat/completions`), and **Anthropic Messages** (`/v1/messages`) for OpenWebUI, Claude Code, and Continue.dev. ---