Gabe Goodhart 23f7aabc16 model : Granite Switch Decision (#30676) ...

* feat(convert): Add decision.chat to support decision models that can also chat

Branch: GraniteSwitchDecision
AI-usage: full (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(convert): Add conversion for Granite Switch as decision model

The template follows from the usage sample:
https://huggingface.co/ibm-granite/granite-switch-4.1-8b#guardian-and-decision-side-by-side

Branch: GraniteSwitchDecision
AI-usage: draft (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(common): Add support for chat+decision models in common

Branch: GraniteSwitchDecision
AI-usage: full (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(common): Add granite switch decision model enum

Branch: GraniteSwitchDecision
AI-usage: full (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(server): Plumb through decision_chat bool to support decision+chat models

Branch: GraniteSwitchDecision
AI-usage: full (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(server): Add Granite Switch decision support

Branch: GraniteSwitchDecision
AI-usage: draft (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* docs: Update server README for granite switch decisions / chat+decisions

Branch: GraniteSwitchDecision
AI-usage: draft (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* Revert "feat(convert): Add decision.chat to support decision models that can also chat"

This reverts commit 952ef567647e53ac9beda7a1f79d6927240d068d.

* Revert "feat(common): Add support for chat+decision models in common"

This reverts commit 93ed782e3a8b2fd5968732c6525c7ad29ad4bea2.

* Revert "feat(server): Plumb through decision_chat bool to support decision+chat models"

This reverts commit 97e9af60ddaccbd82f1eb0a488adff43b16ee095.

* fix: If Granite Switch supports decisions, it always supports text too

Branch: GraniteSwitchDecision
AI-usage: none
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* docs: Remove reference to decision.chat in server README

Branch: GraniteSwitchDecision
AI-usage: none
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

2026-10-16 20:00:41 +02:00

..

batched-bench

batch: migrate the rest of examples to llama_batch_ext (#29601)

2026-09-30 18:08:43 +02:00

cli

server: save only restorable slot states to the prompt cache (#30498)

2026-10-15 06:30:17 +02:00

completion

chat: replace output string with parts (#30389)

2026-10-14 01:03:56 +02:00

cvector-generator

batch: migrate the rest of examples to llama_batch_ext (#29601)

2026-09-30 18:08:43 +02:00

export-lora

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

2026-06-18 16:46:17 +02:00

fit-params

server: use port 9931 by default (#30159)

2026-10-09 10:40:03 +02:00

gguf-split

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

imatrix

imatrix : include clocale for std::setlocale (#30079)

2026-10-07 10:58:22 +02:00

llama-bench

llama-bench: respect -fitc if bigger than required benchmark size (#28331)

2026-10-09 19:14:30 +02:00

mtmd

mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629)

2026-10-16 01:46:42 +02:00

perplexity

batch: migrate the rest of examples to llama_batch_ext (#29601)

2026-09-30 18:08:43 +02:00

quantize

quantize: cap working memory size to avoid loading big tensors onto RAM (#27795)

2026-08-27 18:31:13 +02:00

results

batch: migrate the rest of examples to llama_batch_ext (#29601)

2026-09-30 18:08:43 +02:00

rpc

rpc : turn GGML_RPC_DEBUG into a verbosity level and add logs (#29544)

2026-10-11 17:43:35 +03:00

server

model : Granite Switch Decision (#30676)

2026-10-16 20:00:41 +02:00

tokenize

tokenize : drop --stdin mutual-exclusion check (#25672)

2026-07-15 18:41:51 +02:00

tts

args: add --video-* CLI arguments (#24318)

2026-08-27 12:11:12 +02:00

tuning

metal : key the fa-vec tuned table by family instead of SKU (#29075)

2026-09-23 19:23:15 +08:00

ui

fix(ui): take the agentic turns default from DEFAULT_AGENTIC_CONFIG (#30582)

2026-10-15 12:36:06 +02:00

CMakeLists.txt

metal : per-device tuned (Q, NE) for flash-attn vec (#26570)

2026-08-24 19:22:27 +03:00