llama.cpp-xrip

0 Fork 0

Files

T

Toki Nasin 7481354a17 convert : fix token configuration for PLaMo-3 (#29843 )

* convert : Fix token configuration for PLaMo-3

The reasoning and tool calling tags in PLaMo-3 consist of three tokens
each. For example, for reasoning:

* reasoning start: `<|plamo:begin_`, `think`, `:plamo|>`
* reasoning end: `<|plamo:end_`, `think`, `:plamo|>`

Registering `<|plamo:begin_`, `<|plamo:end_`, and `:plamo|>` as
`USER_DEFINED` so that they are parsed correctly.

Also PLaMo-3 models use <|plamo:tag|> as EOT, while PLaMo-2 models
use <|plamo:op|>.

Take EOT token as a parameter and look it up so that PLaMo-2 and
PLaMo-3 can use their appropriate ones.

* use NORMAL instead of USER_DEFINED

2026-10-07 11:34:16 +02:00

__init__.py

model : add K2 Horizon dense and MoVA support (#29535 )

2026-10-06 18:42:24 +02:00

afmoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

arctic.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

baichuan.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bailingmoe3.py

model : add Ling 3.0 VL support (#29151 )

2026-09-24 08:57:31 +02:00

bailingmoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

base.py

convert : fix token configuration for PLaMo-3 (#29843 )

2026-10-07 11:34:16 +02:00

bert.py

llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) (#29818 )

2026-10-02 11:56:04 +02:00

bitnet.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bloom.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

chameleon.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

chatglm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

clef.py

server: support vision input for Clef (#29969 )

2026-10-05 14:02:40 +02:00

codeshell.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

cogvlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

command_r.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dbrx.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

deci.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

deepseek.py

convert : skip bias_vl tensor in DeepSeek-V4 DSpark conversion (#28294 )

2026-09-03 10:37:23 +03:00

dots1.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dots3.py

mtmd: support dots3-note vision+audio (#27524 )

2026-08-22 10:35:50 +02:00

dotsocr.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dream.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

ernie.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

exaone.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

falcon_h1.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

falcon.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gemma.py

model: support embeddinggemma2 (text+vision+audio) (#30054 )

2026-10-06 18:20:31 +02:00

glm.py

add GLM-5.3-Flash (GLM5-Next) support (#27773 )

2026-09-30 14:20:32 +08:00

gpt2.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gpt_oss.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gptneox.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

granite.py

model : GraniteSWAForCausalLM / GraniteMoeSWAForCausalLM (#25505 )

2026-08-19 16:53:31 +02:00

grok.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

grovemoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

hrm_text.py

model : add support for HrmTextForCausalLM (DFM Mimir 1B) (#27625 )

2026-09-16 15:18:45 +02:00

hunyuan.py

spec : support DFlash for HunyuanOCR (#28890 )

2026-09-22 15:04:52 +02:00

hy_v4.py

convert : refactor Hy4-preview conversion - move HC tensor mapping to the global map (#28451 )

2026-09-07 15:20:58 +02:00

internlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

internvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

jais.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

jamba.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

januspro.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

k2_horizon.py

model : add K2 Horizon dense and MoVA support (#29535 )

2026-10-06 18:42:24 +02:00

kimi_k3.py

convert: add MiMo-V2.6 support (#29257 )

2026-09-22 14:38:09 +02:00

kimi_linear.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

kimivl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

laguna.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

lev.py

model: support nimble decision model (#29844 )

2026-10-02 14:56:53 +02:00

lfm2.py

model : Add LFM2.5-Encoder-350M and LFM2.5-Encoder-230M (#29862 )

2026-10-03 08:44:45 +02:00

lighton_ocr.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llada.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llama4.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llama.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llava.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

maincoder.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mamba.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

maple.py

llama: add Maple 20B-A1B ternary MoE architecture (CPU) (#27000 )

2026-09-14 14:04:05 +03:00

mellum.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mimo.py

llama : fix tensor split for fused qkv with uneven K/V head sizes (#29294 )

2026-09-25 11:15:33 +08:00

minicpm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

minimax.py

ci : bump ty to 0.0.78 (#28548 )

2026-09-07 21:10:06 +02:00

mistral3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mistral.py

convert : fix conversion for Mistral-Medium-3.5-128B (#24268 )

2026-06-07 21:41:39 +02:00

mpt.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

muse_glimmer.py

ci : bump ty to 0.0.78 (#28548 )

2026-09-07 21:10:06 +02:00

nanbeige.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

nemotron.py

convert : add text_config as fallback [transformers 5.18] (#30040 )

2026-10-06 11:04:26 +02:00

olmo.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

openelm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

orion.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pangu.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

phi.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pixtral.py

Refactor: convert_hf_to_gguf.py (#17114 )

2026-05-15 15:18:12 +02:00

plamo.py

convert : fix token configuration for PLaMo-3 (#29843 )

2026-10-07 11:34:16 +02:00

plm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pockettts.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pplx_decider.py

models: support pplx-decider (#30044 )

2026-10-06 16:07:46 +02:00

qwen3tts.py

mtmd: Fix Qwen3-tts-0.6b (#28231 )

2026-09-02 12:46:16 +02:00

qwen3vl.py

llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) (#29818 )

2026-10-02 11:56:04 +02:00

qwen4exp.py

Qwen4Exp: add MTP (#29761 )

2026-10-01 14:13:27 +03:00

qwen.py

llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) (#29818 )

2026-10-02 11:56:04 +02:00

qwenvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

refact.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

rwkv.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

sarashina2.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

smallthinker.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

smolvlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

spark2_5.py

[Model] Support for Spark2_5ForCausalLM implementation (#27868 )

2026-09-06 17:43:58 +02:00

stablelm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

starcoder.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

step3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

t5.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

talkie.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

ultravox.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

wavtokenizer.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

xverse.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

youtuvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00