llama.cpp-xrip

wmantly/llama.cpp-xrip

0 Fork 0

2e92ecd024 models : remove duplicate metadata load (#27378) Sigbjørn Skjæret 2026-08-19 16:05:50 +02:00
645ca2834b ci : re-enable release dependency for sycl (#27385) Sigbjørn Skjæret 2026-08-19 15:44:16 +02:00
fe8156f789 ggml: add ggml_rope_set_offset (+ metal support) (#27120) Xuan-Son Nguyen 2026-08-19 14:04:57 +02:00
77acca437f ui: read persisted settings before the API key probe (#27365) Pascal 2026-08-19 14:02:08 +02:00
95c409c136 mtmd: add mtmd_bitmap_set_mergeable (#27348) Xuan-Son Nguyen 2026-08-19 13:48:22 +02:00
8ef78e644f metal : dequantize q8_0 using packed types (#27370) Georgi Gerganov 2026-08-19 14:10:05 +03:00
ee4c505a4f server: add dedup-cache-models preset option (#27346) Xuan-Son Nguyen 2026-08-19 11:04:26 +02:00
98d1e92c21 vulkan: tiled transpose for 0<->2 permuted CONT (#26585) Kevin HopperandKevin Hopper 2026-08-19 03:20:21 -05:00
5112b9738b ggml-webgpu: add mulmat with overlapping src0/src1 (e.g., for minimax-01) (#27321) Masashi Yoshimura 2026-08-19 16:29:33 +09:00
0adcc3bb57 ci : add attestation for signed release artifacts (#25933) Jeremie Miller 2026-08-19 01:23:52 -06:00
79fe799194 tests: skip test-unicode build on win32/BUILD_SHARED_LIBS (#27336) Jeff Bolz 2026-08-19 01:50:50 -05:00
0329fcdac8 gguf-py : add size guards to GGUFReader (#27188) Oğuzhan AkkayaandSigbjørn Skjæret 2026-08-19 02:35:27 -04:00
6d05498314 server: (cosmetic) do not print cmd_child_to_router messages [no release] (#27347) Xuan-Son Nguyen 2026-08-19 01:45:56 +02:00
60addddf3c opencl: fix WAR race in the generic FA tile kernels when the WG spans subgroups (#26434) Hongqiang Wang 2026-08-18 13:57:24 -07:00
9731ad3f29 mtmd: deepseek-ocr SAM ggml_conv_2d with the im2col kept in F32 (#26727) Saba Fallah 2026-08-18 19:05:19 +02:00
af5172627d RPC: populate use_count to enable fusion inside backends (#27142) Aman Gupta 2026-08-18 21:08:57 +05:30
3dc7285b4f ui: Services consolidation refactor (#27239) Aleksander Grygier 2026-08-18 16:39:32 +02:00
fdf4c64604 ui: Stores consolidation refactor (#27238) Aleksander Grygier 2026-08-18 16:37:26 +02:00
04b569142d common: share thread pools when n_threads differ (#27138) Niklas Wenzel 2026-08-18 16:23:43 +02:00
0596704284 quant : Optimise memory usage by evicting weights after processing each layer (#22877) Ed Addario 2026-08-18 15:22:32 +01:00
0882c7bc89 sycl: honor GGML_HINT_SRC0_IS_HADAMARD (#27298) Titaniumtown 2026-08-18 06:21:25 -07:00
afd439df1f unicode : include '~' in collapsed symbol class (#26972) Thiago Padilha 2026-08-18 10:15:22 -03:00
169e4a7ff2 readme : update status badges + regen AUTHORS (#27317) Georgi Gerganov 2026-08-18 14:35:04 +03:00
9d77fa1725 ci : Update OpenVINO to 2026.3, skip nemotron-h rollback test (#27292) Zijun Yuandravi9 2026-08-18 18:02:22 +08:00
c0296022f3 ci: add Windows ARM64 CUDA support to the manual workflow (#27300) shivamkumard-ctrl 2026-08-18 15:25:45 +05:30
7acdbb1f19 mtmd: fix LFM2 image tiling threshold (#27057) BlackFoilandXuan Son Nguyen 2026-08-18 18:11:19 +09:00
1511ce3bc3 sync : ggml Georgi Gerganov 2026-08-18 11:29:14 +03:00
da786dc23e ggml : bump version to 0.20.2 (ggml/1589) Georgi Gerganov 2026-08-18 11:28:01 +03:00
27e345b574 build : fix xcframework + cmake clean-up (#27304) Georgi Gerganov 2026-08-18 11:16:51 +03:00
8b86400975 ci : create pre-release with change log and nightly link in make-release (#27302) Georgi Gerganov 2026-08-18 10:14:41 +03:00
25ae3a9b33 CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (#26843) ynankani 2026-08-18 04:15:53 +00:00
01818e4956 ui: enforce alphabetical enum member ordering (#27272) Aleksander Grygier 2026-08-17 23:52:00 +02:00
0021a77de0 ui: Refactor Built-In Tools naming (Server/Browser) (#27271) Aleksander Grygier 2026-08-17 22:23:22 +02:00
058df671b2 ci: more optimizations (#26983) Eve 2026-08-17 19:59:40 +00:00
087f94d82e doc: document MCP stdio servers and CORS defaults in the server README [no release] [no ci] (#26847) Pascal 2026-08-17 21:32:15 +02:00
533b18257b server: save processed mtmd chunks as placeholder (#27278) Xuan-Son Nguyen 2026-08-17 21:29:50 +02:00
ed1c3a20f5 mtmd: use sha256 for input hashing (#27274) Xuan-Son Nguyen 2026-08-17 21:20:12 +02:00
d8df12ebc4 vocab : support integer tokenizer scores (#27260) Sigbjørn Skjæret 2026-08-17 20:13:15 +02:00
b75ecd1971 mtmd : skip thumbnail for non-tiled LFM2 images (#27246) Tarek DakhranandXuan-Son Nguyen 2026-08-17 19:41:32 +02:00
60eeeb6082 cuda : skip UMA override for HIP builds (#27083) Mario Limonciello 2026-08-17 11:35:36 -05:00
39be55c97e vendor: move hash to vendor (#27262) Xuan-Son Nguyen 2026-08-17 18:21:02 +02:00
34af94cd9a ci : push release tag explicitly in release.yml (#27261) Georgi Gerganov 2026-08-17 16:14:13 +03:00
666f8898a2 ui: move get_datetime tool to frontend (#27255) Xuan-Son NguyenandPascal 2026-08-17 14:33:55 +02:00
805984d676 ci : reduce builds in build-xcframework.sh (#27252) Georgi Gerganov 2026-08-17 14:53:21 +03:00
9cd719af21 model: support speculators-format checkpoints for DSpark (#26275)
王金旭 desovo7 ruixiang63
2026-08-17 19:51:06 +08:00
7077abbe14 ui: add browser get_info tool (#27251) Xuan-Son NguyenandAleksander Grygier 2026-08-17 13:14:33 +02:00
d83f72d463 ci : restore release.yml check during make-release.yml (#27247) Georgi Gerganov 2026-08-17 13:10:56 +03:00
9f0d017efb mtmd: harden preprocessor_granite (#27235) Xuan-Son Nguyen 2026-08-17 11:30:15 +02:00
7c35571e5d ci : allow make-release to target a specific commit (#27234) Georgi Gerganov 2026-08-17 11:52:46 +03:00
f9779dda86 ci : make release workflows use a deploy key (#27229) Georgi Gerganov 2026-08-17 11:31:20 +03:00
fa88ae9368 convert: add @ModelBase.example (#27208) Xuan-Son Nguyen 2026-08-17 10:15:11 +02:00
3733366720 model : BailingMoE3 Support (#26608)
Toby bloomer Dyluhn
2026-08-17 03:49:49 -04:00
4197155add sync : ggml Georgi Gerganov 2026-08-17 09:46:25 +03:00
cea66f4c5a ggml : bump version to 0.20.1 (ggml/1587) Georgi Gerganov 2026-08-17 09:45:11 +03:00
4695f001fe llama-bench: fix deprecation warnings missing trailing newline (#27179) Fathi Boudra 2026-08-17 06:33:24 +02:00
f275595dd1 sycl: fix thread/block count in quantized cpy kernel launches (#27160) Titaniumtown 2026-08-16 21:32:16 -07:00
37a215c9e9 [SYCL] support OP OPT_STEP_ADAMW, OPT_STEP_SGD (#25268) Neo ZhangandNeo Zhang Jianyu 2026-08-17 12:31:29 +08:00
4df29be4f4 ci : fix dry-run reporting in make-release job [no ci] (#27167) Daniel Bevenius 2026-08-16 14:53:13 +02:00
3cb7ffb1a1 model : remove some ggml_concat (#27176) fairydreamingandXuan Son Nguyen 2026-08-16 14:12:55 +02:00
b94041a98e chat: refactor handling supports_string_content / supports_typed_content (#27130) Xuan-Son Nguyen 2026-08-16 12:45:33 +02:00
10bf611e53 llama : check LoRA tensor data is within file bounds (#27056) Oğuzhan AkkayaandSigbjørn Skjæret 2026-08-16 02:38:01 -04:00
ece963f41b ui: mask API Key field in settings and error splash to stop browser a… (#26562) Cristiano PintoandPascal 2026-08-15 21:52:55 +01:00
0d9ceae1e3 ui: read structuredContent from MCP tool result when content is empty (#26691) Gautam0507 2026-08-15 23:30:18 +05:30
ad1de39e07 model: add Kimi-K3 text model (#26185)
Piotr Wilkin (ilintar)Boris Dvorkin Stanisław Szymczyk Deepankar Singh Claude Fable 5 Caleb DeLeeuw Xuan Son Nguyen
2026-08-15 17:11:05 +02:00
22b8e310b9 server: re-design yield_to_queue thread model (#27133) Xuan-Son Nguyen 2026-08-15 16:48:40 +02:00
adb55e5148 vendor: update BoringSSL to 0.20260813.0 (#27099) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-08-15 08:41:18 -03:00
77140d247c vendor : update cpp-httplib to 0.53.1 (#27103) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-08-15 08:40:44 -03:00
5f754ea0e2 common: support --models-dir loading MTP assistant models (#24431) Eric ZhangandXuan Son Nguyen 2026-08-15 19:17:35 +08:00
27df9199d1 fix: check gguf array type before reading (#27075) Xuan-Son Nguyen 2026-08-15 11:45:30 +02:00
9b0a2ce859 vulkan: add SHMEM_STRIDE_PAD/APPLY_SLM_A_RESHAPE for coopmat1 on Intel Xe (#25380) Jiang, Fish 2026-08-15 17:35:05 +08:00
0177dcc730 common: migrate the deprecated --mmap/--no-mmap to --load-mode (#26934) Fathi Boudra 2026-08-15 10:35:53 +02:00
6b4344ecc7 fixed indent Masato Nakasaka 2026-08-14 11:47:55 +09:00
7b38cb71b9 Fixed gating logic for problematic Intel driver version Masato Nakasaka 2026-08-14 10:39:51 +09:00
9d57ce456c mtmd: fix Granite4 Vision image sequence assembly (#26653)
Hemanth Battu Xuan Son Nguyen Hemanth Battu
2026-08-14 15:25:26 -07:00
16d222fc5e model : add support for MiniMaxText01ForCausalLM and MiniMaxM1ForCausalLM (#27018)
fairydreaming QscQ Sigbjørn Skjæret Stanisław Szymczyk
2026-08-15 00:02:38 +02:00
6fed9f6ff7 mtmd, common: various fixes (#27071) Xuan-Son Nguyen 2026-08-14 23:34:56 +02:00
9e40df63ba jinja : fix quadratic cost in gather_string_parts (#27034) 0 2026-08-14 17:34:40 -04:00
7e4c0a9688 chat : pass reasoning_effort to template Andy WilliamsandAlde Rojas 2026-08-15 03:53:11 +09:30
9b05354ec6 sync : ggml Georgi Gerganov 2026-08-14 19:05:40 +03:00
06ae2326ba ggml : bump version to 0.20.0 (ggml/1584) Georgi Gerganov 2026-08-14 18:13:36 +03:00
1692f9e50b ggml : recurrent state rollback for ggml_ssm_scan (#26623)
lnigam Georgi Gerganov Gaurav Garg
2026-08-14 19:50:40 +05:30
4c1a0af40d llama : allow virtual igpu devices (#26953) Georgi Gerganov 2026-08-14 15:14:19 +03:00
77918caf30 server: allow accessing /metrics and /slots during llama_decode() (#27041) Xuan-Son Nguyen 2026-08-14 13:23:10 +02:00
885c5bbe8e tests : replace personal home directory paths with generic placeholders (#27043) Jim WuandJim Wu 2026-08-14 01:32:59 -07:00
6509138622 sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779) Titaniumtown 2026-08-13 23:26:23 -07:00
c6f6a92c55 ggml: force single thread on wasi (#25686) Mendy Berger 2026-08-14 02:16:20 -04:00
3d93885352 sycl: fuse the gated-delta-net state writeback cpy (#26643) Titaniumtown 2026-08-13 23:00:36 -07:00
2bacf9ea5c dflash : clarify output logging of target_layer_ids (#27013) Daniel Bevenius 2026-08-14 06:57:05 +02:00
a94d563ed8 common: apply CPU parameters across tools (#27026) Niklas Wenzel 2026-08-13 20:40:59 +02:00
bdffafa5df ui: Refactor data-attrs constants, enum for bool strings (#27002) Aleksander Grygier 2026-08-13 20:01:12 +02:00
fa4ec4590c refactor: Naming (#27001) Aleksander Grygier 2026-08-13 19:45:32 +02:00
9c5531e2bf ui: fix VITE_PUBLIC_SERVER variable reading (#24845) Ilya 2026-08-13 20:31:51 +03:00
aee56b3abf OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952)
Zijun Yu Xuejun Mustafa Cavus virajwad Copilot Autofix powered by AI suryasidd Mustafa Cavus Ravi Panchumarthy
2026-08-14 01:30:48 +08:00
a97123e497 [SYCL] Support host pinned mem to improve SYCL Host-to-Device Memory Access (#26789) Neo Zhang 2026-08-14 01:05:33 +08:00
2606220d9f chat : fix LFM2 tool call arg name prefix ambiguity (#26960) Aldehir Rojas 2026-08-13 11:18:44 -05:00
981184e49a server : serve index.html with no-cache (#27006) Emanuil Rusev 2026-08-13 17:59:45 +03:00
1d2869c6e5 spec : auto-detect mtp draft model type (#27005) Sigbjørn Skjæret 2026-08-13 13:39:16 +02:00
4a84b0ad10 metal : add TQ2_0 support (#26980) Georgi Gerganov 2026-08-13 14:33:53 +03:00
f65e568fd8 common : auto-detect spec type from draft GGUF metadata (#26814) aic0d3r 2026-08-13 12:34:27 +02:00
0d0bfcd4fd spec: enable backend sampling for both dflash & dspark (#26958) Ruixiang WangandGeorgi Gerganov 2026-08-13 11:07:28 +02:00

... 15 16 17 18 19 ...

Commit Graph Select branches Hide Pull Requests master Mono Color

Commit Graph

Select branches

Hide Pull Requests

master