-
1863ac0333
ui: export conversations from database instead of cached store (#27432)
Tom Tan
2026-09-04 06:13:10 -07:00
-
49c0dc82b8
model : add Tencent Hy 4 (hy_v4) preview architecture support (#28127)
2026-09-04 20:31:36 +08:00
-
5266f24da7
llama.cpp : bump version to 0.4.0 (#28386)
Georgi Gerganov
2026-09-04 15:22:38 +03:00
-
64a155d242
sync : ggml (#28379)
Georgi Gerganov
2026-09-04 14:39:19 +03:00
-
163a40796f
model, mtmd: fix gemma4 vision handling (#28335)
Xuan-Son Nguyen
2026-09-04 12:23:27 +02:00
-
8f83678fd8
metal : add remaining fa-vec tunings for M3 Max (#28373)
Niklas Wenzel
2026-09-04 11:46:31 +02:00
-
86b351fd64
ggml : replace compile definitions with version.h.in (#28364)
Daniel Bevenius
2026-09-04 10:28:23 +02:00
-
d509cb1e86
Don't use npx inside a package.json script (#28270)
Evan Huus
2026-09-04 04:27:56 -04:00
-
4cbe8b070b
ggml : don't crash when backend search path can't be read (#28271)
Adrien Gallouët
2026-09-04 09:24:06 +02:00
-
24f5bf8a41
ggml : remove GGML_CUDA_PEER_MAX_BATCH_SIZE (#28177)
Adrien Gallouët
2026-09-04 09:22:01 +02:00
-
a529af96e2
docs : update maintainer PRs link and regenerate AUTHORS (#28365)
Georgi Gerganov
2026-09-04 10:20:49 +03:00
-
38521ec33f
vendor: update BoringSSL to 0.20260903.0 (#28354)
Alessandro de Oliveira Faria (A.K.A.CABELO)
2026-09-04 04:10:26 -03:00
-
0ef4d560e1
ci : disable failing openvino tests (#28347)
Ravi Panchumarthy
2026-09-03 23:18:11 -07:00
-
c390d0abbc
common : make build info output stream configurable (#28322)
Adrien Gallouët
2026-09-04 08:13:20 +02:00
-
832fd6f174
ggml-cpu(s390x) : fix q5_1 uninitialized v_acc (#28332)
Aaron Teo
2026-09-04 13:55:50 +08:00
-
9a4843cf2f
src : add n_expert_used_max function (#28323)
Daniel Bevenius
2026-09-04 06:36:51 +02:00
-
6703d7894c
sycl: fuse rms_norm+mul+add and add+add residual chains (#27610)
Frosty40
2026-09-03 23:05:40 -05:00
-
f9f09f02cc
SYCL: Refactor GGML_SYCL_ENABLE_MKL_FA to global var (#26863)
Ozymandias_EBON
2026-09-03 21:45:53 -05:00
-
d230ddd763
llama: fix whole source code rebuilt on each new commit (#28278)
Xuan-Son Nguyen
2026-09-03 23:53:04 +02:00
-
c5a5535e6e
common/json-schema : fix GBNF grammar generation for empty object schemas (#28279)
Sergey Sklyarov
2026-09-03 22:37:50 +02:00
-
95ef7fc160
opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations (speculative decoding/MTP) (#26477)
Hongqiang Wang
2026-09-03 09:46:19 -07:00
-
8c1a25166b
tune MMVQ to MMQ crossover for SM87 (#28285)
kbenkhaled
2026-09-03 12:40:42 -04:00
-
d30500b83b
snapdragon: ci updates to use new run script (#28293)
Max Krasnyansky
2026-09-03 08:59:11 -07:00
-
e107984bcf
ops: add Hexagon to ops.md and update main README.md (#28263)
Todor Boinovski
2026-09-03 07:14:36 -07:00
-
42f0225fea
server : use pytest-xdist for server tests (#28298)
Daniel Bevenius
2026-09-03 15:04:30 +02:00
-
de8656bd94
mtmd: propagate const to preproc class (#28310)
Xuan-Son Nguyen
2026-09-03 12:57:10 +02:00
-
7bb0fc18f6
metal : add sparse FA (#28098)
Georgi Gerganov
2026-09-03 13:51:13 +03:00
-
0df017d6dd
metal : fix glu dispatch with ne00 = 1 (#28306)
Georgi Gerganov
2026-09-03 13:25:41 +03:00
-
f45576aa86
mtmd : add
const in various places (#28307)
Mads Marquart
2026-09-03 12:12:49 +02:00
-
0ba6499c3b
CUDA: Allow concurrent streams per split for multi-GPU (#28198)
2026-09-03 12:03:03 +02:00
-
c7bda030e7
vulkan: fix FA dequant path engagement (#28190)
Nathan Wilson
2026-09-03 15:40:34 +07:00
-
0df974d777
sycl : enhance the api to support peer-to-peer copy (#27550)
Neo Zhang
2026-09-03 15:41:07 +08:00
-
d646c9d155
convert : skip bias_vl tensor in DeepSeek-V4 DSpark conversion (#28294)
Georgi GerganovandSigbjørn Skjæret
2026-09-03 10:37:23 +03:00
-
5ec4eab69e
misc : prevent RAM peaking at model loading stage (#27483)
Tarek Dakhran
2026-09-03 09:32:24 +02:00
-
4aa6ffba25
sycl: reduce redundant work in Q4_K multi-column MMVQ (#27062)
EurekaticandRaulAbejonDelgado
2026-09-03 08:59:06 +02:00
-
c61b98b875
model: add NVIDIA Nemotron-3-Puzzle-75B-A9B (NemotronHPuzzle) support (#25444)
Yaniss Amazouz
2026-09-03 09:53:08 +03:00
-
67a17c17ca
mtmd: fix idefics3 preproc (#28273)
Xuan-Son Nguyen
2026-09-03 01:00:57 +02:00
-
159b741427
finetune: fix no KV cache (#27199)
Xuan-Son Nguyen
2026-09-02 23:53:32 +02:00
-
9cffdcc801
server : accept data: URLs for input_video and input_audio (#27735)
Abhiram
2026-09-03 01:54:31 +05:30
-
f027c4f1b0
ggml-hexagon: add F16 support for unary ops (#28228)
cqderek
2026-09-03 03:59:36 +08:00
-
7339054744
mtmd: add mtmd_tokenize_from_parts() (#28250)
Xuan-Son Nguyen
2026-09-02 21:20:10 +02:00
-
9cc33944f9
metal : add fa-vec tunings for M3 (#28236)
Isaac
2026-09-02 23:43:12 +05:30
-
8c0b9cd04a
metal : fix memory query under low-memory conditions (#27701)
2026-09-02 20:09:46 +02:00
-
03dbcc53e1
ci : check for missing autoreleasepools (#27884)
Niklas Wenzel
2026-09-02 19:54:48 +02:00
-
cff184438e
Update ROCm to 10.0.0 release (#27803)
Mario Limonciello
2026-09-02 12:49:11 -05:00
-
9400c8946e
model: correctly support input vision for deepseek4 (#28154)
Xuan-Son Nguyen
2026-09-02 19:14:46 +02:00
-
d5fec32a87
ci : enable hf-jobs on server-cuda (#28258)
Sigbjørn Skjæret
2026-09-02 19:13:20 +02:00
-
3d3d7c8181
ggml-cuda : remove unused vars (#28235)
Adrien Gallouët
2026-09-02 18:54:11 +02:00
-
e750b887a8
common, server : enable preserve_reasoning kwarg by default, log its effective state (#28174)
Georgi GerganovandXuan-Son Nguyen
2026-09-02 19:19:54 +03:00
-
7798007a29
mtmd: support DeepSeek-V4-Flash-Vision-Exp (#28133)
Xuan-Son Nguyen
2026-09-02 16:43:43 +02:00
-
8e93a9773b
CUDA + ggml: add sparse-fa for DSV4/GLM (#27970)
Aman Gupta
2026-09-02 19:57:37 +05:30
-
0f3a71be15
mtmd: Fix Qwen3-tts-0.6b (#28231)
Pascal
2026-09-02 12:46:16 +02:00
-
b81c99b479
ggml: avoid KleidiAI buffer type init on dispatch (#27891)
Aman Chadha(IVIXMMI)andAcmmi
2026-09-02 11:46:15 +05:30
-
960dffab05
hexagon: MUL_MAT and MUL_MAT_ID fusion and fixes (#28202)
Max Krasnyansky
2026-09-01 23:15:21 -07:00
-
ba8818cbf3
vulkan: handle larger batch sizes (>4) efficiently for IQ3_S mat-vec (#27449)
Laurent ZuijdwijkandMarshall
2026-09-02 07:14:52 +01:00
-
56dd8150cc
vulkan : only request VK_KHR_shader_bfloat16 extension if supported (#28155)
Mads Marquart
2026-09-02 08:13:25 +02:00
-
2637dfe373
ggml-cpu : conditionally add SpacemiT IME kernel sources (#27961)
Alan Tseng
2026-09-02 14:12:28 +08:00
-
43d87ff2dd
opencl: fix out‐of‐bound reads in the Adreno image kernels (#27632)
Hongqiang Wang
2026-09-01 22:28:45 -07:00
-
69320fef12
hexagon: add missing FARF logs for cpy/get_rows/set_rows/gdn ops (#28217)
Trivikram Reddy
2026-09-02 00:20:29 -05:00
-
b96806d960
metal : add metallib build support for xcframework (#28163)
Jhen-Jie Hong
2026-09-02 07:45:56 +08:00
-
3466812d1f
cuda: fuse MoE weighted expert reduction (#25952)
anujj
2026-09-02 01:18:47 +05:30
-
b356fa2624
kv-cells: look up the n-gram history in the sequence position index (#28040)
Pascal
2026-09-01 20:16:07 +02:00
-
dfc29b64eb
context : autoscale n_ctx_train when yarn scaling specified (#28030)
Sigbjørn Skjæret
2026-09-01 18:59:54 +02:00
-
f28493c783
models : appropriately flag noscan ssm_a tensors (#28121)
Sigbjørn Skjæret
2026-09-01 18:59:15 +02:00
-
73159c3039
model : fix gemma4-assistant (#28183)
Sigbjørn Skjæret
2026-09-01 18:58:44 +02:00
-
d11b3cc7ed
model : load relevant arrays with n_layer_all (#28173)
Sigbjørn Skjæret
2026-09-01 18:58:29 +02:00
-
c845263f8b
Revert "sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 12…" (#28184)
Titaniumtown
2026-09-01 09:04:31 -07:00
-
1f3d318734
sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 1280 (#28016)
Jingxin (Philip) Li
2026-09-01 23:47:08 +08:00
-
8887a48f05
metal : add fa-vec tuning for M2 Pro (#28122)
Lukasz Stolcman
2026-09-01 15:24:44 +02:00
-
be789c3448
metal : add fa-vec tunings for A18 Pro (MacBook Neo) (#28152)
Jhen-Jie Hong
2026-09-01 21:15:59 +08:00
-
9d817213a0
model : load hparams.n_layer_nextn before n_layer() calls (#28159)
Sigbjørn Skjæret
2026-09-01 13:55:45 +02:00
-
fe2120bc9d
metal : fix more leaks due to missing autoreleasepools (#27883)
Niklas WenzelandYiChen Lv
2026-09-01 13:50:47 +02:00
-
d08c7872d6
metal : add fa-vec tuning for M2 Max (#28015)
Georgi Gerganov
2026-09-01 13:37:40 +03:00
-
5eec3ad017
sycl : support limit max alloc memory within 2GB for host-pinned memory (#27559)
Neo Zhang
2026-09-01 18:35:47 +08:00
-
36b1015438
qwen4exp: fix seq_cp, block position keying, mtmd input, cuda abort, add tests (#27941)
Daniel Han
2026-09-01 03:22:04 -07:00
-
d086dbb348
tests : fix log verbosity for test-llama-archs (#28147)
Georgi Gerganov
2026-09-01 13:07:12 +03:00
-
1b89a43e38
quantize: row-slab stream to avoid thread starvation (#27830)
Xuan-Son Nguyen
2026-09-01 11:18:54 +02:00
-
d5d993a093
metal: enable Metal 4.0 tensor API on M5+/A19+ (#27461)
James Francis
2026-09-01 03:02:42 -06:00
-
234a6ebaa0
ci: Bump ggml-org/ccache-action to v1.2.24 (#28083)
Ludovic Henry
2026-09-01 11:00:17 +02:00
-
518b76236b
kleidiai : Update KleidiAI Documentation (#26078)
Jonathan Clohessy
2026-09-01 09:45:13 +01:00
-
0eadefebd3
qwen4exp: support recurrent state rollback (#28123)
Pascal
2026-09-01 06:24:49 +02:00
-
09412af38a
qwen4exp: sum the indexer heads by slices (#28023)
Pascal
2026-09-01 06:23:59 +02:00
-
458681e1d5
metal : add fa-vec tunings for M1 Ultra (#28088)
Buğra Özgürsoy
2026-09-01 00:47:27 +03:00
-
e4b9af007b
CUDA: XOR swizzle flash attn K,V smem fp16 tiles (#25635)
ynankani
2026-08-31 20:18:01 +00:00
-
ab0b3bd3c8
metal : add concat support for quantized types (#28116)
Georgi Gerganov
2026-08-31 23:16:04 +03:00
-
85c55223ca
AVX2: Speed up large batch size prompt processing of IQ models (#27402)
BartowskiandGeorgi Gerganov
2026-08-31 14:33:50 -04:00
-
2a74817f93
metal : add top-k radix implementation (#28073)
Georgi Gerganov
2026-08-31 21:31:53 +03:00
-
2d8d612e4c
kv-cache : optimize restoring non-contiguous cells (#27991)
itsnotoger
2026-08-31 18:49:58 +02:00
-
010be9683a
opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance (#26438)
Hongqiang Wang
2026-08-31 08:56:22 -07:00
-
774ee0e200
ui: copy the displayed text of grouped agentic responses (#27832)
Pascal
2026-08-31 17:48:43 +02:00
-
8e53fcefd2
webgpu : avoid crash when offset is not multiple of 4 in WebGPU ggml_backend_tensor_get() implementation (#28045)
2026-08-31 16:04:38 +02:00
-
f8dbcd6189
ROCm: add radix TOP_K for long rows (#27466)
Jaden_Mach
2026-08-31 09:00:04 -04:00
-
5d4a3be26d
metal : add fa-vec tunings for M1 (#28078)
Niklas Wenzel
2026-08-31 13:58:55 +02:00
-
41ef91f7c8
CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were restricted to 1 token (#27621)
ynankani
2026-08-31 11:22:28 +00:00
-
a32af33de2
sycl : Enhance to get the free memory of Intel GPU (#27968)
Neo Zhang
2026-08-31 18:33:02 +08:00
-
580e88d8b7
ci : add check for unzip (#28082)
Sigbjørn Skjæret
2026-08-31 12:17:51 +02:00
-
662a0b0121
spec : fuse the DFlash encoder into the KV cache injection (#27310)
2026-08-31 17:19:20 +08:00
-
2cdae802e4
vulkan: tune mat-vec rows for batched inference on Strix Halo (#27909)
Simon Teixidor
2026-08-31 11:07:53 +02:00
-
557614e029
ggml : add MUL_MAT to the list of ops that may need additional memory (for WebGPU) (#28071)
fairydreamingandStanisław Szymczyk
2026-08-31 10:17:23 +02:00
-
daef7b6874
vulkan: top_k radix select for k >= 1024 for Qwen 3.8 Flash Next (#28032)
Ruben Ortlam
2026-08-31 07:04:34 +02:00