This website requires JavaScript.
54ce507b6f
UI: Fix settings precedence, Factory < Admin (--ui-config-file) < Users (Settings panel) (#26002 )
Pascal
2026-07-24 15:09:55 +02:00
8f5ab832ca
cohere2 moe template parser: enforce JSON schema for text responses if a response schema is provided (#26018 )
Matt Thompson
2026-07-24 03:54:47 -07:00
0cea36222f
vendor: update subprocess.h (#26061 )
Xuan-Son Nguyen
2026-07-24 08:02:23 +02:00
0a50d9909a
hexagon: further improved pipeline of the core bits (L2, DMA, MM, FA) (#26049 )
Max Krasnyansky
2026-07-23 19:13:03 -07:00
c0bc8591e8
hexagon: fix Windows crash when op_poll is enabled (#26029 )
adgup-qti
2026-07-23 21:38:10 +05:30
1425386fd9
CUDA: fix external compilation of q1_0 MMQ (#25778 )
Johannes Gäßler
2026-07-23 14:45:51 +02:00
e6dd0e29a6
args: refactor mlock/mmap/directio into load-mode (#20834 )
Aaron Teo
2026-07-23 20:32:56 +08:00
da296d6e72
contrib: fix leftovers from the AI usage policy update (#26030 )
Pascal
2026-07-23 12:32:23 +02:00
c588c4f476
metal : add f16 type support to leaky relu (#25981 )
Ilia Ilmer
2026-07-22 23:45:46 -04:00
d941f6e1c9
conversion: fix non-MoE NomicBert GGUF conversion error (#25996 )
Shahir BIn Zulfiker
2026-07-23 09:01:35 +06:00
4310aa4f87
contrib: allow all AI-generated code in general (#26012 )
Xuan-Son Nguyen
2026-07-23 00:29:03 +02:00
cf512566dc
ui: Add a "Default" option for the reasoning selector (#25846 )
Pascal
2026-07-22 23:09:49 +02:00
1a064ab092
CUDA: Improve NVFP4 W4A4 activation quantization (#25730 )
Oliver Simons
2026-07-22 19:28:02 +02:00
0278d8362d
hexagon: activation ops update (#25974 )
Todor Boinovski and Max Krasnyansky
2026-07-22 09:25:04 -07:00
e0833bf686
mtmd: use RAII for setting and resetting non-causal attention (#25723 )
Niklas Wenzel
2026-07-22 18:10:03 +02:00
61328e6a91
feat(ui): add symbolic math support to JS sandbox via nerdamer (#25948 )
rankaiyx and Pascal
2026-07-22 23:52:55 +08:00
e8e6c7af24
minor: fix reasoning preserve var for DS4 [no ci] (#25999 )
Piotr Wilkin (ilintar)
2026-07-22 14:32:54 +02:00
6d5a910c50
common: infer the speculative type from the draft repo sidecars (#25989 )
Pascal
2026-07-22 13:06:35 +02:00
f534da26e4
Fix DeepSeek4 crafted template (#25414 )
Piotr Wilkin (ilintar)
2026-07-22 12:54:40 +02:00
3ce7da2c85
ggml: enable PowerPC backend variants on AIX (#25983 )
shalinib-ibm
2026-07-22 14:56:40 +05:30
b4d6c7d8ff
ci : fix SYCL package shared library lookup (#25987 )
KyleHagy
2026-07-22 02:20:40 -07:00
7347430f44
webgpu : add CONV_2D_DW (depthwise conv2d) kernel (#25847 )
m1el
2026-07-22 03:24:44 -05:00
c5a4a0bb83
cuda: GET_ROWS quants (#25962 )
Pascal
2026-07-22 08:42:47 +02:00
67b9b0e7f6
llama-arch: fix DeepSeek4 APE tensor op (#25945 )
helanfxz
2026-07-22 10:55:44 +08:00
1f66c3ce1c
Add support for Laguna XS.2 & M.1 (#25165 )
Joe Rowell
2026-07-22 03:54:08 +02:00
66e4bf7e59
convert: fix handle HunyuanVL XD-RoPE config (#25514 )
wendadawen
2026-07-22 06:42:35 +08:00
b4aa7dd477
mtmd : use align_corners for qwen3vl vision position embedding interpolation (#25781 )
Gerben van V
2026-07-21 23:58:34 +02:00
71102a73f2
hexagon: check tensor type when reusing descriptors (#25968 )
Wei Wang
2026-07-22 05:44:22 +08:00
846e991ec3
cuda: add sqrt_softplus in topk-moe for dsv4 (#25896 )
Aman Gupta
2026-07-22 00:30:01 +08:00
fb0e6b6219
kleidiai : warn once when a weight type has no KleidiAI kernel (#25701 )
Kamalesh VS
2026-07-21 21:40:29 +05:30
60f6a17704
common: resolve draft repo to its requested sidecar (#25955 )
Pascal
2026-07-21 18:03:43 +02:00
fd41bf65a2
server: return 400 instead of 500 on validation error with X-Conversation-Id (#25760 )
Pascal
2026-07-21 17:47:54 +02:00
40b740ad05
server : properly handle null llama_context (#25868 )
fairydreaming and Stanisław Szymczyk
2026-07-21 17:47:17 +02:00
f048010180
vulkan: Refactor vk_queue to use per-instance mutexes and unique handles (#23570 )
Winston Ma and Jeff Bolz
2026-07-21 23:40:45 +08:00
5735e10c49
ggml-openvino: Add GGML_BACKEND_DL_IMPL invocation for OpenVINO backend (#25795 )
Markus Ebner
2026-07-21 16:43:11 +02:00
305ba519ab
CUDA: vectorize same-type get_rows with int4 copy (#25929 )
Piotr Wilkin (ilintar)
2026-07-21 15:53:57 +02:00
76f46ad29d
hexagon: add CLAMP op (#25934 )
Todor Boinovski
2026-07-20 16:12:09 -07:00
2beefef688
ui: Sidebar Conversations Bulk Action + Improved Settings logic/UI (#25815 )
Aleksander Grygier and Pascal
2026-07-20 23:40:08 +02:00
91d2fc3875
llama_dsv4: write only used rows in state (#25325 )
Aman Gupta
2026-07-20 22:43:39 +08:00
4ee6a9af71
ui: fix collapsed user bubble with markdown rendering (#25869 )
Pascal
2026-07-20 16:28:43 +02:00
43b5e63589
UI: fix Settings/Display tool call content toggle (#25783 )
Pascal
2026-07-20 16:28:24 +02:00
1521a9ac31
ui: enable the agentic flow when only the JS sandbox is active (#25865 )
Pascal
2026-07-20 16:22:16 +02:00
178a6c4493
opencl: Support broadcast for Adreno MUL_MAT and honor view_offs for Adreno Q8_0 MUL_MAT for llama-server multi-stream (#25910 )
Hongqiang Wang and Li He
2026-07-19 22:48:57 -07:00
571d0d540d
model: rotate injected K/V cache for DFlash (#25823 )
Ruixiang Wang and Georgi Gerganov
2026-07-18 15:02:18 +02:00
4937ca83f4
llama-quant : exclude i32 ffn_gate_tid2eid routing table from quantization (#25787 )
Yash Raj Pandey
2026-07-18 07:43:18 -04:00
86a9c79f86
opencl: load and use kernel_gemm_moe_q6_k_f32_ns from bin kernel lib (#25797 )
lhez
2026-07-17 15:29:29 -07:00
6bdd77f13c
opencl: read/write MoE dp4a activation tiles to local memory as 128-bit (vectorized LD/ST perf opt) for Adreno GPUs (#25810 )
Hongqiang Wang
2026-07-17 12:02:27 -07:00
86d86ed439
opencl: transpose q4_K noshuffle scales for coalesced reads (#25805 )
Hongqiang Wang
2026-07-17 07:49:43 -07:00
7d56da7e54
sync : ggml
Georgi Gerganov
2026-07-17 16:45:30 +03:00
3727404068
ggml : bump version to 0.17.0 (ggml/1568)
Georgi Gerganov
2026-07-17 16:44:55 +03:00
5d5306bf3e
tests : initialize all tensors in test_dsv4_hc to avoid NaNs in sentinel tensors (#25822 )
fairydreaming and Stanisław Szymczyk
2026-07-17 15:33:35 +02:00
635cdd5fcc
common : auto-download dflash- and eagle3- HF sidecars (#25811 )
Georgi Gerganov
2026-07-17 12:15:30 +03:00
11fd0a6fb7
ggml-blas: default hadamard mul_mat to cpu routine (#25710 )
Aaron Teo
2026-07-17 16:39:33 +08:00
788e07dc91
vulkan: Support Q2_0 (#25430 )
Jeff Bolz
2026-07-17 07:42:59 +01:00
0bd0ec6099
sycl: fix row calculation when K_QUANTS_PER_ITERATION is 1 (#25690 )
Todd Malsbary
2026-07-16 22:49:49 -07:00
b85833e934
opencl: add ABS op (#25115 )
Gezahegne
2026-07-17 01:13:47 -04:00
e8f19cc0ad
opencl: loads quants as uint for q4_K and q5_K flat mv (optimization for Adreno A7x GPUs) (#25780 )
Hongqiang Wang and Li He
2026-07-16 13:18:21 -07:00
ac2557cb24
docs: added a note about using OpenCl with Adreno 810 (#25786 )
akleine
2026-07-16 21:44:45 +02:00
0dc74e332e
DeepseekV4: Add fused hyper-connection ops (#25585 )
Aman Gupta
2026-07-17 00:33:33 +08:00
b2dd28a3b6
hexagon: L2 cache handling rework (dirty bit tracking with lazy flushing) and more MUL_MAT updates (#25762 )
Max Krasnyansky
2026-07-16 09:28:04 -07:00
f15bd60901
kleidiai: Add SME vs SME2 distinction in kernel dispatch (#25478 )
Rajendra Matcha
2026-07-16 21:27:04 +05:30
b15ca938ad
vulkan: when using transfer queue for async copies, sync on event_wait to avoid race (#25229 )
Ruben Ortlam
2026-07-16 15:34:24 +02:00
3278e921b1
conversion: accept BitNetForCausalLM architecture name (#25769 )
Khashayar Ghafouri
2026-07-16 18:54:47 +05:30
2e1fd76490
TP: fix Phi3, Bert, Plamo2/3, ChatGLM (#25536 )
Johannes Gäßler
2026-07-16 15:23:23 +02:00
86b719bf21
vendor: update BoringSSL to 0.20260713.0 (#25624 )
Alessandro de Oliveira Faria (A.K.A.CABELO)
2026-07-16 10:17:38 -03:00
32e789fdfd
tests: actually exercise test-recurrent-state-rollback (#25758 )
Aman Gupta
2026-07-16 21:06:12 +08:00
a8dc0e3269
server : allow text-only slot save/restore with mtmd (#25076 )
Chipmunk
2026-07-16 21:26:44 +09:00
a55a8c5266
convert : fix dflash target tokenizer mismatch during conversion (#25733 )
Ruixiang Wang
2026-07-16 14:19:47 +02:00
79bba02a67
CUDA: Support CUDA Virtual Devices (#25228 )
Anav Prasad
2026-07-16 03:37:35 -07:00
3f08ef2c51
Enable CUDA graphs on volta+turing (#25749 )
Alexander Heisler
2026-07-16 05:56:19 -04:00
8ee54c8b32
server: Ignore empty / non-existing Origin headers (#25756 )
Sebastian Dröge
2026-07-16 12:26:51 +03:00
c7d8722922
ggml-cuda : restore prop.integrated on HIP builds (#24233 )
liminfei-amd
2026-07-16 17:10:08 +08:00
5839ba3524
CUDA: dedup MoE gate/up activation quantization (#25441 )
Pranesh Gonegandla and praneshgo
2026-07-16 07:02:25 +00:00
a320cbfcb7
ci : add official website link to release notes (#25728 )
Georgi Gerganov
2026-07-16 08:30:42 +03:00
56d6e9dde2
quant : allow using manual tensor types with --pure (#25716 )
Georgi Gerganov
2026-07-16 08:30:20 +03:00
3dafb585f8
opencl: disable FA and MoE weights repack to work around compiler issues for Adreno 850 GPU (#25745 )
Hongqiang Wang and Li He
2026-07-15 20:53:14 -07:00
602f828b4d
cuda: extract Q1_0 elements via __byte_perm (#25628 )
David Friehs
2026-07-16 05:39:17 +02:00
505b1ed15c
opencl: exclude some moe kernels on Adreno a7x (#25698 )
Hongqiang Wang
2026-07-15 12:02:19 -07:00
32beb244f5
ui: Agentic Content UX improvements (#25450 )
Aleksander Grygier
2026-07-15 20:31:45 +02:00
3b53219361
cuda : CUDA GGML_OP_LIGHTNING_INDEXER implementation (generic vector kernel + wmma kernel) (#25545 )
fairydreaming and Stanisław Szymczyk
2026-07-15 19:57:52 +02:00
aff6eb6e75
tokenize : drop --stdin mutual-exclusion check (#25672 )
Adrien Gallouët
2026-07-15 18:41:51 +02:00
c3d47e696b
opencl: fix two issues on flash attention for Adreno a7x (#25697 )
Hongqiang Wang
2026-07-15 09:08:40 -07:00
f6f12e43fa
CUDA: tighter MMQ src1 buffer size for native fp4 (#25613 )
leonardHONG
2026-07-15 23:21:22 +08:00
956973c764
Fix crash with draft-simple (#25720 )
Gaurav Garg
2026-07-15 19:51:34 +05:30
a582222290
server: fix read_file append_loc space breaking edit_file match (#25705 )
Pascal
2026-07-15 13:46:46 +02:00
a05df0a81a
ui: fix thinking menu never appearing in single-model mode (#25637 )
Pascal
2026-07-15 13:39:21 +02:00
a3e5b96ac5
cuda : relax tensor contiguity requirements for quantized concat (#25678 )
fairydreaming and Stanisław Szymczyk
2026-07-15 13:36:32 +02:00
c81029373d
ci : add HF_TOKEN to self-hosted workflows (#25706 )
Georgi Gerganov and ggerganov
2026-07-15 14:34:53 +03:00
b3c9d1b846
metal: fuse snake activation (mul, sin, sqr, mul, add) (#25459 )
Pascal
2026-07-15 12:53:31 +02:00
f955e394bf
ggml: add f16 out_prod support for CPU and out_prod op for Vulkan (#23997 )
Michael Lamothe
2026-07-15 18:46:56 +10:00
33a75f41c3
DeepseekV4: reduce graph splits (#25702 )
Aman Gupta
2026-07-15 15:47:18 +08:00
d3fba0c79d
sycl : fix get_rows Q2_K, Q4_K, Q5_K (#25656 )
Neo Zhang
2026-07-15 15:32:28 +08:00
ae9291e16b
sycl : support kernel type fp16 for conv2d_dw (#25653 )
Neo Zhang
2026-07-15 15:31:10 +08:00
22b208b1ca
sycl : implement xielu op (#25550 )
Andrew Smith
2026-07-15 00:29:12 -07:00
0e148a573f
sycl: Increase minimum buffer size for USM system allocations (#25525 )
Francois Dugast
2026-07-15 09:28:24 +02:00
32b741c336
[SYCL] Flash Attention with XMX engine via oneDNN (#25222 )
2026-07-15 03:26:53 -04:00
12127defda
opencl: do not use clCreateBufferWithProperties when targeting CL 2.x (#25673 )
Hongqiang Wang
2026-07-14 19:53:56 -07:00
00fa7cb284
opencl: handle OOB write in noshuffle GEMV kernels (odd ne01) (#25640 )
Hongqiang Wang
2026-07-14 13:46:54 -07:00
a4ce2595c5
opencl: avoid the vec path in GEMV for unaligned row stride (#25671 )
Hongqiang Wang
2026-07-14 12:27:56 -07:00
c71854292f
hexagon: fix hmx-queue signal enum-narrowing problem (#25677 )
Chyan
2026-07-15 03:27:09 +08:00