llama.cpp-xrip

wmantly/llama.cpp-xrip

0 Fork 0

71cc86fa41 convert: fix GLM regression in index_tensors (#27655) jacekpoplawski 2026-08-24 12:21:00 +02:00
a14dba686a ggml : shorten virtual device naming in CUDA and Metal (#27608) Georgi Gerganov 2026-08-24 12:35:08 +03:00
c1c766da59 webgpu : reorder includes since V that appears in common_decls.tmpl may be defined as K in flash_attn_decls.tmpl if KV_OVERLAP (#27545) fairydreamingandStanisław Szymczyk 2026-08-24 10:07:12 +02:00
160c6b0bdd mtmd: video: fix moov atom at the end of file (#27596) Xuan-Son Nguyenandrkfg 2026-08-24 09:59:04 +02:00
985b14912b ci : apply ccache-clear with older/min/dry-run to all ccache jobs (#27602) Georgi Gerganov 2026-08-24 10:49:20 +03:00
6036c635e2 ggml : fix ggml_clamp (#27644) Georgi Gerganov 2026-08-24 10:43:04 +03:00
a130532ae1 mamba2 : Flatten in/out projections to dispatch GEMM instead of GEMV (#27513) Prabhsimran Singh 2026-08-24 11:55:11 +05:30
bf0a29cc16 Deepseek 4: -sm tensor (#26490) Aman Gupta 2026-08-24 11:50:25 +05:30
c060ca974c model : support MTP in GLM-4.5-Air (#26534) jacekpoplawski 2026-08-23 20:20:44 +02:00
ccc8fd2baa readme : update links (#27617) Georgi Gerganov 2026-08-23 20:55:56 +03:00
d05f89562d fix: Change chat tabs nav shortcuts (#27609) Aleksander Grygier 2026-08-23 19:37:19 +02:00
8d9af25633 test : fix multi-GPU server tests (#27614) Georgi Gerganov 2026-08-23 19:59:42 +03:00
4a08fa2970 test: move tools/parser to tests (#27548) Xuan-Son Nguyen 2026-08-23 18:38:51 +02:00
56db501e73 mtmd: use pillow-accurate algo, correct resize_algo for all models (#27594) Xuan-Son Nguyen 2026-08-23 18:35:41 +02:00
95b8e33e16 ci : add test-llama-archs tensor split for Metal (#27598) Georgi Gerganov 2026-08-23 15:57:07 +03:00
a278dcef04 contrib : recommend waiting for CI before merging (#27603) Niklas Wenzel 2026-08-23 14:56:47 +02:00
e8eed4525a server : add LLAMA_SERVER_SLOTS_N_DIFF (#27600) Georgi Gerganov 2026-08-23 15:55:51 +03:00
ba8e0eddfb common : skip device_info loop if it's not going to be printed (#26692) Bartosz Taudul 2026-08-23 14:39:16 +02:00
b0539c43ed DeepseekV4: fix rollback with multi-seq (#26756) Aman GuptaandGeorgi Gerganov 2026-08-23 16:27:49 +05:30
d3371929bb [Tensor parallel] Fix meta tensor split state propagation (#27574) Gaurav Garg 2026-08-23 16:19:12 +05:30
8144f3192e ui: Chat Conversation Tabbed navigation (#27263) Aleksander GrygierandPascal 2026-08-23 10:46:49 +02:00
6657ded4fa vendor : update subprocess.h (#27409) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-08-23 04:38:29 -03:00
29ea9412a6 cuda : add POOL_1D support (#27573) Aman Karki 2026-08-23 13:07:32 +05:30
70adb1b4ce common: json.h: fix clang lto (#27575) Xuan-Son Nguyen 2026-08-23 01:11:10 +02:00
3f545becce vulkan : added the PAD_REFLECT_1D operation (#26586) Safi UllahandJeff Bolz 2026-08-23 00:42:20 +05:00
b21e4de745 mtmd: use ggml_rope_set_offset (#27521) Xuan-Son Nguyen 2026-08-22 16:33:47 +02:00
d9f918d2d0 common: add json.h abstraction (#27511) Xuan-Son Nguyen 2026-08-22 16:28:28 +02:00
2fb989b9e7 fit: also take into account n_streams (#27496) Xuan-Son NguyenandPascal 2026-08-22 16:16:06 +02:00
9fee29e943 arg: remove -no-cnv from cli [no ci] (#27542) Xuan-Son Nguyen 2026-08-22 15:53:56 +02:00
e85caa81ea ci : Restore ROCm job for Ubuntu (#27399)
Mario Limonciello Jim Wu Sigbjørn Skjæret
2026-08-22 05:28:30 -05:00
2115b73d8e model : support DSpark for bailingmoe3 (#27508) Tiwei Bie 2026-08-22 17:19:48 +08:00
54ee5ee643 mtmd: support dots3-note vision+audio (#27524) Xuan-Son NguyenandSigbjørn Skjæret 2026-08-22 10:35:50 +02:00
3a653fea93 ci : add older, min and dry-run options to ccache-clear (#27504) Georgi Gerganov 2026-08-22 11:31:30 +03:00
369e1cd614 ggml: optimize concat op by replacing per-element memcpy with row-level memcpy (#24575) Kartik SirohiandSigbjørn Skjæret 2026-08-22 14:00:31 +05:30
2c6b141efb common : fix draft-mtp with embeddings (#26352, #27299) (#27400) Shahir BIn ZulfikerandSigbjørn Skjæret 2026-08-22 13:44:22 +06:00
8672290039 sycl : add Q2_K reordered MMVQ and ESIMD kernels (again) (#27490) Sigbjørn Skjæret 2026-08-22 09:09:26 +02:00
3aeb924628 readme : fix server badge alt (#27533) Sigbjørn Skjæret 2026-08-22 09:08:07 +02:00
2100e59260 readme : update badges (#27531) Georgi Gerganov 2026-08-22 08:25:00 +03:00
d775b8967a mtmd: support webp via ffmpeg (#27520) Xuan-Son Nguyen 2026-08-22 01:38:05 +02:00
3af988fabc opencl: fold the gpt-oss MoE per-expert bias adds into the epilogue (op/kernel fusion) (#26431) Hongqiang Wang 2026-08-21 14:24:33 -07:00
9a286ac98d docs: improve Windows build instructions (#27381) Niklas Wenzel 2026-08-21 20:49:27 +02:00
a3b9c23ead ci : fix empty release_id in make-release upload step (#27516) Georgi Gerganov 2026-08-21 21:41:25 +03:00
5a32f7b66e model: add dots3-note (#27060) Xuan-Son Nguyen 2026-08-21 19:52:34 +02:00
873e5d8e39 model: use ggml_rope_set_offset() (#27382) Xuan-Son Nguyen 2026-08-21 18:54:29 +02:00
d7fa69b7de ci : run ccache-clear as the last step of release jobs (#27503) Georgi GerganovandSigbjørn Skjæret 2026-08-21 18:56:04 +03:00
bb4caa7540 llama.cpp : bump version to 0.2.0 (#27498) Georgi Gerganov 2026-08-21 15:01:24 +03:00
c4b0225d85 scripts : add release.sh for release preparation (#27497) Georgi Gerganov 2026-08-21 14:51:26 +03:00
5de25a7487 sync : ggml Georgi Gerganov 2026-08-21 14:32:32 +03:00
01ff204fbd ggml : bump version to 0.21.0 (ggml/1597) Georgi Gerganov 2026-08-21 13:22:00 +03:00
353b32d8b9 ci : remove duplicate flag (#27488) Georgi Gerganov 2026-08-21 14:10:06 +03:00
7a0e42fd01 Revert "sycl : add Q2_K reordered MMVQ and ESIMD kernels (#26336)" (#27486) Georgi Gerganov 2026-08-21 14:02:03 +03:00
5b6ddc9675 ui: Settings navigation cleanup (#27241) Aleksander Grygier 2026-08-21 12:30:03 +02:00
e467c2ff61 ci : add nightly-tag.txt to make-release (#27485) Georgi Gerganov 2026-08-21 13:20:44 +03:00
1719747451 ci : release clean-up (#27477) Georgi Gerganov 2026-08-21 11:33:40 +03:00
62b2269060 kleidiai : add SME2 F32 GEMV kernel support (#26891) Charles Xu 2026-08-21 10:33:30 +02:00
ff14356e0c sycl : add Q2_K reordered MMVQ and ESIMD kernels (#26336) Todd Malsbary 2026-08-21 01:01:40 -07:00
5fff128451 test : make the FA V-is-view-of-K case a test case parameter (#27394) Georgi Gerganov 2026-08-21 10:29:17 +03:00
9e89a196b8 sycl : Add Q5_K ESIMD kernel (#26376) Todd Malsbary 2026-08-21 00:23:02 -07:00
cd26896c19 opencl: keep the vocab-scale K-quant lm_head on the CPU for Adreno A7X (compiler issue workaround) (#26440) Hongqiang WangandLi He 2026-08-20 22:30:17 -07:00
1cb3f5eb41 sycl: Update gate logic for Alchemist GPUs regarding OneDNN features. (#26635) HumerousGorgonandNeo Zhang 2026-08-21 13:16:29 +08:00
6602dd3389 sycl: fix multiple warnings in compiling sycl backend (#26713) Ian Faust 2026-08-21 07:15:40 +02:00
9e96cf77ff sycl : fix load model with mlock issue (#27250) Neo Zhang 2026-08-21 13:14:54 +08:00
b2e5e9b28b TP: enable tensor split for LFM2/LFM2MOE (#26993) Chris Danis 2026-08-21 01:13:58 -04:00
a298422da7 docs: fix typos in ET.md (#27457) vk 2026-08-21 10:06:59 +05:30
749f688fca ggml: support ggml_rope_set_offset on opencl, sycl, wgpu, hexagon (#27345) Xuan-Son Nguyen 2026-08-21 00:36:57 +02:00
0e1d9185c5 ci: use shell script to check cmake pkg (#27414) Eve 2026-08-20 20:01:32 +00:00
a30273376e metal : clamp K extent in tensor API mat-mat kernel for K not a multiple of 32 (#27450) Georgi Gerganov 2026-08-20 21:31:29 +03:00
6503355df0 opencl: fix q6_K flat mul_mat for Adreno A6x/A7x GPUs with older E031 compilers (#26476) Hongqiang Wang 2026-08-20 10:58:35 -07:00
6b4fa88a6c opencl: fix local size for norm (#27339) lhez 2026-08-20 10:52:07 -07:00
521a64cd01 ui: Stores split refactor (#27240) Aleksander Grygier 2026-08-20 19:02:04 +02:00
681c29d36a mtmd: add --mmproj-device argument (#23255) John-Henry LimandXuan Son Nguyen 2026-08-21 00:45:37 +08:00
07822bddf8 model : support DSpark for LFM2 models (#27383) Tarek Dakhran 2026-08-20 16:36:57 +02:00
78ec4c3780 vulkan: FA MMQ should use fp32 for Q quantization calculations (#27413) Jeff Bolz 2026-08-20 09:18:11 -05:00
63b64a50a3 metal : dequant kv cache only for large batches (#27438) Georgi Gerganov 2026-08-20 17:00:54 +03:00
bf0040e15f CI: Use LLVM's OpenMP over MSVC_DEBUG_non_redist on Windows (#26678) Oliver Simons 2026-08-20 15:42:26 +02:00
9855ad69d3 server: (router) lazy-load startup_models after main setup (#27424) Xuan-Son Nguyen 2026-08-20 15:22:16 +02:00
8a832e4bf3 server : fix --docker-repo being treated as router mode (#27416) Aritro Bandyopadhyay 2026-08-20 06:37:14 -06:00
2b5621094e CUDA: adding switch points per HW and quant type to tune the mvq->MMQ decode crossover (#26079)
Pranesh Gonegandla praneshgo Oliver Simons
2026-08-20 12:36:21 +00:00
dc64a1620e common : gracefully fallback on unsupported regex patterns in JSON schema (#26939) Aldehir Rojas 2026-08-20 06:59:03 -05:00
70aff25250 metal : dequantize quantized KV to F16 before flash attention (#27390) Georgi Gerganov 2026-08-20 13:43:59 +03:00
f20395dae5 Revert "tensor-split meta backend fixes (#26502)" (#27433) Georgi Gerganov 2026-08-20 13:35:15 +03:00
8497981321 ggml: fix backend split scheduler race condition (#26040) Ruben Ortlam 2026-08-20 10:42:33 +02:00
a3b1effcda convert: fix get block count error for Nemotron 3 Ultra (#27101) Rock Chen 2026-08-20 15:35:28 +08:00
d9b6be07d0 ggml-cuda: provide static workspace for cuBLAS handles (#26574) Alexander HeislerandOliver Simons 2026-08-20 03:27:51 -04:00
929d47a391 graph : create V as a view of K in the k_iswa build_attn (#27392) Georgi Gerganov 2026-08-20 10:00:35 +03:00
f466cfa38f spec : avoid binding reference to null pointer (#27404) Georgi Gerganov 2026-08-20 10:00:16 +03:00
2cfdb5fc08 vulkan : add source groups for shaders (#26666) Markus Tavenrath 2026-08-20 08:52:28 +02:00
9ee9fc04c1 opencl: make the MoE expert scatter deterministic (#26464) Hongqiang Wang 2026-08-19 20:40:19 -07:00
d59d455fd8 tensor-split meta backend fixes (#26502) Max Krasnyansky 2026-08-19 14:53:27 -07:00
990e3bfee3 hexagon: fix FA HMX queue ordering and pack the rescale D matrices (#27042) Yiwei Shao 2026-08-19 14:42:57 -07:00
b062ba735e opencl: port fused ssm_scan kernel (Mamba-2, d_state in {128, 256}) to GPU (#26439) Hongqiang WangandLi He 2026-08-19 13:35:17 -07:00
cd644c3954 ggml-cpu: gate __fp16 on __ARM_FP16_FORMAT_IEEE (#26860) Pascal 2026-08-19 22:03:13 +02:00
947fd9bb2b server: refactor sleep handling, allow access /metrics during sleep (#27376) Xuan-Son Nguyen 2026-08-19 20:48:09 +02:00
ee0ea03adf server : make models endpoints private when authentication is enabled (#26347) s0mecode 2026-08-19 22:44:42 +04:00
dc72703fc6 vulkan : dequant q8_0 KV once in coopmat1 (#25494) Nathanw1014 2026-08-20 01:14:15 +09:30
b95502ba9a vulkan: add null checks in ggml_vk_queue_command_pools_cleanup (#27353) Jetson Tan 2026-08-19 23:43:10 +08:00
3e7344670a Revert "common: share thread pools when n_threads differ (#27138)" (#27337) Niklas WenzelandMax Krasnyansky 2026-08-19 17:05:48 +02:00
7221e24f57 model : GraniteSWAForCausalLM / GraniteMoeSWAForCausalLM (#25505) Gabe GoodhartandSigbjørn Skjæret 2026-08-19 08:53:31 -06:00
6cc504a2e9 sycl: report zero devices instead of aborting when the host has none (#27291) Titaniumtown 2026-08-19 07:46:01 -07:00
01ac3ad761 ci : add release attestation url (#27389) Sigbjørn Skjæret 2026-08-19 16:40:47 +02:00

... 14 15 16 17 18 ...

Commit Graph Select branches Hide Pull Requests master Mono Color

Commit Graph

Select branches

Hide Pull Requests

master