llama.cpp-xrip

wmantly/llama.cpp-xrip

0 Fork 0

eeae28b67e ggml-cpu/ops: vectorize flash-attention V-cache F16 to F32 conversion (#26947) jinzihaoandjinzihao 2026-08-13 17:04:46 +08:00
154d57af3e sycl: remove separate fp32 type promotion in gemm non-oneDNN path (#26372) Ian Faust 2026-08-13 11:02:18 +02:00
1ee1cd9bc6 sycl: fuse UNARY(silu|sigmoid|softplus) + MUL (#26411) Titaniumtown 2026-08-13 01:41:38 -07:00
8efbf65dbd sycl : Add DMMV ESIMD Q3_K kernel (#26251) Todd Malsbary 2026-08-13 01:32:36 -07:00
d415e65a57 sycl : enhance concat to support Q4_0, Q4_1, Q5_0, Q5_1, Q8_0 (#26800) Neo Zhang 2026-08-13 16:24:28 +08:00
decaf508bb server: refactor + correctness fixes for metrics (#26920) Xuan-Son Nguyen 2026-08-13 10:02:01 +02:00
e79e4bf660 ggml-hip : remove -funsafe-math-optimizations (#26696) Jim WuandJim Wu 2026-08-12 23:38:02 -07:00
d86c7d62df ui: Clean up contexts, remove prop drilling from Chat Form Actions (#26951) Aleksander Grygier 2026-08-13 08:21:15 +02:00
f2efd64141 ui: Move styles/ to $lib scope (#26950) Aleksander Grygier 2026-08-13 08:13:52 +02:00
094e53db1c ui: Stores architecture improvements (#26910) Aleksander Grygier 2026-08-13 08:11:30 +02:00
a6040c925c refactor: Clean up UI types (#26909) Aleksander Grygier 2026-08-13 08:07:34 +02:00
1f368f354d ggml : fix arm builds, unused var (#26991) Georgi Gerganov 2026-08-13 07:57:24 +03:00
e21152dc96 ui: Constants refactor (#26908) Aleksander Grygier 2026-08-13 06:53:56 +02:00
8e7f22b67e common: add system-level config file (#26118) Johnathan Craig MaudlinandXuan Son Nguyen 2026-08-12 18:02:27 -04:00
84e908c625 ci: fix thread sanitizer + remove ccache (#26927) EveandSigbjørn Skjæret 2026-08-12 16:01:12 +00:00
9558fa44c9 ci : disable ubuntu-rocm (#26969) Sigbjørn Skjæret 2026-08-12 15:41:44 +02:00
7a9ff95979 disable rocm cache (#26962) Sigbjørn Skjæret 2026-08-12 15:41:43 +02:00
680a9ae63d cmake : introduce semantic versioning (#26839) Daniel BeveniusandGeorgi Gerganov 2026-08-12 14:15:03 +02:00
d8a8beac22 gguf : harden loader against malformed tensor dims and metadata types (#25596) HarrisonSecandGeorgi Gerganov 2026-08-12 05:07:48 -07:00
132753bf4e kleidiai: Add runtime feature detection mechanism for aarch64/kleidiai (#26076) Jonathan Clohessy 2026-08-12 12:49:11 +01:00
ece98b87f7 model : disallow integer dflash sliding_window_pattern (#26900) Sigbjørn Skjæret 2026-08-12 13:24:10 +02:00
af05a42a7c sync : ggml Georgi Gerganov 2026-08-12 13:59:44 +03:00
13fd0bb55e cmake : add config version support (ggml/1582) Daniel Bevenius 2026-08-12 12:46:06 +02:00
5d9e5ac30e server : support slot save/restore with media inputs (#26640) Chipmunk 2026-08-12 19:20:28 +09:00
4dd127584b ui: add read_media tool (#25877)
parabelboi ckrafft Xuan Son Nguyen Pascal
2026-08-12 12:03:32 +02:00
89e0aa6fd3 opencl: default FA c8 cluster width to 16 on X1E (#26433) Hongqiang Wang 2026-08-11 23:10:27 -07:00
a4a4c51f3d tests : update speculative params (#26925) Georgi Gerganov 2026-08-12 08:08:19 +03:00
a7cd2f0e98 vulkan: add TQ2_0 (ternary) support (#25850)
michaeltrabalka-tech Claude Fable 5 Michael Trabalka
2026-08-12 01:07:23 -04:00
55f453b924 wavtokenizer-dec : bound posnet/convnext block_count against n_layer_all (#26892) Oğuzhan AkkayaandSigbjørn Skjæret 2026-08-12 01:06:16 -04:00
6eff593262 convert : handle per_layer_config in Gemma4 (transformers 5.15) (#26882) Wang ZhiyuandSigbjørn Skjæret 2026-08-12 13:05:13 +08:00
cb27fe9c35 opencl: use flat mv q5_k when weight exceeds image1d_buffer_t limit (#26880) lhez 2026-08-11 22:02:28 -07:00
0b1bad14ff chat : fix muse-glimmer detection of tool calls after EOM (#26879) ruanslv 2026-08-11 16:15:20 -04:00
7b13a8404d ci : add missing release check (#26923) Sigbjørn Skjæret 2026-08-11 20:20:40 +02:00
ebb546b7e9 CUDA: only disable CUDA graphs when mul_mat_id actually needs a stream sync (#26802) Rafail Giavrimis 2026-08-11 18:50:03 +01:00
5988633170 cuda : add warp-per-row wkv7 kernel for single-token decode (#26111) 0 2026-08-12 01:46:23 +08:00
f785fc9ea4 spec : update speculative-simple (#26904) Georgi Gerganov 2026-08-11 19:52:12 +03:00
ba360efe1f chat : tighten bare function parsing for Qwen models (#26793) Aldehir Rojas 2026-08-11 10:58:54 -05:00
70dfba5aee ci : add windows-rocm to check-release (#26897) Sigbjørn Skjæret 2026-08-11 17:48:27 +02:00
38406d597f imatrix.cpp: Move finite check and only check touched experts (#26861) Bartowski 2026-08-11 11:18:19 -04:00
2468576f24 requirements: use stable torch packages on s390x (#26864) Niklas Wenzel 2026-08-11 15:58:53 +02:00
5d16e81dd9 convert : keep quantization scales for nemotron --mtp export (#26903) ynankani 2026-08-11 13:19:05 +00:00
cc078b45b6 Dflash support for nemotron-3.5 (#26905) lnigamandSigbjørn Skjæret 2026-08-11 18:46:26 +05:30
6e62ba5384 mtmd: support pocket-tts (#26871) Xuan-Son NguyenandPascal 2026-08-11 14:18:30 +02:00
8d274dd7c6 ui: fix context gauge for single-model usage (#25738) Tom Tan 2026-08-11 04:42:48 -07:00
704485942a ci: hip-quality-check: update vgpr spill ignore list (#26859) uvos 2026-08-11 11:47:57 +02:00
1138b851fa model-conversion : use save_output_data for causual embeddings [no ci] (#26890) Daniel Bevenius 2026-08-11 11:41:38 +02:00
9afff1b748 tests : fix running server tests on windows (#26889) Georgi Gerganov 2026-08-11 12:07:15 +03:00
153d324bcf llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
Ruben Ortlam Max Krasnyansky Piotr Wilkin Georgi Gerganov
2026-08-11 08:20:46 +02:00
b3df57286c tests : clean-up server test, use tests.sh in ci (#26886) Georgi Gerganov 2026-08-11 09:07:13 +03:00
4801e3c567 tests : disable backend sampler hip multi output (#26878) Jim WuandJim Wu 2026-08-10 21:21:32 -07:00
14e78ddef7 model : fix SWA not being enabled for EXAONE 4.5 (#26848) Junmo Kim 2026-08-11 13:20:17 +09:00
48d22e295e common/peg : suppress incomplete escape sequences (#26780) Aldehir Rojas 2026-08-10 23:10:31 -05:00
84f7129467 ggml-webgpu: fix CI errors from #25025 and #25262 (#26566) Masashi Yoshimura 2026-08-11 13:10:00 +09:00
030ebb558a Address review comment of PR 25532 (#26852) Gaurav Garg 2026-08-11 00:02:25 +05:30
689e227db4 opencl: transpose the K tile in local memory for FA prefill kernels (#26428) Hongqiang Wang 2026-08-10 11:09:19 -07:00
0666ad2b2b ci : target ROCm 7.14 for build and release (#25775) Mario Limonciello 2026-08-10 12:53:12 -05:00
dd1ea52433 llama : support multi-output backend sampling (#25532) Gaurav GargandGeorgi Gerganov 2026-08-10 19:28:56 +05:30
d2f83055d6 ggml-cpu : fix CPU affinity mask being ignored on Android (#26838) Hitesh Chopra 2026-08-10 17:43:40 +05:30
f8def7fe16 ggml : require contiguous src for ROLL on CUDA and Metal (#25928) Yash Raj Pandey 2026-08-10 08:01:44 -04:00
4dee52f82d ui: UI/chat form follow ups (#26743) Pascal 2026-08-10 13:32:51 +02:00
e5275f6f77 ci : don't specify python version in server-sanitize for broader runner compatibility (#26840) Sigbjørn Skjæret 2026-08-10 13:32:22 +02:00
4ae84dea27 server: add more tool isolation support (ssh remote + podman rootless) (#26774) PascalandXuan Son Nguyen 2026-08-10 13:31:09 +02:00
62bf73d25c model: Muse Glimmer Support (#26841)
Pedro Cuenca Young Han Beto de Paola Daniel Han ruanrms Xuan Son Nguyen Sigbjørn Skjæret
2026-08-10 13:07:27 +02:00
a52077c4ca chat : Align Laguna-S-2.1 chat template to huggingface (#26232) Guido Imperiale 2026-08-10 11:20:59 +01:00
4c6766fd7e vendor: sync subprocess.h and drop local patches (#26808) Pascal 2026-08-10 11:59:08 +02:00
86c298fb8a llama: Restore quantization of mmprojs (#26818) Pedro CuencaandXuan Son Nguyen 2026-08-10 11:58:32 +02:00
2e2d99cfd2 ci: Add support for CUDA 13.4 ARM64 builds for Windows (#26650)
shivamkumard-ctrl Georgi Gerganov Sigbjørn Skjæret
2026-08-10 14:16:44 +05:30
7a20b417f4 model: add MTP support for Nemotron model (#26725) Ruixiang Wang 2026-08-10 10:25:24 +02:00
e23e9440eb vendor : update cpp-httplib to 0.53.0 (#26821) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-08-10 04:57:45 -03:00
157b81fe6d model : Granite-Switch Architecture (#25107) Bar Haim 2026-08-10 00:53:46 -07:00
6ad4ab0ea0 readme : remove dev branches (#26832) Georgi Gerganov 2026-08-10 09:53:26 +03:00
92d1bb0c99 ui: Linting & Formatting scripts (#26819) Aleksander Grygier 2026-08-10 08:38:37 +02:00
1e396e72a8 server: gate the docker tools runtime tests on a real container run (#26826) Pascal 2026-08-10 08:32:58 +02:00
0377426cef model-saver : fix expert shared/chunk FFN length key clobber (#26693) Caleb DeLeeuw 2026-08-09 23:32:01 -07:00
aea252fb4a ci: fix the ctest sanitize runs (#26593) Eve 2026-08-10 06:31:28 +00:00
f401bb1390 ggml-webgpu : refactor several wgsl files and simplify flash_attn wgsl. (#26134) Masashi Yoshimura 2026-08-10 15:29:41 +09:00
74ce15741b ui: degrade the working directory picker when file search is off (#26811) Pascal 2026-08-09 21:20:23 +02:00
936918514c ci: add pr-draft-label (#26801) Xuan-Son Nguyen 2026-08-09 16:51:21 +02:00
08659901c4 ggml-cpu : fix missing Q5_0 dispatch in SpaceMiT backend (#26792) Hao-Chen2337 2026-08-09 18:16:53 +08:00
61141f1487 ci: rm GGML_HIP_ROCWMMA_FATTN (#26760) Aaron Teo 2026-08-09 18:15:28 +08:00
7ba604f1cb server: report the isolate working directory from get_info (#26773) PascalandXuan-Son Nguyen 2026-08-09 00:42:50 +02:00
687e778927 CUDA: fuse rms_norm + mul + rope (+ view + set_rows) (#26767) Rafail Giavrimis 2026-08-08 17:32:37 +01:00
18f7ad7fc9 server, ui: only offer a working directory when a tool reads it (#26762) Pascal 2026-08-08 16:36:21 +02:00
dd2c7c4471 server: add initial tool isolation support (via docker) (#26507) Xuan-Son NguyenandPascal 2026-08-08 16:35:53 +02:00
69bf643791 CUDA: fix thread/block count in quantized cpy kernel launches (#26731) Rafail Giavrimis 2026-08-08 05:40:04 +01:00
3653e6d6d5 tts: account for the vocoder pass in the timings line (#26733) Pascal 2026-08-07 22:35:52 +02:00
fc6545d322 allozaur/feat/chat form contenteditable (#26717) Aleksander Grygier 2026-08-07 20:40:10 +02:00
1621a3d388 tests : speed-up server test suite 3x (#26734) Georgi Gerganov 2026-08-07 21:38:32 +03:00
6de1b63473 allozaur/feat/chat slash commands (#26716) Aleksander Grygier 2026-08-07 20:20:01 +02:00
f8e30266d2 sycl: coalesce the ssm_conv window loads (#26612) Titaniumtown 2026-08-07 11:09:32 -07:00
a194a75b7e metal : fix NORM/RMS_NORM for row lengths that leave a partial simdgroup (#26708) robertomeroni 2026-08-07 20:09:07 +02:00
23634783c5 ui: Filesystem @mentions for Chat Form (#26715) Aleksander Grygier 2026-08-07 18:45:54 +02:00
4cb22cd537 mtmd: fix longest_edge ignoring min/max pixels (#26638) Xuan-Son Nguyen 2026-08-07 18:05:15 +02:00
4cf5cab65d sync : ggml Georgi Gerganov 2026-08-07 17:10:39 +03:00
933f46f3cb ggml : bump version to 0.19.0 (ggml/1581) Georgi Gerganov 2026-08-07 17:10:01 +03:00
9ba73fd1f5 server : clarify comment in eval_llama_cmpl_schema [no ci] [no release] (#26720) Daniel Bevenius 2026-08-07 15:39:33 +02:00
f4f7758cae webui: load the model selected via ?model= when ?load=true (#26707) Emanuil Rusev 2026-08-07 16:31:40 +03:00
34e9ee57f5 ui: set npm min-release-age to protect against supply-chain attacks (#26711) Niklas Wenzel 2026-08-07 14:53:51 +02:00
dff15d4ac9 server: (router) add LRU scheduler (#26572) Xuan-Son Nguyen 2026-08-07 14:46:53 +02:00
e1470ee6a2 server: (router) do not evict busy models (#26567) Xuan-Son Nguyen 2026-08-07 14:39:59 +02:00

... 16 17 18 19 20 ...

Commit Graph Select branches Hide Pull Requests master Mono Color

Commit Graph

Select branches

Hide Pull Requests

master