llama.cpp-xrip

wmantly/llama.cpp-xrip

0 Fork 0

f00c9083b2 ci : add behavior check workflow (#31036) Sigbjørn Skjæret 2026-10-23 14:53:44 +02:00
f5027fb213 CANN: missing const qualifiers added for consistency (#30933) Raul Torres 2026-10-23 08:34:20 +01:00
f64a49819c sycl : pass device into mul_mat_uses_onednn (#31014) Titaniumtown 2026-10-22 23:37:53 -07:00
1ab09d632e Extend probabilistic sampling for DFlash2 drafts (#30663) Pranesh GonegandlaandPranesh Gonegandla 2026-10-23 05:45:36 +00:00
f9599d0cc8 vocab : fix Nemotron-3.5-Embed tokenization (#30974)
Takamichi Ohara Sigbjørn Skjæret Daniel Bevenius
2026-10-23 14:31:30 +09:00
643b0cdacb hexagon: Op Fusion refactoring, optimizations and new fusions like BINARY_NX (back-to-back ADDs, etc) (#30843) Max Krasnyansky 2026-10-22 21:05:44 -07:00
0a9ef00678 sycl: Replace host waits in fattn-mkl with explicit dependencies (#30684) Todd Malsbary 2026-10-22 19:43:12 -07:00
7377bada8c sycl: Add graph record and replay (#28725) Todd Malsbary 2026-10-22 19:39:52 -07:00
184f653602 server: Substitute rerank placeholder from the original template only. (#30864) pzhu 2026-10-23 06:38:03 +08:00
d814cbb88c server: realtime API: send complete after committed audio drains (#30994) Xuan-Son NguyenandPascal 2026-10-23 00:37:47 +02:00
970b51ce7c opencl: add depthwise conv2d (#30900) kurquharandLi He 2026-10-22 10:54:24 -07:00
a08ab75ae7 mtmd : add MiniCPM-OCR 1.0 support (#30979) tc-mb 2026-10-23 01:22:15 +08:00
19ab5a5e65 clef : include <algorithm> for std::find and std::copy (#30981) Martin Kleinberger 2026-10-22 17:14:47 +01:00
36cbf415f1 Fix !30793 Gaurav Garg 2026-10-22 19:30:57 +05:30
5c19a5a756 glm5 : optimize inputs (#30932) Georgi Gerganov 2026-10-22 16:59:29 +03:00
d9ee007a06 model : fix qwen4exp layer inputs for DFlash drafters (#30927) Georgi Gerganov 2026-10-22 16:49:38 +03:00
d81d0d8fb9 Multi-column on Intel XMX matrix engines refactored (#29864) budiony 2026-10-22 16:39:01 +03:00
d77256999f vulkan: replace std::aligned_alloc with posix_memalign for termux compatibility (#30828) Bill Sideris 2026-10-22 15:40:13 +03:00
0693dbfb91 nemotron : support non-standard GQA, BPE tokenizer and domyn-small pre-type (#23343) martin-cimminoandMartin Cimmino 2026-10-22 13:34:47 +02:00
a5d22276be server : support typed content input for RERANK endpoint (#29625) Tim Wangandtimothywang21 2026-10-22 07:27:24 -04:00
5f5acfe250 ci : disable slow WebGPU tests (#30963) Georgi Gerganov 2026-10-22 13:56:20 +03:00
1f4c2eeaa5 ci : be able to reconfigure HTTP port for server pytest workers (#30972) Georgi Gerganov 2026-10-22 13:56:03 +03:00
7170cad4d0 sycl: fix CONV_2D wrong results for non-contiguous input (#30363) Michael Taylor 2026-10-22 05:19:58 -03:00
d88040c704 vocab : add clean_spaces GGUF key (#30940) tkran2 2026-10-22 02:58:08 -05:00
e197cef455 vocab : use Tekken pre-tokenizer for pixtral rather than the Llama 3 one (#30960) tkran2 2026-10-22 02:06:47 -05:00
bf039c8496 models : Record layer inputs for all granite models (#30957) Gabe Goodhart 2026-10-22 03:02:41 -04:00
dfeea52005 kleidiai : add Q8_0 SVE dotprod GEMV and SVE i8mm GEMM kernels (#30808) Charles Xu 2026-10-22 08:56:21 +02:00
e3797b184d sycl: merge the fp16 and fp32 dequant switches (#30740) Titaniumtown 2026-10-21 22:30:21 -07:00
0b1281aeef webgpu : add Q2_0 support (#30914) Chanho Lee 2026-10-22 14:30:04 +09:00
4912ac24f1 dflash : load optional FC input scale (#30945) Hrishith Thadicherla 2026-10-22 10:54:12 +05:30
84746c5c94 ui: Add "Show tool call in progress" setting (#30681) Aleksander Grygier 2026-10-22 07:14:47 +02:00
0682a576a7 lora : support prism.hadamard folded weights (#30910) Hoang Vien Duy 2026-10-22 12:12:17 +07:00
a6b83d426f ui : key draft sidecar badges by model instead of repo (#30919) Aleksander Grygier 2026-10-22 07:11:45 +02:00
c7fc509417 opencl: add F32-to-I32 ARGMAX (#30897) kurquharandLi He 2026-10-21 18:02:50 -07:00
a37cc46104 models : add Flint model (FlintForCausalLM) (#30928) alexey-rsiandSigbjørn Skjæret 2026-10-21 23:26:22 +02:00
99fb997184 jinja : fix namespace attributes shadowed by dict methods (#30941) Tarek Dakhran 2026-10-21 23:06:56 +02:00
7775ffb7e4 model: Add support for SenseNova U1 model (#28919) Maphist0andSigbjørn Skjæret 2026-10-22 03:54:16 +08:00
d454a204ef llama: create new fused op for QSA mask (#30640) Aman GuptaandPascal 2026-10-22 01:02:22 +08:00
0756e83fc1 sycl: q8 fast dequant (#30775) 92es 2026-10-21 10:01:03 -07:00
9febe63d5a jinja: support hexadecimal string escapes (#30929) alexey-rsi 2026-10-21 18:04:36 +02:00
9b56ccf00d ggml-opencl : add IM2COL_3D support (#30895) kurquharandLi He 2026-10-21 07:59:55 -07:00
0a1ef309cd mtmd: add state object for mtmd_gen (#30902) Xuan-Son Nguyen 2026-10-21 12:59:54 +02:00
261700b896 server : forward llama.cpp sampling params on /v1/messages (#30856) David Garcia 2026-10-21 06:58:52 -04:00
f849095365 vendor: update BoringSSL to 0.20261020.0 (#30889) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-10-21 06:15:54 -03:00
824eaecf48 llama : optimize vocabulary loading (#30679) Evgen MykhailenkoandGeorgi Gerganov 2026-10-21 05:03:27 -04:00
eb182d85c0 llama : place d2t by its set_rows use so it can stay on the GPU (#30912) Aman Gupta 2026-10-21 14:02:29 +05:30
ea9e3446b5 metal : fix memory leaks and cleanup logic in GPU capture path (#30890) Niklas Wenzel 2026-10-21 09:54:33 +02:00
0efe8e4c6b hexagon: neon-vectorized and threaded repack (tiling) (#30901) Max Krasnyanskyandhubezhou 2026-10-21 00:48:39 -07:00
b531e4c749 opencl: add dp4a GEMM variants to vector load activation (#30753) lhez 2026-10-21 00:48:13 -07:00
74b115ca6e sycl : fix fa crash for Query head dimension mismatch (neq0 != HSK / D=2048/4096) (#30286) Neo Zhang 2026-10-21 15:46:43 +08:00
96caa80059 sycl: collapse duplicate need_check launch bodies in mmq (#30739) Titaniumtown 2026-10-21 00:46:00 -07:00
479a52779f ggml-cpu : compute f32 gelu_quick and geglu_quick without the fp16 table (#30737) bosh 2026-10-21 14:34:37 +07:00
8baabd53b7 llama : scale moe down projection per expert token (#30861) Georgi Gerganov 2026-10-21 09:01:00 +03:00
493253fe5a Sycl iq3 crash fix (#30604) Anant Shrivastava 2026-10-21 10:34:13 +05:30
339f3242c7 opencl: fix rope program build error with newer Clang (#30893) Ben Ashbaugh 2026-10-20 17:19:08 -07:00
9a3b91c680 server : fix usage.completion_tokens undercount with n > 1 (#29486) Unbug Lee 2026-10-21 07:19:54 +08:00
5c0b49a23b server : add POST /tts endpoint for TTS models (#26603) Xuan-Son NguyenandPascal 2026-10-21 01:19:42 +02:00
1242be66f6 server: add realtime transcription API (#30636) Xuan-Son NguyenandPascal 2026-10-21 00:04:15 +02:00
84e66d0321 refactor : move LFM2 shortconv and FFN blocks into a shared LFM base (#30874) Tarek DakhranandGeorgi Gerganov 2026-10-20 23:17:13 +02:00
52ffa02745 model : support Nemotron-3(.5)-Embed (#30877) Takamichi Ohara 2026-10-21 05:48:45 +09:00
839a572a4c qwen: reshape output to 2d instead of 3d (#30823) Aman Gupta 2026-10-21 00:39:56 +05:30
ead9f32058 server: Support logprobs with speculative decoding (#27196)
Nigel Bosch Claude Fable 5 Jeonghyun Lee
2026-10-20 12:36:14 -05:00
b684b498b6 hexagon: fix VTCM size query on images that need layout out-params (#30655) Tarek Dakhran 2026-10-20 19:22:08 +02:00
4a45de4f2c mtmd : lfm2 tiles and layout match transformers (#30261) Yuri KhrustalevandXuan Son Nguyen 2026-10-20 12:54:46 -04:00
7e3eeee048 model : add H2O-Lightning-4B decision model (#30361)
PSEUDOTENSOR / Jonathan McKinney Jonathan C. McKinney Xuan Son Nguyen
2026-10-20 09:54:27 -07:00
5ba3b9fd3d mtmd: fix gemma 4 ffn act (#30882) Xuan-Son Nguyen 2026-10-20 18:33:32 +02:00
5a9a34d888 server : avoid repeated mmproj memory margin addition on sleep/resume (#28233) TANGBUDUandTANGBUDU 2026-10-21 01:32:12 +09:00
39da130fcd ggml-cuda : support ssm_conv kernel size 7 (#30873) Tarek Dakhran 2026-10-20 17:47:44 +02:00
4e201388c3 server: Router wasn't propagating the client disconnects fully to the child, the response wait could cause a delayed cancellation (#29707) Me42019 2026-10-20 10:43:45 -05:00
1ba568c5ad server: fix missing output_index in Responses API SSE events for compatibility (#30863) Renzis 2026-10-20 22:17:06 +08:00
36140dbee2 mtmd : read LFM2 tiling params from GGUF metadata (#30840) Tarek DakhranandMichael DM 2026-10-20 16:05:30 +02:00
df11702136 metal : optimize argmax and pool_1d (#30862) Georgi Gerganov 2026-10-20 16:46:00 +03:00
9df0b73c70 model : drop the redundant precision overrides in the Kolibri-1 router (#30865) Georgi GerganovandSigbjørn Skjæret 2026-10-20 15:58:09 +03:00
b38960f520 ci : remove superfluous webgpu jobs (#30868) Sigbjørn Skjæret 2026-10-20 14:27:55 +02:00
a01ce9ffc6 opencl: add several gemm variants for small batches and some fixes (#30850) lhezandHongqiang Wang 2026-10-20 04:37:28 -07:00
8115b4c31f sycl : replace memset due to not always ordered (#30812) Neo Zhang 2026-10-20 19:35:48 +08:00
119f68d7d4 ggml-cpu : select the NEON fp32->fp16 conversion (#30505) Bernard Ladenthin 2026-10-20 13:35:06 +02:00
b684498579 HIP/CUDA: Fix reduction in mmf getting tile widths not devisiable by 64 (#30836) uvos 2026-10-20 13:32:38 +02:00
522f2b6eed ggml-zdnn: introduce flash attention op (#30512) Aaron Teo 2026-10-20 19:31:35 +08:00
83c2d012a2 spec : save the dynamic ngram cache file (#22055) Peter SiderisandPetros Sideris 2026-10-20 14:31:10 +03:00
13786fbb3a CUDA: Clear CUDA graphs after legacy memory pool flush (#26771) Bálint Bokros 2026-10-20 13:30:50 +02:00
d80619397c server : pass id_slot through the Anthropic /v1/messages conversion (#28554) Peter van VelzenandXuan Son Nguyen 2026-10-20 13:23:41 +02:00
704366d76f metal : fix missing MoE kernel variant for 9 experts per token (#30610) (#30699) Caladrel 2026-10-20 06:02:05 -05:00
707616feb5 ci: Fix --strict mode for API check (#30623) Christian Kastner 2026-10-20 12:38:45 +02:00
d8d92973c8 vocab : add \p{M} to lookaheads in Tekken and GPT-4o pre-tokenizer regexes (#30845) tkran2 2026-10-20 03:37:46 -05:00
7879491cf4 tests : make MoE router selection independent of the backend noise (#30818) Georgi Gerganov 2026-10-20 10:40:15 +03:00
8466395353 hexagon: update to snapdragon-toolchain v0.8 and enable hexagon v85 (#30854) Max Krasnyansky 2026-10-19 23:49:59 -07:00
dd002b91f5 sycl: fix compiler warnings - missing prototypes, dead code, extra semicolons (#30271) Michael Taylor 2026-10-20 01:47:25 -03:00
1d88cb05f1 ui: hide the native clear button in SearchInput (#30719) aiqubits 2026-10-20 11:58:38 +08:00
3bb63cbcbf sycl : fix get_rows on reordered quantized weights (#30430) Sam MurdochandSam 2026-10-20 10:47:21 +11:00
f711c8f303 mtmd : match the transformers Qwen-VL resize (#30736) bosh 2026-10-20 06:14:40 +07:00
921257f500 ci, docs: add WASI CI and docs (#30754) Mendy Berger 2026-10-19 19:09:55 -04:00
3ffb62935b ci : re-enable type/lint-check for skills (#30713) Sigbjørn Skjæret 2026-10-20 01:03:03 +02:00
7adf160c41 server: add --connect, allow p2p access to server outside LAN (#28277)
Xuan-Son Nguyen Pascal Adrien Gallouët
2026-10-20 00:23:14 +02:00
ab7ed0d4b5 ui : fix attachment text preview clipped when a line is longer than the container (#30806) A-Raphie 2026-10-19 23:22:14 +01:00
4c3c5810f8 hybrid dna tokenizer fixes (#30825) Kashif RasulandSigbjørn Skjæret 2026-10-19 23:01:40 +02:00
1b29621bac opencl: add cooperative-k dp4a gemm for q4_0, q4_k and q6_k (#30741) lhez 2026-10-19 12:30:39 -07:00
6fa4f6cd3e opencl: add get_rows for i32, cpy for i32 and f32 (#30756) lhez 2026-10-19 12:22:34 -07:00
0ce8cd1141 jinja : implement unique filter (#30819) Aldehir Rojas 2026-10-19 12:18:24 -05:00
f174553e16 server : fix swa checkpoint invalidation logic (#30666) Tarek Dakhran 2026-10-19 15:58:14 +02:00

1 2 3 4 5 ...

Commit Graph Select branches Hide Pull Requests master Mono Color

Commit Graph

Select branches

Hide Pull Requests

master