Commit Graph

Select branches

Hide Pull Requests

master

Mono Color

• 7fdd16b432 server : improve context checkpoint logic (#16440) Georgi Gerganov 2025-10-08 10:57:29 +03:00
• 74b8fc17f9 ggml webgpu: profiling, CI updates, reworking of command submission (#16452) Reese Levine 2025-10-07 13:48:56 -07:00
• aeaf8a36f0 llama : support LiquidAI LFM2-MoE hybrid model (#16464) Tarek Dakhran 2025-10-07 20:03:35 +02:00
• df1b612e29 server : add /v1/health endpoint (#16461) Georgi Gerganov 2025-10-07 15:57:14 +03:00
• 4e0388aa8a webui : added download action (#13552) (#16282) Sascha RogmannandAleksander Grygier 2025-10-07 11:11:08 +02:00
• ef4c5b87ea presets : fix pooling param for embedding models (#16455) Georgi Gerganov 2025-10-07 10:32:32 +03:00
• c61ae20d05 rpc : update documentation (#16441) Radoslav GerganovandDiego Devesa 2025-10-07 09:59:13 +03:00
• 0123ff38f5 memory : use sequential equal splits for recurrent modules (#16442) Georgi Gerganov 2025-10-07 08:24:17 +03:00
• 0a319bb75e metal : add support for non-padded FA KV (#16148) Georgi Gerganov 2025-10-07 08:23:30 +03:00
• 1d6092fc72 tests : add -INF blocks to the KQ mask in the FA tests (#16380) Georgi GerganovandJeff Bolz 2025-10-07 08:22:35 +03:00
• 8ae32dc9ec metal : various optimizations + refactoring (#16446) Georgi Gerganov 2025-10-07 08:21:40 +03:00
• 3df2244df4 llama : add --no-host to disable host buffers (#16310) Gadflyiiandslaren 2025-10-06 12:55:53 -05:00
• c08002a198 chat : Granite Docling stopping (#16438) Gabe Goodhart 2025-10-06 10:59:40 -06:00
• 3a002afafa ci : refactor sdk caching to minimize storage (#16414) Sigbjørn Skjæret 2025-10-06 17:40:21 +02:00
• a23b9bdbd3 ggml : fix unaligned access in AMX code (#16315) Georgi Gerganov 2025-10-06 16:05:27 +03:00
• 04e632a4aa ci : remove missing reranker model files (#16444) Daniel Bevenius 2025-10-06 14:56:59 +02:00
• a80ff183ab ggml-cpu : fix leftover handling in ggml_vec_scale_f32 for SVE (#16443) Daniel Bevenius 2025-10-06 14:17:12 +02:00
• 1d49ca3759 nix : removed metal for nix (#16118) Yuannan 2025-10-06 09:29:56 +00:00
• c5fef0fcea server: update readme to mention n_past_max metric (#16436) Oleksandr Kuvshynov 2025-10-06 03:53:31 -04:00
• ca71fb9b36 model : Granite docling + Idefics3 preprocessing (SmolVLM) (#16206) Gabe GoodhartandXuan Son Nguyen 2025-10-05 06:57:47 -06:00
• 35266573b9 ggml webgpu: actually add softmax, fix rms_norm offset (#16400) Reese Levine 2025-10-04 20:59:31 -07:00
• 86df2c9ae4 vulkan: use a more appropriate amount of threads when generating shaders (#16418) Eve 2025-10-04 20:04:27 +00:00
• f39283960b rpc : check src buffer when copying tensor (#16421) Radoslav Gerganov 2025-10-04 16:22:45 +03:00
• 898acba681 rpc : add support for multiple devices (#16276) Radoslav Gerganov 2025-10-04 12:49:16 +03:00
• e29acf74fe vulkan : incremental shader builds (#16341) AclyandJeff Bolz 2025-10-04 11:42:56 +02:00
• 128d522c04 chat : support Magistral thinking (#16413) Pascal 2025-10-03 20:51:48 +02:00
• f6dcda3900 server : context checkpointing for hybrid and recurrent models (#16382) ddh0andGeorgi Gerganov 2025-10-03 13:34:51 -05:00
• 606a73f531 metal : fix loop bound in ggml_mem_ranges (#16412) Georgi Gerganov 2025-10-03 19:18:56 +03:00
• 946f71ed9a llama : fix shapes for bert/mpt q/k norm (#16409) Sigbjørn Skjæret 2025-10-03 14:40:25 +02:00
• 638d330246 ggml : fix graph reallocation with multiple chunks (#16396) Acly 2025-10-03 13:49:08 +02:00
• 84c8e305e8 Fix missing messages on sibling navigation (#16408) Aleksander Grygier 2025-10-03 12:51:40 +02:00
• 2aaf0a2a20 vulkan: Replace uses of maxMemoryAllocationSize and VK_WHOLE_SIZE (#16354) Jeff Bolz 2025-10-03 05:50:46 -05:00
• 0e1f838556 vulkan: Fix FA coopmat1 invalid array indexing (#16365) Jeff Bolz 2025-10-03 04:52:46 -05:00
• ad126479c2 ci : change macos-13 to macos-15-intel (#16401) Daniel Bevenius 2025-10-03 11:45:16 +02:00
• 77233277c9 Capture model name only after first token (streaming) or completed request (#16405) Aleksander Grygier 2025-10-03 11:30:39 +02:00
• e308efda8e vulkan: in flash attention, bounds check against nem1 (don't rely on GGML_KQ_MASK_PAD) (#16316) Jeff Bolz 2025-10-03 03:33:08 -05:00
• 136bda78c5 webui : Fix messages payload sent to chat completions (#16402) Aleksander Grygier 2025-10-03 09:11:34 +02:00
• 5113efd34c fix: track viewportHeight via window.innerHeight to avoid unwanted scrolling (#16356) PascalandAleksander Grygier 2025-10-03 08:01:31 +02:00
• d64c8104f0 test-barrier : do not use more threads than physically available (#16389) Sigbjørn SkjæretandJeff Bolz 2025-10-02 20:10:12 +02:00
• ef07a40906 ggml webgpu: add support for soft_max, optimize rms_norm (#16357) Reese LevineandGeorgi Gerganov 2025-10-02 11:00:31 -07:00
• 34fcc5a4ac model : Apertus model implementation (#15852) 4 people 2025-10-02 19:43:22 +02:00
• 91a2a56556 musa: update compile flags (#16265) R0CKSTAR 2025-10-02 21:29:56 +08:00
• 72ee736c44 ci : fix ubuntu-latest-cmake-rpc (disable ccache) (#16388) Sigbjørn Skjæret 2025-10-02 13:51:36 +02:00
• f09aefaa84 ci: update vulkan ci (#16294) Eve 2025-10-02 08:10:07 +00:00
• bbd32bc038 ci : fix clean-up of old logs (#16381) Georgi Gerganov 2025-10-02 10:35:43 +03:00
• 2be72c2b12 SYCL: Update to oneAPI 2025.2 (#16371) Neo Zhang JianyuandZhang Jianyu 2025-10-02 15:16:25 +08:00
• 95ce098544 HIP: add IMbackK to codeowner (#16375) uvos 2025-10-02 05:52:59 +02:00
• c8dedc9999 CI: reenable cdna in rocm docker builds (#16376) uvos 2025-10-01 23:32:39 +02:00
• e95fec640f HIP: Disable ROCWMMA fattn on CDNA when compiled against ROCWMMA 2.0.0 (#16221) uvos 2025-10-01 23:09:25 +02:00
• ded67b9444 llama : parameter conversion and loading fixes for PLaMo2 variants (#16075) Shunta SaitoandSigbjørn Skjæret 2025-10-02 06:08:15 +09:00
• 1fe4e38cc2 ci: Properly install rocwmma for hip builds (#16305) uvos 2025-10-01 20:18:03 +02:00
• 4201deae9c common: introduce http.h for httplib-based client (#16373) Adrien Gallouët 2025-10-01 19:22:18 +02:00
• 764799279f Conversation action dialogs as singletons from Chat Sidebar + apply conditional rendering for Actions Dropdown for Chat Conversation Items (#16369) Aleksander Grygier 2025-10-01 18:18:10 +02:00
• 2a9b63383a Improve code block color theming (#16325) Aleksander Grygier 2025-10-01 15:54:42 +02:00
• 1104ca1a1c ci : use registry cache for docker builds (#16366) Sigbjørn Skjæret 2025-10-01 14:09:52 +02:00
• 4f1575921c Add optional setting for showing "Model used:" information (#16337) Aleksander Grygier 2025-10-01 12:08:16 +02:00
• 132d673554 vulkan: make ggml_vk_default_dispatcher support older vulkan headers (#16345) Eve 2025-10-01 07:56:36 +00:00
• aa9538a63a webui: Remove running llama-server within WebUI dev.sh script (#16363) Aleksander Grygier 2025-10-01 07:40:26 +02:00
• e74c92e842 model : support GLM 4.6 (make a few NextN/MTP tensors not required) (#16359) Bartowski 2025-09-30 16:24:36 -04:00
• b2ba81dbe0 ci : fix ccache key for ubuntu-cpu-cmake (#16355) Sigbjørn Skjæret 2025-09-30 21:41:42 +02:00
• bf6f3b3a19 common : disable progress bar without a tty (#16352) Adrien Gallouët 2025-09-30 19:52:41 +02:00
• 7c156df414 opencl: support pad_ext (#15888) lhez 2025-09-30 10:45:45 -07:00
• 16b0ca0d2e Chatapi ignore empty sampling (#16330) Pascal 2025-09-30 19:18:54 +02:00
• 8d78cd2613 ggml webgpu: support for rope,div,sub,glu,scale,cont operators (#16187) Reese LevineandGeorgi Gerganov 2025-09-30 09:57:51 -07:00
• d1c84a662d opencl: support ne3 in get_rows (#15866) lhez 2025-09-30 09:55:13 -07:00
• 364a7a6d4a common : remove common_has_curl() (#16351) Adrien Gallouët 2025-09-30 16:39:44 +02:00
• 2df5bcf357 ci : disable ccache for android (#16348) Sigbjørn Skjæret 2025-09-30 15:38:01 +02:00
• 075c01567b ggml : bump version to 0.9.4 (ggml/1363) Georgi Gerganov 2025-09-30 13:42:39 +03:00
• a014310374 cuda : Enable CUDA Graph usage for Nemotron Nano v2 (NemotronH) (#16328) anavp-nvidia 2025-09-30 08:13:22 +00:00
• 35fb82497e metal : dynamic simdgroups for MV kernels (#16340) Georgi Gerganov 2025-09-30 11:03:23 +03:00
• 3c62aed89f common : simplify etag tracking by removing json (#16342) Adrien Gallouët 2025-09-30 09:36:33 +02:00
• f1eb1cb1eb kleidiai : fix work size and threads sync for fp16 (#16246) Charles Xu 2025-09-30 09:07:20 +02:00
• de41f2b7bf codeowners: add codeowners for opencl backend (#16344) lhez 2025-09-29 22:30:16 -07:00
• a74a0d69f3 tests: override test_set_rows::max_nmse_err to allow for occasional rounding differences (#16295) Jeff Bolz 2025-09-29 19:26:34 -05:00
• 5f7e166cbf Fix thinking blocks with quotes + add handling [THINK]...[/THINK] blocks (#16326) PascalandAleksander Grygier 2025-09-29 18:49:47 +02:00
• d72f5f7ba2 ci : add AMD runners and workflows (#16249) Georgi Gerganov 2025-09-29 17:51:48 +03:00
• b77e6c18e1 ggml: riscv: add riscv spacemit backend (#15288) 3 people 2025-09-29 22:50:44 +08:00
• 2ddd3f2356 sync : ggml Georgi Gerganov 2025-09-29 16:50:52 +03:00
• 4d3d455d3c sync : whisper.cpp (ggml/1359) Georgi Gerganov 2025-09-29 16:49:11 +03:00
• c9b1c06467 ggml : remove -dev suffix from release version (ggml/1355) Daniel Bevenius 2025-09-26 17:34:42 +02:00
• b6ae75afb4 ggml : bump version to 0.9.3 (ggml/1353) Daniel Bevenius 2025-09-25 14:39:05 +02:00
• b6dff20e2f ggml : prepare for development of 0.9.2-dev Georgi Gerganov 2025-09-20 16:44:23 +03:00
• 2db78c75e4 ggml : bump version to 0.9.1 Georgi Gerganov 2025-09-20 16:44:23 +03:00
• 02463ab27b ggml-backend : add root cause in error message if loading backend library fails (#16172) Rafal Lewczuk 2025-09-29 13:17:09 +02:00
• adc76347d7 ggml : check cuda and metal argsort limits and add test (#16323) Sigbjørn Skjæret 2025-09-29 11:09:00 +02:00
• 3a2bdcda0b Improve Mobile UI for dialogs and action dropdowns (#16222) Aleksander GrygierandPascal 2025-09-29 10:37:20 +02:00
• 66bb7985c3 fix: preserved zero values in chat settings inputs and textareas by switching to nullish coalescing for field values and default placeholders (#16312) Pascal 2025-09-29 09:08:41 +02:00
• 2f61c0f5bf llama-cli: prevent spurious assistant token (#16202) VinkalandSigbjørn Skjæret 2025-09-29 12:33:12 +05:30
• 3ffd0fae47 perplexity : show more kl-divergence data (#16321) ddh0 2025-09-29 01:30:45 -05:00
• a4a0aa5ea2 ggml : fix dependencies for ggml_set_rows (#16318) Georgi Gerganov 2025-09-29 08:41:28 +03:00
• 92cd103f62 vulkan: Fix validation failure in quantized flash attention (#16292) Jeff Bolz 2025-09-28 23:50:37 -05:00
• b887d2f341 ggml : fix GGML_F32_VEC_FMA argument order in ggml_vec_mad1_f32 (#16307) Sigbjørn Skjæret 2025-09-28 23:15:03 +02:00
• bd0af02fc9 common : fix reasoning before forced tool call via tool_choice = required (#16264) crat0zandAlde Rojas 2025-09-28 14:13:50 -04:00
• d9e0e7c819 ci : fix musa docker build (#16306) R0CKSTAR 2025-09-28 22:38:15 +08:00
• 0124ac989f devops: switch to using ubuntu-22.04-s390x image (#16302) Aaron Teo 2025-09-28 19:25:58 +08:00
• 2811c65286 Fixed a few typos in the README of the LLaMA.cpp HTTP Server [no ci] (#16297) Imad Saddik 2025-09-28 12:04:46 +01:00
• d8359f5fde vulkan: 64-bit im2col (#16135) Jeff Bolz 2025-09-28 01:38:37 -05:00
• 6a2c6145a0 metal : extend mat-mat multiplication support (#16225) Georgi Gerganov 2025-09-28 09:34:44 +03:00
• 3b53634fe3 metal : fuse non-sequential nodes (#16102) Georgi Gerganov 2025-09-28 09:34:05 +03:00
• 1384abf8b8 vulkan: handle mat_mul with A matrix > 4GB (#16176) Jeff Bolz 2025-09-27 20:36:34 -05:00