llama : add Command R Plus support (llama/6491) 8cf7097 unverified Carolinabanana S S slaren ggerganov commited on Apr 9, 2024
ggml : reuse quantum structs across backends (llama/5943) bb0625f unverified ggerganov commited on Mar 12, 2024
1.5 bit: we can do even better (llama/5999) 36cc71e unverified Kawrakow ikawrakow commited on Mar 11, 2024
ggml, ci : Windows ARM runner and build fixes (llama/5979) 507b9dd unverified Michael Podvitskiy commited on Mar 11, 2024
Better 1.5 bit quantization (llama/5971) f3a62cc unverified Kawrakow ikawrakow commited on Mar 11, 2024
ggml : fix unnecessary f32 -> f16 -> f32 casts (mmla) (llama/5951) cb8bbaa unverified ggerganov commited on Mar 9, 2024
ggml : remove old quantization functions (llama/5942) 11a2545 unverified ggerganov commited on Mar 9, 2024
ggml : add ggml-common.h to deduplicate shared code (llama/5940) 0a37735 unverified ggerganov commited on Mar 9, 2024
ggml : use `uint8x16_t` return type for `ggml_vqtbl1q_u8` (llama/5894) 7f5bc53 unverified bobqianic commited on Mar 6, 2024
quants : use MM256_SET_M128I consistently to fix gcc 7 build (llama/5889) cdd783a unverified Cebtenzzre commited on Mar 5, 2024
ggml : fix IQ3_S AVX implementation (llama/5834) 98e5c63 unverified ggerganov commited on Mar 2, 2024
ggml : make i-quants work with super-blocks of 64 (CPU,Metal) (llama/5760) 9a07f42 unverified Kawrakow ikawrakow commited on Feb 28, 2024
Attempt to fix android build (llama/5752) e720b3b unverified Kawrakow ikawrakow commited on Feb 27, 2024
IQ4_XS: a 4.25 bpw quantization (llama/5747) 0ee1bfb unverified Kawrakow ikawrakow commited on Feb 27, 2024
ggml-quants : fix avx2 iq1_s vec_dot when compiled with gcc (llama/5742) 72e8610 unverified Engininja2 commited on Feb 27, 2024
Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range (llama/5721) 2b9bb9e unverified Kawrakow ikawrakow ggerganov commited on Feb 26, 2024
ggml-quants : provide ggml_vqtbl1q_u8 for 64bit compatibility (llama/5711) 430efc6 unverified Crad commited on Feb 25, 2024
IQ3_S: a much better alternative to Q3_K (llama/5676) 32589c9 unverified Kawrakow ikawrakow commited on Feb 24, 2024
ggml : always define ggml_fp16_t as uint16_t (llama/5666) bc567d3 unverified ggerganov commited on Feb 22, 2024
ggml : restore vec dot stride arg names (llama/5453) de4041f unverified ggerganov commited on Feb 18, 2024
ci : fix wikitext url + compile warnings (llama/5569) 49f0106 unverified ggerganov commited on Feb 18, 2024
ggml-quants : fix compiler warnings (shadow variable) (llama/5472) e538f25 unverified Kawrakow ikawrakow commited on Feb 13, 2024
ggml : fix compile warnings (unused vars) (llama/4966) 97fa2e3 unverified ggerganov commited on Feb 11, 2024
ggml : add mmla kernels for quantized GEMM (llama/4966) 0d50a29 unverified snadampal commited on Feb 11, 2024
ggml : fix `error C2078: too many initializers` for MSVC ARM64 (llama/5404) 8ebb36c unverified Michael Podvitskiy commited on Feb 9, 2024
Slight quantization improvement for Q4_K and Q5_K (llama/5361) e3cd020 unverified Kawrakow ikawrakow commited on Feb 6, 2024
iq2_xxs: tune quantization (llama/5320) 11e5f6b unverified Kawrakow ikawrakow commited on Feb 5, 2024
Faster AVX2 dot product for IQ2_XS (llama/5187) 187ae44 unverified Kawrakow ikawrakow PeterReid commited on Jan 30, 2024
ggml : add IQ2 to test-backend-ops + refactoring (llama/4990) 227f2ae unverified ggerganov commited on Jan 17, 2024
ggml : importance matrix support for legacy quants (llama/4969) d8bb9d8 unverified Kawrakow ikawrakow commited on Jan 16, 2024
Add ability to use importance matrix for all k-quants (llama/4930) 7032309 unverified Kawrakow ikawrakow commited on Jan 14, 2024
ggml : fix 32-bit ARM compat for IQ2_XS (#1758) d5836c9 unverified ggerganov commited on Jan 12, 2024
ggml : SOTA 2-bit quants (add IQ2_XS) (llama/4856) 5e827d5 unverified Kawrakow ikawrakow commited on Jan 11, 2024
ggml : fix vld1q_s8_x4 32-bit compat (llama/4828) efed5ba unverified ggerganov commited on Jan 9, 2024