Hugging Face's logo

turboderp
/
GLM-4.6V-exl3

exl3
Model card Files
xet
Community
turboderp commited on
Commit
e06c0fd
·
verified ·
1 Parent(s): 4b37a2c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -13,5 +13,17 @@ EXL3 quants of [GLM-4.6V](https://huggingface.co/zai-org/GLM-4.6V)
13
 
14
  Base bitrates:
15
 
 
 
16
  [4.00 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/4.00bpw)
17
- (more to come)
 
 
 
 
 
 
 
 
 
 
 
13
 
14
  Base bitrates:
15
 
16
+ [2.00 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/2.00bpw)
17
+ [3.00 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/3.00bpw)
18
  [4.00 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/4.00bpw)
19
+ [5.00 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/5.00bpw)
20
+
21
+ Optimized:
22
+
23
+ [2.13 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/2.13bpw)
24
+ [2.32 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/2.32bpw)
25
+ [2.55 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/2.55bpw)
26
+ [2.80 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/2.80bpw)
27
+ [3.13 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/3.13bpw)
28
+ [3.55 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/3.55bpw)
29
+ [4.07 bits per weight](https://huggingface.co/turboderp/GLM-4.6V-exl3/tree/4.07bpw)