Perplexity - google_gemma-3-27b-it-qat-Q4_K_M has the worst score of all Q4 quants. The rest test in the thread.

#3
by mirek190 - opened

google_gemma-3-27b-it-abliterated-Q4_K_M.gguf <-- older uncensored version
10042 82.23461462

google_gemma-3-27b-it-qat-q4_0.gguf <-- original from google
10042 82.83210516

google_gemma-3-27b-it-Q4_K_M.gguf <-- older Bartowski imatrix q4km
10042 82.91177056

google_gemma-3-27b-it-qat-Q4_K_M.gguf <-- newest Bartowki has the worst score
10042 82.28000000%

google_gemma-3-27b-it-abliterated-Q4_K_M.gguf <-- older uncensored version
10042 82.23461462

google_gemma-3-27b-it-qat-q4_0.gguf <-- original from google
10042 82.83210516

google_gemma-3-27b-it-Q4_K_M.gguf <-- older Bartowski imatrix q4km
10042 82.91177056

google_gemma-3-27b-it-qat-Q4_K_M.gguf <-- newest Bartowki has the worst score
10042 82.28000000%

how i can test it like this with score?

Sign up or log in to comment