Request ARM quants

by lucid-gunner - opened Oct 19, 2024

Hi, wonderful work as always. Can you please make Q4_0_X_X quants for this model. Thanks!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment