How to use mgoin/llama2_70b_sparsegpt_2_4_sft_tp1_fp8 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mgoin/llama2_70b_sparsegpt_2_4_sft_tp1_fp8", dtype="auto")
No model card
