How to use kyars/llama-host with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("kyars/llama-host", device_map="auto")
