Usage on Ornith-1.5-35B-A3B
Can this template be used on the Ornith-1.5-35B-A3B finetune also?
Ornith is the same family of model, and this template is working well for me on https://huggingface.co/dealignai/Ornith-1.5-35B-A3B-CRACK-GGUF - I also use it on https://huggingface.co/outsourc-e/Qwen3.8-27B-Unleashed-GGUF
Both have been great so far with this template for agentic and chat with reasoning on, and generating game json outputs with reasoning off.
I have an issue with the "auto_disable_thinking_with_tools: true" option when used with Ornith-1.5-35B-A3B and Hermes.
The tool calls are sent in xml eventhough I set the following in hermes config:
extra_body:
chat_template_kwargs:
tool_call_format: json
auto_disable_thinking_with_tools: true
Ornith 1.5 9B and Qwen 3.8 27B work with these chat template kwargs
Yep, Ornith is a Qwen finetune so it works with this template without issues.
@Pallito : If your Hermes proxy is dropping chat_template_kwargs, you can just change line 2 at the top of chat_template.jinja to _tool_format = 'json' before pasting it into your setup. In v22.4 I put all the default knobs right at the top so you do not have to rely on kwargs passthrough.