ojus1 commited on
Commit
e2fb75e
·
verified ·
1 Parent(s): 9f7d797

Update README with model card for gmail_googlecalendar

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -583,6 +583,10 @@ response = tokenizer.decode(output[0][input_tokens['input_ids'].shape[1]:], skip
583
  print("Response:", response)
584
  ```
585
 
 
 
 
 
586
  For best results, provide detailed system-prompt to steer the tool-use behaviour.
587
 
588
  # License
 
583
  print("Response:", response)
584
  ```
585
 
586
+ ## Deployment with vLLM
587
+
588
+ `vllm serve ojus1/Qwen3-0.6B-Instruct --enable-lora --lora-modules prem-research/Funcdex-0.6B=prem-research/Funcdex-0.6B-gmail_googlecalendar --enable-auto-tool-choice --tool-call-parser hermes`
589
+
590
  For best results, provide detailed system-prompt to steer the tool-use behaviour.
591
 
592
  # License