,Model Name,Total Time,GPU Util Time,Commonsense & NLI Mean Score,Commonsense & NLI Avg. Rank
1,Qwen_Qwen2.5-14B-Instruct (8bit),52h 44m,29h 32m,0.7941,1
2,Qwen_Qwen3-14B (8bit),29h 45m,17h 29m,0.7807,2
3,google_gemma-3-12b-it,15h 45m,14h 8m,0.7737,3
4,Qwen_Qwen2.5-7B-Instruct,9h 36m,8h 33m,0.773,4
5,openchat_openchat-3.6-8b-20240522,7h 51m,6h 59m,0.7726,5
6,01-ai_Yi-1.5-9B-Chat,13h 54m,12h 15m,0.7691,6
7,Qwen_Qwen2.5-7B-Instruct-1M,11h 17m,10h 10m,0.7564,7
8,Qwen_Qwen3-8B,15h 31m,13h 44m,0.7468,8
9,mistralai_Mistral-7B-Instruct-v0.3,8h 38m,7h 41m,0.7403,9
10,01-ai_Yi-1.5-6B-Chat,8h 4m,7h 1m,0.7374,10
11,Qwen_Qwen2.5-3B-Instruct,7h 48m,6h 30m,0.7367,11
12,mistralai_Ministral-8B-Instruct-2410,10h 46m,9h 27m,0.7328,12
13,NousResearch_Hermes-2-Pro-Mistral-7B,8h 27m,7h 28m,0.7284,13
14,Qwen_Qwen2-7B-Instruct,11h 30m,10h 11m,0.7274,14
15,01-ai_Yi-1.5-9B,11h 43m,10h 26m,0.7266,15
16,Qwen_Qwen3-4B,5h 51m,5h 3m,0.7266,16
17,meta-llama_Llama-3.1-8B-Instruct,12h 19m,10h 52m,0.7249,17
18,01-ai_Yi-1.5-6B,4h 28m,3h 54m,0.7199,18
19,google_gemma-3-4b-it,4h 51m,3h 50m,0.7167,19
20,meta-llama_Llama-2-13b-hf,19h 21m,17h 38m,0.7157,20
21,meta-llama_Llama-2-13b-chat-hf,17h 8m,15h 37m,0.7153,21
22,meta-llama_Meta-Llama-3-8B-Instruct,6h 30m,5h 46m,0.7147,22
23,deepseek-ai_DeepSeek-R1-0528-Qwen3-8B,17h 57m,15h 30m,0.7094,23
24,deepseek-ai_deepseek-llm-7b-chat,10h 6m,9h 8m,0.709,24
25,meta-llama_Llama-2-7b-chat-hf,6h 57m,6h 7m,0.6978,25
26,meta-llama_Llama-2-7b-hf,5h 42m,4h 59m,0.6956,26
27,deepseek-ai_DeepSeek-R1-Distill-Llama-8B,11h 46m,10h 36m,0.6928,27
28,deepseek-ai_deepseek-llm-7b-base,7h 11m,6h 26m,0.6886,28
29,Qwen_Qwen2.5-1.5B-Instruct,3h 20m,2h 36m,0.6803,29
30,meta-llama_Llama-3.2-3B-Instruct,7h 12m,5h 57m,0.6788,30
31,deepseek-ai_deepseek-math-7b-rl,8h 2m,7h 12m,0.6711,31
32,Qwen_Qwen2.5-Math-7B,27h 21m,24h 38m,0.6587,32
33,Qwen_Qwen3-1.7B,4h 25m,3h 36m,0.6442,33
34,deepseek-ai_DeepSeek-R1-Distill-Qwen-7B,6h 28m,5h 43m,0.6422,34
35,google_gemma-3-1b-it,6h 50m,4h 52m,0.6267,35
36,meta-llama_Llama-3.2-1B-Instruct,3h 30m,2h 35m,0.6264,36
37,Qwen_Qwen2.5-Math-7B-Instruct,5h 37m,4h 57m,0.6184,37
38,Qwen_Qwen2.5-0.5B-Instruct,2h 34m,1h 48m,0.6039,38
39,deepseek-ai_DeepSeek-R1-Distill-Qwen-1.5B,3h 40m,2h 52m,0.5703,39
40,Qwen_Qwen3-0.6B,3h 45m,2h 53m,0.5696,40
41,Qwen_Qwen2.5-Math-1.5B-Instruct,3h 25m,2h 39m,0.5181,41