Article
66
Mostafa Elhoushi
melhoushi
AI & ML interests
Make ML faster, smaller, smarter.
Recent Activity
authored a paper 5 days ago
Calibrating Beyond English: Language Diversity for Better Quantized Multilingual LLM authored a paper 5 days ago
Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation updated a model about 1 month ago
melhoushi/gpt_cp_h2048_d40_gbs200_tpp20.0_lp0.8_linear_linear_reverseOrganizations
models 154
melhoushi/gpt_cp_h2048_d40_gbs200_tpp20.0_lp0.8_linear_linear_reverse
Updated • 130
melhoushi/common_pile_h2048_d40_gbs200_tpp20.0_lp0.8_linear_linear_reverse
Updated • 11
melhoushi/Moonlight-16B-A3B-Instruct-transformers-5.13.0
Text Generation • 16B • Updated • 52
melhoushi/gpt_cp_h1152_d23_gbs76_tpp20.0_lp0.4_linear_linear_reverse
Updated • 16
melhoushi/common_pile_h1152_d23_gbs76_tpp20.0_lp0.4_linear_linear_reverse
Updated • 2
melhoushi/gpt_cp_h1152_d23_gbs76_tpp20.0_lp0.4_linear_null
Updated • 16
melhoushi/common_pile_h1152_d23_gbs76_tpp20.0_lp0.4_linear_null
Updated • 1
melhoushi/gpt_cp_h896_d17_gbs66_tpp20.0_lp0.4_linear_null
Updated • 14
melhoushi/common_pile_h896_d17_gbs66_tpp20.0_lp0.4_linear_null
Updated • 3
melhoushi/gpt_cp_h640_d13_gbs48_tpp20.0_lp0.4_linear_null
Updated • 17
datasets 138
melhoushi/OpenThoughts3_science_qwen7binst_traj_n16w16_2048
Viewer • Updated • 4.5M • 13
melhoushi/OpenThoughts3_math_qwen7binst_traj_n16w16_2048
Viewer • Updated • 4.05M • 22
melhoushi/OpenThoughts3_code_qwen7binst_traj_n16w16_2048
Viewer • Updated • 9.63M • 19
melhoushi/OpenThoughts3_science_qwen7binst_sft_2048
Viewer • Updated • 91.8k • 33
melhoushi/OpenThoughts3_math_qwen7binst_sft_2048
Viewer • Updated • 88.3k • 6
melhoushi/OpenThoughts3_code_qwen7binst_sft_2048
Viewer • Updated • 200k • 21
melhoushi/OpenThoughts3_code_qwen_sft_2048
Viewer • Updated • 212k • 35 • 1
melhoushi/OpenThoughts3_math_qwen_sft_2048
Viewer • Updated • 79.5k • 11
melhoushi/OpenThoughts3_math_qwen_sft
Viewer • Updated • 80.7k • 6
melhoushi/baseline_gptq_dataset_codesmath
Viewer • Updated • 1.02k • 29