TRI-ML
/

openlm-7b-code

Text Generation

Model card Files Files and versions

sedrickkeh commited on Dec 15, 2023

Commit

19b381e

·

1 Parent(s): c45af9e

qk norm

Files changed (1) hide show

config.json +2 -1

config.json CHANGED Viewed

@@ -20,5 +20,6 @@
   "torch_dtype": "float16",
   "transformers_version": "4.34.0.dev0",
   "use_cache": true,
-  "vocab_size": 50432
 }

   "torch_dtype": "float16",
   "transformers_version": "4.34.0.dev0",
   "use_cache": true,
+  "vocab_size": 50432,
+  "qk_norm": true,
 }