breadlicker45
/

model

model / params.json

Upload 3 files

542eb73 almost 3 years ago

101 Bytes

{"dim": 4096, "multiple_of": 256, "n_heads": 32, "n_layers": 32, "norm_eps": 1e-06, "vocab_size": -1}