bigscience-data
/

tokenizer_v0

Model card Files Files and versions

tokenizer_v0 / tokenizer.json

thomasw21

Add tokenizer

9f96c30 over 4 years ago

History Blame Contribute Delete

10.6 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 166557adf7dc11995dcb3fb98673dbb7be26881f21be3681ca2f35c78b480cee
Size of remote file:: 10.6 MB
SHA256:: 54733cceb3fa9eb9e61b238bd09f4c755b99703841351029e4a4e1b9f21d968a

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.