Spaces:
Running
Running
Commit History
py : make convert-pt-to-ggml.py backwards compatible with older vocab.json tokenizer files (#1001) 83e4988 unverified
minor : improve C++ and Python style (#768) 3ebe4d6 unverified
AsukaMinato commited on
models : change convert-pt-to-ggml to use .tiktoken tokenizer files (#725) a7879d3 unverified
Ivan Gorin commited on
models : add usage comments to the HF convert script (#157) 8528ec5 unverified
models : simplify the conversion script 1ffa4c8 unverified
minor : remove one more redundant line 6f3392b unverified
minor : fix double float32 conversion in python script e6c2e3e unverified
Add enconding parameter to vocab.json opening to fix errors bf50d62
Joonas Pihlajamaa commited on