| INFO: rkllm-toolkit version: 1.2.1b1 | |
| Loading model | |
| Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:02<00:00, 1.35it/s] | |
| /teamspace/studios/this_studio/RK | |
| /teamspace/studios/this_studio/RK/../data/datasets.json | |
| Building model | |
| Building model: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 423/423 [00:44<00:00, 9.53it/s] | |
| Build model success! | |
| Exporting model to: Seed-Coder-8B-Instruct.rkllm | |
| INFO: Setting chat_template to "<[begin▁of▁sentence]>system\nYou are an AI programming assistant, utilizing the Seed-Coder model, developed by ByteDance Seed, and you only answer questions related to computer science. For politically sensitive questions, security and privacy issues, and other non-computer science questions, you will refuse to answer.\n\n<[end▁of▁sentence]><[begin▁of▁sentence]>user\n[content]<[end▁of▁sentence]><[begin▁of▁sentence]>assistant\n" | |
| INFO: Setting token_id of bos to 0 | |
| INFO: Setting token_id of eos to 2 | |
| INFO: Setting token_id of sep to 6 | |
| INFO: Setting token_id of pad to 1 | |
| Converting model: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 291/291 [00:00<00:00, 2097152.00it/s] | |
| INFO: Setting max_context_limit to 4096 | |
| INFO: Exporting the model, please wait .... | |
| [=================================================>] 681/681 (100%) | |
| INFO: Model has been saved to Seed-Coder-8B-Instruct.rkllm! |