Instructions to use wesley-stepgrid/hyperclovax-seed-text-instruct-1.5b-litert-lm with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use wesley-stepgrid/hyperclovax-seed-text-instruct-1.5b-litert-lm with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli litert-lm run \ --from-huggingface-repo=wesley-stepgrid/hyperclovax-seed-text-instruct-1.5b-litert-lm \ --prompt="Write me a poem"
- Notebooks
- Google Colab
- Kaggle
HyperCLOVA X SEED Text Instruct 1.5B โ LiteRT-LM (safety fine-tuned, int4)
Powered by HyperCLOVA X.
This repository redistributes NAVER's HyperCLOVA X SEED Text Instruct 1.5B converted to the
on-device .litertlm format (LiteRT-LM 0.13.x, Android), for use as the low-end Korean "mind"
(๋
ธ๋ฐ / Nova) in the StepGrid wellness app. It is a derivative of, and remains governed by, the
HyperCLOVA X SEED Model License Agreement โ see the license link above. All HyperCLOVA X SEED
usage restrictions and the acceptable-use policy pass through to this redistribution unchanged.
What was changed vs. the base model
- Safety fine-tuning (QLoRA). A small Korean-language safety SFT set (dangerous-question โ safe-answer, with contrast/retention examples) was applied so the model reliably warns on household-chemical and gas-safety questions instead of giving unsafe advice. Merged back to the base weights before conversion.
- Stop-token fix.
eos_token_idset to the real turn-end tokens (<|im_end|>,<|endofturn|>) so generation stops cleanly (the baseconfig.jsonvalue caused token leakage / run-on output). - int4 (BLOCKWISE_32 dynamic) quantization so it loads within memory on older Android CPUs.
The StepGrid app additionally applies deterministic, model-independent safety backstops (dangerous chemical-mix and medicine-dose guards) on top of this model at both generation and history-display time. On-device behavior should not be assumed safe without such guards.
Attribution
- Base model: HyperCLOVA X SEED Text Instruct 1.5B, ยฉ NAVER Cloud โ Powered by HyperCLOVA X.
- License: HyperCLOVA X SEED Model License Agreement (see
license_link). Redistribution here is under the same terms, including the name prefix, the "Powered by HyperCLOVA X" notice, and pass-through of the license and acceptable-use policy.
- Downloads last month
- 18