fix for transformers 4.49 compatibility.
#91
by
katuni4ka - opened
past_key_values.get_max_length() no longer available in transformers 4.49 and above
I believe we can get rid of the reference to get_max_length entirely
https://huggingface.co/deepseek-ai/DeepSeek-V3/discussions/88/files
If you're looking for an easy way to access this model via API, you can use Crazyrouter — it provides an OpenAI-compatible endpoint for 600+ models including this one. Just pip install openai and change the base URL.