Hugging Face's logo

mervinpraison
/
tamilan-2-9b

Transformers
PyTorch
Safetensors
GGUF
English
gemma2
text-generation-inference
unsloth
trl
sft
praison
Model card Files
xet
 Community
How to use from
llama.cpp
Install (macOS, Linux) 
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mervinpraison/tamilan-2-9b:
# Run inference directly in the terminal:
llama cli -hf mervinpraison/tamilan-2-9b:
Install from WinGet (Windows) 
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mervinpraison/tamilan-2-9b:
# Run inference directly in the terminal:
llama cli -hf mervinpraison/tamilan-2-9b:
Use pre-built binary 
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf mervinpraison/tamilan-2-9b:
# Run inference directly in the terminal:
./llama-cli -hf mervinpraison/tamilan-2-9b:
Build from source code 
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf mervinpraison/tamilan-2-9b:
# Run inference directly in the terminal:
./build/bin/llama-cli -hf mervinpraison/tamilan-2-9b:
Use Docker 
docker model run hf.co/mervinpraison/tamilan-2-9b:
Quick Links

Tamilan 2 - 9B Advanced Tamil Large Language Model

Tamilan 2 is the latest version of the Tamil Large Language Model, designed to enhance understanding and generation of Tamil text.

Gemma 2, instruction fine tuned on Tamil Alpaca Dataset

Developed by: Mervin Praison

Download

Website: Tamilan 2

Key Features:

  1. Sizes:

    • 2B parameters
    • 9B parameters
    • 27B parameters

  2. Quantization Levels:

    • 4-bit
    • 8-bit
    • 16-bit

  3. Training Dataset:

  4. Applications:

    • Content creation
    • Customer support
    • Educational tools
    • Research

  5. Deployment:

    • Supports efficient deployment and fine-tuning for various tasks

Uploaded model

  • Developed by: mervinpraison
  • License: apache-2.0
  • Finetuned from model : unsloth/gemma-2-9b-bnb-4bit
Downloads last month
125
GGUF
Model size
9B params
Architecture
gemma2
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mervinpraison/tamilan-2-9b

Base model

google/gemma-2-9b
Quantized
unsloth/gemma-2-9b-bnb-4bit
Quantized
(140)
this model

Collection including mervinpraison/tamilan-2-9b