Merlina-ORPO-12B

This is the same training run as schneewolflabs/A0l-12B but with a custom ORPO implementation and beta=0.1.

image/png

Downloads last month
23
Safetensors
Model size
12B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for nbeerbower/Merlina-ORPO-12B

Dataset used to train nbeerbower/Merlina-ORPO-12B