Training Code

[vgoklani]

Are you planning to release the training and model files?

Thanks!

[macabdul9]

Hi @vgoklani,

All trained models are available here: https://huggingface.co/MBZUAI. For code, currently, we are a little occupied with training and evaluating more models but one can use Standford's Alpaca to train models on LaMini Instructions as we are following the same. For more details please look into our paper: https://arxiv.org/abs/2304.14402

Thanks again.

[haiduo]

Hi @vgoklani,

All trained models are available here: https://huggingface.co/MBZUAI. For code, currently, we are a little occupied with training and evaluating more models but one can use Standford's Alpaca to train models on LaMini Instructions as we are following the same. For more details please look into our paper: https://arxiv.org/abs/2304.14402

Thanks again.

Hello, could you please provide the code for distilling the student model from the teacher model? How is sequence-level distillation done here?