The MHRoberta is Mental Health Roberta model. The pretrained Roberta transformer based model fine-tunned on Mental Health dataset by adopting PEFT method.
adapter transformer feedforward-neural-network lora mental-health self-attention roberta bert-model positional-encoding huggingface-transformers roberta-model huggingface-datasets roberta-tokenizer large-language-model llm-finetuning freezing-layer peft-fine-tuning-llm
-
Updated
May 23, 2025 - Jupyter Notebook