Topics in NLP and LLMs

In this repo I will share different topics on anything I want to know in nlp and llms

Topics :

• PEFT (Parameter-Efficient Fine-Tuning)
  • LoRA
  • QLoRA

• Quantization

• Byte Pair Encoding (BPE).

• Relative positional embedding vs Absolute positional embedding.

---

Related Repositories

LLMs from Scratch FineTuning Large Language Models

---

📞 Contact :