Practical course about Large Language Models.

[SIGIR'24] The official implementation code of MOELoRA.

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"

CRE-LLM: A Domain-Specific Chinese Relation Extraction Framework with Fine-tuned Large Language Model

Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

Official code implemtation of paper AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

PEFT is a wonderful tool that enables training a very large model in a low resource environment. Quantization and PEFT will enable widespread adoption of LLM.

[ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference

Fine-tune StarCoder2-3b for SQL tasks on limited resources with LORA. LORA reduces model size for faster training on smaller datasets. StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The Stack v2 and some natural language text such as Wikipedia, Arxiv, and GitHub issues.

High Quality Image Generation Model - Powered with NVIDIA A100

My lab work of “Generative AI with Large Language Models” course offered by DeepLearning.AI and Amazon Web Services on coursera.

practical projects using LLM, VLM and Diffusion models

NTU Deep Learning for Computer Vision 2023 course

Fine Tuning pegasus and flan-t5 pre-trained language model on dialogsum datasets for conversation summarization to to optimize context window in RAG-LLMs

This repo contains implementations of fine-tuning LLaMA LLM model using LoRA weights (PEFT) as well as focuses on the Retrieval Augmented Generation (RAG) framework.

The transformation of education starts here! Where AI and educational robotics come together to provide the best learning experience.

A fine-tuned LLM great at answering questions about car repairs and maintenance.