LLM Note

llm base model

google/gemma_pytorch
https://github.com/google/gemma_pytorch
OpenBMB/MiniCPM
https://github.com/OpenBMB/MiniCPM
meta-llama/llama-recipes
https://github.com/meta-llama/llama-recipes
THUDM/GLM-4
https://github.com/THUDM/GLM-4

llm model tutorial

mlabonne/llm-course
https://github.com/mlabonne/llm-course
yuanzhoulvpi2017/zero_nlp
https://github.com/yuanzhoulvpi2017/zero_nlp
NielsRogge/Transformers-Tutorials
https://github.com/NielsRogge/Transformers-Tutorials
InternLM/Tutorial
https://github.com/InternLM/Tutorial

RAG

infiniflow/ragflow
https://github.com/infiniflow/ragflow
Filimoa/open-parse
https://github.com/Filimoa/open-parse

Attetion

microsoft/Samba
https://github.com/microsoft/Samba

Long text

jzhang38/EasyContext
https://github.com/jzhang38/EasyContext
xianbaoqian/ChunkLlama
https://github.com/xianbaoqian/ChunkLlama

llm from scratch

karpathy/minbpe
https://github.com/karpathy/minbpe
karpathy/LLM101n
https://github.com/karpathy/LLM101n
naklecha/llama3-from-scratch
从零实现一个llama3英文版
https://github.com/naklecha/llama3-from-scratch
wdndev/llama3-from-scratch-zh
从零实现一个llama3中文版
https://github.com/wdndev/llama3-from-scratch-zh
rasbt/LLMs-from-scratch
https://github.com/rasbt/LLMs-from-scratch
charent/Phi2-mini-Chinese
https://github.com/charent/Phi2-mini-Chinese
charent/ChatLM-mini-Chinese
https://github.com/charent/ChatLM-mini-Chinese

MOE

Mixture-of-Agents
https://github.com/togethercomputer/MoA

RL-LLM(Monte Carlo Tree)

trotsky1997/MathBlackBox
https://github.com/trotsky1997/MathBlackBox
XinyuanWangCS/PromptAgent
https://github.com/XinyuanWangCS/PromptAgent
MARIO-Math-Reasoning/Super_MARIO
https://github.com/MARIO-Math-Reasoning/Super_MARIO