antonio-f / GPT_from_scratch Public

Notifications You must be signed in to change notification settings
Fork 2
Star 4

Very simple implementation of GPT architecture using PyTorch and Jupyter.

4 stars 2 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
GPT_from_scratch.ipynb		GPT_from_scratch.ipynb
README.md		README.md
block.png		block.png
input.txt		input.txt

Repository files navigation

GPT from scratch

Very simple implementation of GPT architecture.

Based on A. Karpathy's code. Needs just PyTorch and Jupyter.

About

Very simple implementation of GPT architecture using PyTorch and Jupyter.

python tutorial simple jupyter-notebook pytorch transformer easy-to-use gpt newbie from-scratch noob-friendly bigram-model multihead-attention self-attention triangular-matrix

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%