Code

Implement ROPE positional encodings#450

Code

Open

devinbot wants to merge 3 commits intokarpathy:masterkarpathy/nanoGPT:masterfrom devinbot:devin/ropedevinbot/nanoGPT:devin/ropeCopy head branch name to clipboard

+29-3

Commits

Commits on Mar 7, 2024

• Adjust dataset path in train.py and remove verbose print statements from model.py

  

  Ubuntu

  committed
  6290941

  Copy full SHA for 6290941

• Add ROPE positional encoding implementation

  

  Ubuntu

  committed
  4a89061

  Copy full SHA for 4a89061

Commits on Mar 8, 2024

• Remove model_backup.py and roformer directory

  

  Ubuntu

  committed
  749410f

  Copy full SHA for 749410f