GitHub - DannyMerkx/next_word_prediction: Pytorch implementation of next word prediction. Includes my own implementation of Google AI's Transformer architecture

DannyMerkx / next_word_prediction Public

Notifications You must be signed in to change notification settings
Fork 13
Star 27

Pytorch implementation of next word prediction. Includes my own implementation of Google AI's Transformer architecture

27 stars 13 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 40 Commits
analysis		analysis
data_preparation		data_preparation
functions		functions
language_modelling		language_modelling
readme.txt		readme.txt

Repository files navigation

Project aimed at comparing Transformers and RNNs as models of human sentence processing.

Please cite our CMCL paper if you use this work:

@inproceedings{Merkx2021HumanSP,
  title={Human Sentence Processing: Recurrence or Attention?},
  author={Danny Merkx and S. Frank},
  booktitle={CMCL},
  year={2021}
}