Skip to content

RuanPetrus/tiny-transformer-cuda

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Tiny-Transformer-Cuda

Cuda implementation of transformers

Layers

Only forward layers are implemented for now.

The following layers were implemented:

  • Matmul forward
  • Gelu forward
  • Feed forward layer forward
  • Softmax forward
  • CrossEntropyLoss forward
  • Layernorm forward
  • Encoder forward
  • FlashAttention 2 forward

About

Cuda implementation of a transformer

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published