#

scaled-dot-product

Here are 2 public repositories matching this topic...

gazelle93 / Attention-Various-Positional-Encoding

This project aims to implement the Scaled-Dot-Product Attention layer and the Multi-Head Attention layer using various Positional Encoding methods.

nlp natural-language-processing pytorch spacy nltk gensim attention-mechanism wordembeddings multi-head-attention t5 relative-positional-encoding scaled-dot-product relative-positional-representation

Updated Jun 27, 2022
Python

burcgokden / SDPA-Transformer-Wrapper

A framework for training and evaluating a transformer with scaled dot product attention on a tensorflow dataset.

nlp deep-learning neural-network tensorflow machine-translation embeddings transformer attention nmt smt tensorflow-datasets tensorflow-text natural-langugage-processing scaled-dot-product

Updated Jul 19, 2021
Python

Improve this page

Add a description, image, and links to the scaled-dot-product topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the scaled-dot-product topic, visit your repo's landing page and select "manage topics."