dot-product-attention

Here are 7 public repositories matching this topic...

sooftware / attentions

PyTorch implementation of some attentions for Deep Learning Researchers.

pytorch attention multi-head-attention location-sensitive-attension dot-product-attention location-aware-attention additive-attention relative-positional-encoding relative-multi-head-attention

Updated Mar 4, 2022
Python

mtanghu / LEAP

Star

LEAP: Linear Explainable Attention in Parallel for causal language modeling with O(1) path length, and O(1) inference

deep-learning parallel transformers pytorch transformer rnn attention-mechanism softmax local-attention dot-product-attention additive-attention linear-attention

Updated Jun 18, 2023
Jupyter Notebook

bulatkh / image_captioning

Star

Master Project on Image Captioning using Supervised Deep Learning Methods

tensorflow keras recurrent-neural-networks vgg image-captioning attention-mechanisms bahdanau-attention beam-search-decoder dot-product-attention encoder-decoder-framework

Updated Nov 22, 2022
Jupyter Notebook

AndreiMoraru123 / Neural-Machine-Translation

Star

Modern Eager TensorFlow implementation of Attention Is All You Need

Updated Oct 7, 2024
Python

kkiningh / tf-attention-example

Star

Simple example of how to do dot-product attention in TensorFlow

tensorflow attention dot-product-attention

Updated Jul 7, 2018
Python

whsqkaak / attentions_pytorch

Star

A repository for implementations of attention mechanism by PyTorch.

pytorch attention attention-mechanism multihead-attention dot-product-attention scaled-dot-product-attention

Updated Aug 1, 2022
Python

dcarpintero / transformer101

Star

Annotated vanilla implementation in PyTorch of the Transformer model introduced in 'Attention Is All You Need'.

pytorch feedforward-neural-network softmax transfomer attention-is-all-you-need multihead-attention self-attention gelu dot-product-attention encoder-decoder-architecture positional-encoding linear-layers dropout-layers normalization-layers

Updated Feb 19, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the dot-product-attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the dot-product-attention topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

dot-product-attention

Here are 7 public repositories matching this topic...

sooftware / attentions

mtanghu / LEAP

bulatkh / image_captioning

AndreiMoraru123 / Neural-Machine-Translation

kkiningh / tf-attention-example

whsqkaak / attentions_pytorch

dcarpintero / transformer101

Improve this page

Add this topic to your repo