longnet

Here are 4 public repositories matching this topic...

kyegomez / zeta

Build high-performance AI models with modular building blocks

multi-platform deep-learning transformers pytorch artificial-intelligence transformer speech-recognition multi-modal multi-agent-systems multi-modal-learning gpt4 llama2 longnet

Updated Jan 13, 2025
Python

hkproj / python-longnet

Star

Tools and experiments with the LongNet model

python pytorch attention-mechanism attention-is-all-you-need longnet

Updated Jul 15, 2023
Jupyter Notebook

mylonasc / longnet_dilated_attention

Star

An implementation of (something like) the LongNet dilated attention paper

transformers pytorch attention dilated longnet

Updated Sep 18, 2023
Python

AlinaBaber / Implementation-of-the-LongNet-Scaling-Transformers-to-1-000-000-000-Tokens

Star

implementation of the paper LongNet: Scaling Transformers to 1,000,000,000 Tokens by Jiayu Ding, Shuming Ma, Li Dong, Xingxing Zhang, Shaohan Huang, Wenhui Wang, and Furu Wei.

ai ml transformers deepspeed llms generative-ai longnet

Updated Aug 12, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the longnet topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the longnet topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

longnet

Here are 4 public repositories matching this topic...

kyegomez / zeta

hkproj / python-longnet

mylonasc / longnet_dilated_attention

AlinaBaber / Implementation-of-the-LongNet-Scaling-Transformers-to-1-000-000-000-Tokens

Improve this page

Add this topic to your repo