Skip to content
#

infinigpt

Star

Here is 1 public repository matching this topic...

ArionDas / InfiniGPT

Star 3

This is an unofficial Pytorch implementation of the Infini Attention mechanism introduced in the paper : "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention". Note that the official code for the paper has not been released yet. In case of issues, add a PR (add an explanation of the changes made and why so?)

research pytorch transformer attention-mechanism llms infini-attention infini-transformer infinigpt
  • Updated Sep 8, 2024
  • Python

Improve this page

Add a description, image, and links to the infinigpt topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the infinigpt topic, visit your repo's landing page and select "manage topics."

Learn more