Perceiver IO in Flax

[manifest]

Hey all,

I've just published Flax implementation of the Perceiver IO model and all its building blocks as linen modules. The implementation is highly customizable meaning almost any submodule may be easily configured or replaced with a different type.

Examples include:

• Classification model pretrained on images from ImageNet.
• Masked-language model pretrained using a large text corpus obtained by combining English Wikipedia and C4.
• Autoencoder model pretrained on multimodal input audio, video, and label of the Kinetics-700-2020 dataset.

All the models use pre-trained parameters of the original DeepMind's models.