Adapter layers in BART

[J4nn4]

Hello,

I have a question regarding integration of adapters in models like BART which consist of encoder and decoder components.
Are the adapter layers inserted in the BART model both in the encoder and decoder or only in the encoder?

Thanks!

[julianpollmann]

Hey,

each transformer block of the encoder and decoder contains a AdapterLayer. For facebook/bart-base 6 adapter layers for the encoder and 6 for the decoder are added.

See the MAD-X paper.

[adapter-hub-bert]

This issue has been automatically marked as stale because it has been without activity for 90 days. This issue will be closed in 14 days unless you comment or remove the stale label.