Using adapters in a multimodal model

[loukasilias]

Hello,

I have a model with text and images as inputs
I pass the text through BERT and images through Vision Transformers and train the multimodal model.
Is it possible to add adapter to BERT and train the multimodal model in the same way (as I train it without adapter / without changing the code of training).

Thank you.
Loukas

[calpt]

Duplicate of #635.