AttributeError: 'RobertaModel' object has no attribute 'layer_idx'

[calpt]

Discussed in #628

^{Originally posted by tangshiyi341914 January 5, 2024}
Hello,

I am a student of computer science and I am working on AdapterDrop.

When I ran the Adapter_Drop_Training.ipynb step by step,I got an error:

transformers/trainer.py:1860, in Trainer._inner_training_loop(self, batch_size, args, resume_from_checkpoint, trial, ignore_keys_for_eval)
self.control = self.callback_handler.on_step_begin(args, self.state, self.control)
with self.accelerator.accumulate(model):
tr_loss_step = self.training_step(model, inputs)
if (
args.logging_nan_inf_filter
and not is_torch_tpu_available()

and (torch.isnan(tr_loss_step) or torch.isinf(tr_loss_step))

...
if name in modules:
return modules[name]
raise AttributeError(f"'{type(self).name}' object has no attribute '{name}'")
AttributeError: 'RobertaModel' object has no attribute 'layer_idx'

I don't know how to solve it,could you help me？