Since this outbound dial plugin is using the custom1 voice channel, it's separate from the native voice channel. Can the task channel be amended to not allow inbound calls when on an outbound call?
https://www.twilio.com/docs/flex/task-channel-definition-api
Or possibly put the Worker in the Busy state whilst on the outbound call and back to Available when the call ends?