Backport of internal/daemon/controller+worker: propagate downstream timeout into release/0.17.x

Backport of internal/daemon/controller+worker: propagate downstream timeout into release/0.17.x #5238