We need to hold on to deleted items for a while in order to give all devices a chance to sync the deletions and remove the local copies of these items. After a while however, we could clean these up and remove them from the server entirely.
At the moment, we don't do this and so deleted items persist (E2E encrypted) on the server until the Sync account itself is deleted.