[Backport 1.6.latest] Combine build verification jobs to avoid needing to upload and download artifacts (#1461)

[Backport 1.6.latest] Combine build verification jobs to avoid needing to upload and download artifacts (#1461) #1418