[Backport 2.7] Fix the release build by only applying the Maven publish task to our actual Java artifacts

[Backport 2.7] Fix the release build by only applying the Maven publish task to our actual Java artifacts #1864