test(server): Fix flakiness in TestServer_ReloadWorkerTags #8831

Job	Run time
set-product-version	10s
generate-metadata-file	34s
product-metadata	17s
Go 1.21.1 darwin amd64 build	12m 31s
Go 1.21.1 linux arm build	14m 19s
Go 1.21.1 darwin arm64 build	8m 51s
verify-product-metadata	4s
Go 1.21.1 linux arm64 build	9m 16s
Go 1.21.1 freebsd 386 build	9m 13s
Go 1.21.1 linux 386 build	10m 49s
Go 1.21.1 freebsd amd64 build	5m 44s
Go 1.21.1 linux amd64 build	12m 48s
Go 1.21.1 freebsd arm build	8m 9s
Go 1.21.1 windows 386 build	8m 15s
Go 1.21.1 windows amd64 build	9m 8s
Go 1.21.1 netbsd 386 build	4m 49s
Go 1.21.1 netbsd amd64 build	10m 37s
Go 1.21.1 netbsd arm build	5m 16s
Go 1.21.1 openbsd 386 build	8m 14s
Go 1.21.1 openbsd amd64 build	8m 42s
Go 1.21.1 openbsd arm build	8m 7s
Go 1.21.1 solaris amd64 build	8m 28s
Docker arm build	2m 32s
Docker arm64 build	2m 23s
Docker 386 build	2m 58s
Docker amd64 build	2m 48s
bats / CLI tests	6m 31s
Enos / setup	50s
Enos / Integration (e2e_aws builder:crt)	13m 43s
Enos / Integration (e2e_database)	4m 45s
Enos / Integration (e2e_docker_base builder:crt)	10m 22s
Enos / Integration (e2e_docker_base_with_vault builder:crt)	3m 53s
Enos / Integration (e2e_docker_base_with_postgres builder:crt)	2m 54s
Enos / Integration (e2e_docker_base_with_worker builder:crt)	3m 6s
	3h 41m 6s

Provide feedback