roachtest: c2c/shutdown/src/coordinator failed

[cockroach-teamcity]

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.c2c/shutdown/src/coordinator failed with artifacts on master @ c44b3134d23d6037e1d5d5e12461a6914aa588e3:

(assertions.go:363).Fail: 
	Error Trace:	pkg/cmd/roachtest/tests/cluster_to_cluster.go:824
	            				pkg/cmd/roachtest/tests/cluster_to_cluster.go:1088
	            				pkg/cmd/roachtest/tests/cluster_to_cluster.go:1707
	            				pkg/cmd/roachtest/monitor.go:115
	            				external/org_golang_x_sync/errgroup/errgroup.go:78
	            				src/runtime/asm_amd64.s:1700
	Error:      	Received unexpected error:
	            	monitor failure: EOF [owner=test-eng]
	            	(1) attached stack trace
	            	  -- stack trace:
	            	  | main.(*monitorImpl).WaitE
	            	  | 	pkg/cmd/roachtest/monitor.go:137
	            	  | [...repeated from below...]
	            	Wraps: (2) monitor failure
	            	Wraps: (3) attached stack trace
	            	  -- stack trace:
	            	  | main.(*monitorImpl).wait
	            	  | 	pkg/cmd/roachtest/monitor.go:232
	            	  | main.(*monitorImpl).WaitE
	            	  | 	pkg/cmd/roachtest/monitor.go:137
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*replicationDriver).compareTenantFingerprintsAtTimestamp
	            	  | 	pkg/cmd/roachtest/tests/cluster_to_cluster.go:824
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*replicationDriver).main
	            	  | 	pkg/cmd/roachtest/tests/cluster_to_cluster.go:1088
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerClusterReplicationResilience.func1.3
	            	  | 	pkg/cmd/roachtest/tests/cluster_to_cluster.go:1707
	            	  | main.(*monitorImpl).Go.func1
	            	  | 	pkg/cmd/roachtest/monitor.go:115
	            	  | golang.org/x/sync/errgroup.(*Group).Go.func1
	            	  | 	external/org_golang_x_sync/errgroup/errgroup.go:78
	            	  | runtime.goexit
	            	  | 	src/runtime/asm_amd64.s:1700
	            	Wraps: (4) EOF [owner=test-eng]
	            	    └─ Wraps: (5) EOF [owner=test-eng]
	            	      └─ Wraps: (6) EOF
	            	Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *join.joinError (5) registry.ErrorWithOwnership (6) *errors.errorString
	Test:       	c2c/shutdown/src/coordinator
(require.go:1357).NoError: FailNow called
(monitor.go:149).Wait: monitor failure: monitor user task failed: t.Fatal() was called
test artifacts and logs in: /artifacts/c2c/shutdown/src/coordinator/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=true
• metamorphicBufferedSender=true
• metamorphicLeases=default
• runtimeAssertionsBuild=true
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/shutdown/src/coordinator failed #137328 roachtest: c2c/shutdown/src/coordinator failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-3 T-disaster-recovery branch-release-24.2]

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-48128