ccl/changefeedccl: TestChangefeedEachColumnFamilySchemaChanges failed

[cockroach-teamcity]

ccl/changefeedccl.TestChangefeedEachColumnFamilySchemaChanges failed on release-24.2 @ 8fd5bb201dbb7699d3c6231f52214b9d1884b314:

test logs left over in: outputs.zip/logTestChangefeedEachColumnFamilySchemaChanges3492941826
--- FAIL: TestChangefeedEachColumnFamilySchemaChanges (16.58s)
=== RUN   TestChangefeedEachColumnFamilySchemaChanges/sinkless
    helpers_test.go:869: making server as secondary tenant
    helpers_test.go:948: making sinkless feed factory
    helpers_test.go:1013: pgURL sinkless SinklessFeedUser
    helpers_test.go:1013: pgURL sinkless root
    testfeed_test.go:270: sinkless feed creating changefeed: CREATE CHANGEFEED FOR foo WITH split_column_families
    changefeed_test.go:3261: 
        	Error Trace:	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:197
        	            				github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:272
        	            				github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/changefeed_test.go:3261
        	            				github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1120
        	            				github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1155
        	Error:      	Received unexpected error:
        	            	expected message
        	            	(1) assertion failure
        	            	Wraps: (2) attached stack trace
        	            	  -- stack trace:
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.readNextMessages
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:117
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.assertPayloadsBaseErr
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:208
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.assertPayloadsBase.func1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:200
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.withTimeout.func1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:265
        	            	  | github.com/cockroachdb/cockroach/pkg/util/timeutil.RunWithTimeout
        	            	  | 	github.com/cockroachdb/cockroach/pkg/util/timeutil/timeout.go:28
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.withTimeout
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:261
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.assertPayloadsBase
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:198
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.assertPayloads
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:272
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.TestChangefeedEachColumnFamilySchemaChanges.func1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/changefeed_test.go:3261
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.cdcTestNamed.func1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1120
        	            	  | github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl.cdcTestNamedWithSystem.func1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/ccl/changefeedccl/helpers_test.go:1155
        	            	  | testing.tRunner
        	            	  | 	GOROOT/src/testing/testing.go:1689
        	            	  | runtime.goexit
        	            	  | 	src/runtime/asm_amd64.s:1695
        	            	Wraps: (3) expected message
        	            	Error types: (1) *assert.withAssertionFailure (2) *withstack.withStack (3) *errutil.leafError
        	Test:       	TestChangefeedEachColumnFamilySchemaChanges/sinkless
    testfeed_test.go:277: closing sinkless feed
    --- FAIL: TestChangefeedEachColumnFamilySchemaChanges/sinkless (16.57s)

Parameters:

• attempt=1
• race=true
• run=2
• shard=5

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

• ccl/changefeedccl: TestChangefeedEachColumnFamilySchemaChanges failed #140669 ccl/changefeedccl: TestChangefeedEachColumnFamilySchemaChanges failed [A-cdc C-bug C-test-failure O-robot P-2 T-cdc branch-release-25.1.0-rc target-release-25.2.0]

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!

Jira issue: CRDB-48131

[andyyang890]

Appears to be a duplicate of #140669.

I250226 10:57:54.462850 26473 ccl/changefeedccl/changefeed_stmt.go:357 ⋮ [T10,Vcluster-10,nsql1,client=127.0.0.1:50220,hostssl,user=‹sinklessfeeduser›] 404  core changefeed completed with no error