Cs to stable 24 3 #9268

zverevgeny · 2024-09-15T19:03:31Z

No description provided.

Conflicts: ydb/core/tx/columnshard/normalizer/abstract/abstract.h

This reverts commit ccf98e2.

Conflicts: ydb/core/tx/columnshard/engines/changes/compaction/merger.cpp ydb/core/tx/columnshard/engines/scheme/versions/abstract_scheme.cpp

Co-authored-by: Ivan Morozov <ivanmorozov@localhost.localdomain> Conflicts in canondata re-canonized

Conflicts: ydb/core/tx/columnshard/engines/changes/compaction/abstract/merger.cpp

…ipy (ydb-platform#7272)

…rm#7423) Conflicts: .github/config/muted_ya.txt

Conflicts: ydb/library/yql/sql/v1/sql_ut.cpp

Conflicts: ydb/core/protos/feature_flags.proto ydb/core/testlib/basics/feature_flags.h

Conflicts: ydb/core/tx/columnshard/normalizer/abstract/abstract.h

Conflicts: .github/config/muted_ya.txt

…ydb-platform#9002) Conflicts: ydb/core/protos/feature_flags.proto

github-actions · 2024-09-15T19:06:26Z

⚪ 2024-09-15 19:06:26 UTC Pre-commit check for 539b8c3 has started.
⚪ 2024-09-15 19:09:29 UTC Build linux-x86_64-release-clang14 is running...
🔴 2024-09-15 19:09:44 UTC Build failed. see the build logs.

github-actions · 2024-09-15T19:06:41Z

⚪ 2024-09-15 19:06:41 UTC Pre-commit check for 539b8c3 has started.
⚪ 2024-09-15 19:09:41 UTC Build linux-x86_64-release-asan is running...
🔴 2024-09-15 19:09:55 UTC Build failed. see the build logs.
🔴 2024-09-15 19:09:57 UTC Tests run skipped.

github-actions · 2024-09-15T19:07:05Z

⚪ 2024-09-15 19:07:04 UTC Pre-commit check for 539b8c3 has started.
⚪ 2024-09-15 19:10:09 UTC Build linux-x86_64-relwithdebinfo is running...
🔴 2024-09-15 19:10:23 UTC Build failed. see the build logs.
🔴 2024-09-15 19:10:25 UTC Tests run skipped.

github-actions · 2024-09-15T19:33:05Z

⚪ 2024-09-15 19:33:04 UTC Pre-commit check for 8efafda has started.
⚪ 2024-09-15 19:36:10 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-09-15 20:15:49 UTC Build successful.

github-actions · 2024-09-15T19:33:37Z

⚪ 2024-09-15 19:33:37 UTC Pre-commit check for 8efafda has started.
⚪ 2024-09-15 19:36:42 UTC Build linux-x86_64-release-asan is running...
🟢 2024-09-15 20:21:21 UTC Build successful.
⚪ 2024-09-15 20:21:36 UTC Tests are running...
🔴 2024-09-15 22:27:02 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15171	15053	0	27	50	41

github-actions · 2024-09-15T19:35:46Z

⚪ 2024-09-15 19:35:46 UTC Pre-commit check for 8efafda has started.
⚪ 2024-09-15 19:38:56 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-09-15 20:47:54 UTC Build successful.
⚪ 2024-09-15 20:48:08 UTC Tests are running...
🔴 2024-09-15 23:00:21 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
76330	62857	0	15	13421	37

🔴 2024-09-15 23:01:26 UTC ydbd size 8.2 GiB changed* by +33.0 MiB, which is >= 2.0 MiB vs stable-24-3-9-cs: Alert

ydbd size dash	stable-24-3-9-cs: `c3583fc`	merge: `8efafda`	diff	diff %
ydbd size	8 761 168 152 Bytes	8 795 766 384 Bytes	+33.0 MiB	+0.395%
ydbd stripped size	479 010 568 Bytes	479 894 024 Bytes	+862.8 KiB	+0.184%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

Co-authored-by: Semyon <yentsovsemyon@ydb.tech> Co-authored-by: ivanmorozov333 <ivanmorozov@ydb.tech> Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com> Co-authored-by: Artem Alekseev <fexolm@ydb.tech> Co-authored-by: Alexander Avdonkin <aavdonkin@yandex.ru> Co-authored-by: Nikita Vasilev <ns-vasilev@ydb.tech> Co-authored-by: Vladislav Gogov <vlad-gogov@ydb.tech> Conflicts: ydb/core/kqp/compute_actor/kqp_compute_actor.cpp ydb/core/kqp/compute_actor/kqp_compute_actor.h ydb/core/kqp/compute_actor/kqp_compute_actor_factory.h ydb/core/kqp/compute_actor/kqp_compute_events.h ydb/core/kqp/compute_actor/kqp_scan_compute_actor.cpp ydb/core/kqp/compute_actor/kqp_scan_compute_actor.h ydb/core/kqp/compute_actor/kqp_scan_fetcher_actor.cpp ydb/core/kqp/compute_actor/kqp_scan_fetcher_actor.h ydb/core/kqp/executer_actor/kqp_data_executer.cpp ydb/core/kqp/executer_actor/kqp_planner.cpp ydb/core/kqp/executer_actor/kqp_planner.h ydb/core/kqp/node_service/kqp_node_service.cpp ydb/core/kqp/ut/common/kqp_ut_common.cpp ydb/core/kqp/ut/olap/clickbench_ut.cpp ydb/core/kqp/ut/olap/kqp_olap_ut.cpp ydb/core/kqp/ut/tx/kqp_sink_common.h ydb/core/kqp/ut/tx/kqp_sink_locks_ut.cpp ydb/core/kqp/ut/tx/kqp_sink_mvcc_ut.cpp ydb/core/kqp/ut/tx/kqp_sink_tx_ut.cpp ydb/core/protos/feature_flags.proto ydb/core/protos/kqp.proto ydb/core/testlib/basics/feature_flags.h ydb/core/tx/columnshard/engines/scheme/index_info.cpp ydb/core/tx/columnshard/splitter/chunks.h ydb/library/yql/sql/v1/sql_ut.cpp ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-12 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-14 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-15 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-16 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-17 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-21 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-30 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-31 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-32 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-33 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-34 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-36 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-37 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-38 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-41 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-7

Co-authored-by: Semyon <yentsovsemyon@ydb.tech> Co-authored-by: ivanmorozov333 <ivanmorozov@ydb.tech> Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com> Co-authored-by: Artem Alekseev <fexolm@ydb.tech> Co-authored-by: Alexander Avdonkin <aavdonkin@yandex.ru> Co-authored-by: Nikita Vasilev <ns-vasilev@ydb.tech> Co-authored-by: Vladislav Gogov <vlad-gogov@ydb.tech> Conflicts: ydb/core/kqp/compute_actor/kqp_compute_actor.cpp ydb/core/kqp/compute_actor/kqp_compute_actor.h ydb/core/kqp/compute_actor/kqp_compute_actor_factory.h ydb/core/kqp/compute_actor/kqp_compute_events.h ydb/core/kqp/compute_actor/kqp_scan_compute_actor.cpp ydb/core/kqp/compute_actor/kqp_scan_compute_actor.h ydb/core/kqp/compute_actor/kqp_scan_fetcher_actor.cpp ydb/core/kqp/compute_actor/kqp_scan_fetcher_actor.h ydb/core/kqp/executer_actor/kqp_data_executer.cpp ydb/core/kqp/executer_actor/kqp_planner.cpp ydb/core/kqp/executer_actor/kqp_planner.h ydb/core/kqp/node_service/kqp_node_service.cpp ydb/core/kqp/ut/common/kqp_ut_common.cpp ydb/core/kqp/ut/olap/clickbench_ut.cpp ydb/core/kqp/ut/olap/kqp_olap_ut.cpp ydb/core/kqp/ut/tx/kqp_sink_common.h ydb/core/kqp/ut/tx/kqp_sink_locks_ut.cpp ydb/core/kqp/ut/tx/kqp_sink_mvcc_ut.cpp ydb/core/kqp/ut/tx/kqp_sink_tx_ut.cpp ydb/core/protos/feature_flags.proto ydb/core/protos/kqp.proto ydb/core/testlib/basics/feature_flags.h ydb/core/tx/columnshard/engines/scheme/index_info.cpp ydb/core/tx/columnshard/splitter/chunks.h ydb/library/yql/sql/v1/sql_ut.cpp ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-12 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-14 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-15 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-16 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-17 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-21 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-30 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-31 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-32 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-33 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-34 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-36 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-37 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-38 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-41 ydb/tests/functional/clickbench/canondata/test.test_plans_column_/queries-original-plan-column-7 Fix tx tests (ydb-platform#8945) (ydb-platform#9284) Co-authored-by: Nikita Vasilev <ns-vasilev@ydb.tech> fix tests

Co-authored-by: Semyon <yentsovsemyon@ydb.tech> Co-authored-by: ivanmorozov333 <ivanmorozov@ydb.tech> Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com> Co-authored-by: Artem Alekseev <fexolm@ydb.tech> Co-authored-by: Alexander Avdonkin <aavdonkin@yandex.ru> Co-authored-by: Nikita Vasilev <ns-vasilev@ydb.tech> Co-authored-by: Vladislav Gogov <vlad-gogov@ydb.tech>

zverevgeny and others added 30 commits September 15, 2024 07:01

Turn on GCCountersNormalizer (ydb-platform#8166)

f7f06ef

Conflicts: ydb/core/tx/columnshard/normalizer/abstract/abstract.h

Revert "Ignore stored GCBarrierPreparation (ydb-platform#7473)"

2ad4a75

This reverts commit ccf98e2.

delete unused ISSTransactionOperator (ydb-platform#6908)

ee1e9a5

Fix flaky KqpOlapScheme.DropTable (ydb-platform#6795)

20cce76

increase CS read timeout (ydb-platform#6963)

7f84ced

add stats test for internal column table from tables store (ydb-platf…

2d473d5

…orm#6684)

implement sparse data accessor (ydb-platform#7055)

3282d3c

Conflicts: ydb/core/tx/columnshard/engines/changes/compaction/merger.cpp ydb/core/tx/columnshard/engines/scheme/versions/abstract_scheme.cpp

additional test and addressing fixes (ydb-platform#7168)

e7b4620

tx operations start unification (ydb-platform#7178)

a7fdd7c

asymmetric access for sorted key on find position (ydb-platform#7177)

e489c11

improve performace for stat requests (sysview) (ydb-platform#7211)

f6e6f5f

speed up merging with correct pointers operation (ydb-platform#7230)

0472dd5

speed up tables manager in schemeshard (ydb-platform#7229)

332a1d0

fix pk checker (ydb-platform#7266)

c66255f

correct not null flags usage in tests (ydb-platform#7293)

298fd8d

signals for tablet initialization (ydb-platform#7281)

a654a12

fix unused

326e728

[KIKIMR-21472] Output the final AST in explain query (ydb-platform#6487)

c84ed2c

switch on aggregations pushdown into CS (ydb-platform#7305)

4b75c4c

Co-authored-by: Ivan Morozov <ivanmorozov@localhost.localdomain> Conflicts in canondata re-canonized

fix columns normalization for absent (ydb-platform#7340)

01105b5

Conflicts: ydb/core/tx/columnshard/engines/changes/compaction/abstract/merger.cpp

Move new flag to env from config for compatibility with musty arc rec…

b31b2a8

…ipy (ydb-platform#7272)

add missing table stats for column shards (ydb-platform#7140)

120d53b

fix clickbench with CS (ydb-platform#7393)

fddf95e

move test TShardReader to a common place (ydb-platform#7441)

fa088bc

Overlimit read memory (ydb-platform#7408)

e8dd09e

make local internal CS persistent snapshot pinger (ydb-platform#7431)

0b9c841

Blob memory interval limit (ydb-platform#7444)

7fd01cf

Fix KqpOlapAggregations.Aggregation_ResultCountAll_Filter (ydb-platfo…

1c2191f

…rm#7423) Conflicts: .github/config/muted_ya.txt

add tx progress counters (ydb-platform#7407)

6ac00b5

add missing monitoring metrics for column shards (ydb-platform#7314)

b0b32a0

ivanmorozov333 and others added 13 commits September 15, 2024 17:38

speed up column ids checkers and finder (ydb-platform#8906)

ac39ecc

Add PARTITIONS_COUNT setting to yql (ydb-platform#7602)

829626e

Implemented limit on olap table columnt count (ydb-platform#8742)

a37654b

skip long tx writing to in control locks (ydb-platform#8924)

a417462

Fix PARTITION_COUNT option name and add tests (ydb-platform#9012)

cc39e87

Conflicts: ydb/library/yql/sql/v1/sql_ut.cpp

Add feature flag: enable olap compression (ydb-platform#8726)

fad182f

Conflicts: ydb/core/protos/feature_flags.proto ydb/core/testlib/basics/feature_flags.h

Normalizer insert records (ydb-platform#9010)

5e70546

Conflicts: ydb/core/tx/columnshard/normalizer/abstract/abstract.h

correct EvWrite locks processing (ydb-platform#8931)

7b7094b

Add decimal tests for columnshard (ydb-platform#8959)

4f8fa3d

Conflicts: .github/config/muted_ya.txt

Disable CTAS by default (ydb-platform#9057)

e9a63fe

speed up logging exp (ydb-platform#9087)

7f6818a

Sparsed columns are disabled by default and can be optionally enabled (…

55aac64

…ydb-platform#9002) Conflicts: ydb/core/protos/feature_flags.proto

speed up scan initialization (ydb-platform#9086)

f0f7681

remove dep to count_min_sketch from ut

f58e2d5

zverevgeny marked this pull request as ready for review September 16, 2024 04:00

zverevgeny requested a review from a team as a code owner September 16, 2024 04:00

fomichev3000 approved these changes Sep 16, 2024

View reviewed changes

zverevgeny merged commit 43977d4 into ydb-platform:stable-24-3-9-cs Sep 16, 2024
8 of 12 checks passed

zverevgeny linked an issue Oct 15, 2024 that may be closed by this pull request

Integrate latest changes in CS into stable branch #9271

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cs to stable 24 3 #9268

Cs to stable 24 3 #9268

zverevgeny commented Sep 15, 2024

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

Cs to stable 24 3 #9268

Cs to stable 24 3 #9268

Conversation

zverevgeny commented Sep 15, 2024

github-actions bot commented Sep 15, 2024 • edited Loading

github-actions bot commented Sep 15, 2024 • edited Loading

github-actions bot commented Sep 15, 2024 • edited Loading

github-actions bot commented Sep 15, 2024 • edited Loading

github-actions bot commented Sep 15, 2024 • edited Loading

github-actions bot commented Sep 15, 2024 • edited Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading

github-actions bot commented Sep 15, 2024 •

edited

Loading