Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ColumnShard crashes node on query with huge LIMIT clause #9490

Open
abyss7 opened this issue Sep 19, 2024 · 1 comment
Open

ColumnShard crashes node on query with huge LIMIT clause #9490

abyss7 opened this issue Sep 19, 2024 · 1 comment
Assignees
Labels
bug/crash ydbd process crashed

Comments

@abyss7
Copy link
Collaborator

abyss7 commented Sep 19, 2024

Running query on TPCH-1000 table with data:

PRAGMA ydb.EnableSpillingNodes='None';

SELECT * FROM `column/tpch1000/lineitem` LIMIT 400000000;

All nodes immediately crash with error:

VERIFY failed (2024-09-19T12:35:50.512495+0300): SelfId=[50001:7416285602234175114:5685];TabletId=72075186224038375;ScanId=3;TxId=281475073160771;Sca>
  ydb/library/actors/core/log.cpp:748
  ~TVerifyFormattedRecordWriter(): requirement false failed
 0. /ydb/util/system/yassert.cpp:83: NPrivate::InternalPanicImpl(int, char const*, char const*, int, int, int, TBasicStringBuf<char,>
 1. /ydb/util/system/yassert.cpp:55: NPrivate::Panic(NPrivate::TStaticBuf const&, int, char const*, char const*, char const*, ...) @>
 2. /ydb/ydb/library/actors/core/log.cpp:748: NActors::TVerifyFormattedRecordWriter::~TVerifyFormattedRecordWriter() @ 0x1C5497D4
 3. /ydb/ydb/core/tx/columnshard/engines/reader/plain_reader/iterator/scanner.cpp:304: NKikimr::NOlap::NReader::NPlain::TScanHead::A>
 4. /ydb/ydb/core/tx/columnshard/engines/reader/plain_reader/iterator/scanner.cpp:103: NKikimr::NOlap::NReader::NPlain::TScanHead::S>
 5. /ydb/ydb/core/tx/columnshard/engines/reader/plain_reader/iterator/plain_read_data.h:21: NKikimr::NOlap::NReader::NPlain::TPlainR>
 6. /ydb/ydb/core/tx/columnshard/engines/reader/abstract/read_context.h:136: NKikimr::NOlap::NReader::IDataReader::Start() @ 0x245DC>
 7. /ydb/ydb/core/tx/columnshard/engines/reader/plain_reader/iterator/iterator.h:71: NKikimr::NOlap::NReader::NPlain::TColumnShardSc>
 8. /ydb/ydb/core/tx/columnshard/engines/reader/actor/actor.cpp:84: NKikimr::NOlap::NReader::TColumnShardScan::Bootstrap(NActors::TA>
 9. /ydb/ydb/library/actors/core/actor_bootstrapped.h:23: NActors::TActorBootstrapped<NKikimr::NOlap::NReader::TColumnShardScan>::St>
10. /ydb/ydb/library/actors/core/executor_thread.cpp:251: NActors::TGenericExecutorThread::TProcessingResult NActors::TGenericExecu>
11. /ydb/ydb/library/actors/core/executor_thread.cpp:440: NActors::TGenericExecutorThread::ProcessExecutorPool(NActors::IExecutorPo>
12. /ydb/ydb/library/actors/core/executor_thread.cpp:493: NActors::TGenericExecutorThread::ProcessExecutorPool(NActors::IExecutorPo>
13. /ydb/ydb/library/actors/core/executor_thread.cpp:524: NActors::TExecutorThread::ThreadProc() @ 0x1C522DA6
14. /ydb/util/system/thread.cpp:244: (anonymous namespace)::TPosixThread::ThreadProxy(void*) @ 0x1B775649
15. ??:0: ?? @ 0x7F7D3DAA1608
16. ??:0: ?? @ 0x7F7D3D9C1352

Also logs may contain:

TX_COLUMNSHARD_SCAN ERROR: SelfId=[50003:7414169473942880340:5650];TabletId=72075186224038357;ScanId=12;TxId=281475070870736;ScanGen=1;fline=scanner.cpp:101;event=scanner_initializer_aborted;reason=We need a lot of memory in time for interval scanner: 3961841905 path_id: #016. We need wait compaction processing. Sorry.;
@abyss7 abyss7 added the bug/crash ydbd process crashed label Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug/crash ydbd process crashed
Projects
None yet
Development

No branches or pull requests

4 participants
@abyss7 @ivanmorozov333 @zverevgeny and others