Skip to content

UBSan failure in DB::MergeTreeSink::consume() #33254

@Avogar

Description

@Avogar

Link: https://s3.amazonaws.com/clickhouse-test-reports/32455/d754b58a304977e250e0b2df703d7157bfae3697/stress_test__undefined__actions_.html
Stacktrace:

2021.12.28 11:20:34.509101 [ 226958 ] {} <Fatal> BaseDaemon: ########################################
2021.12.28 11:20:34.510040 [ 226958 ] {} <Fatal> BaseDaemon: (version 21.13.1.1464, build id: E952BD9814F96805) (from thread 1399) (query_id: ec6d06f6-d13c-45a5-8825-75fc2b044935) Received signal Unknown signal (-3)
2021.12.28 11:20:34.510604 [ 226958 ] {} <Fatal> BaseDaemon: Sanitizer trap.
2021.12.28 11:20:34.511100 [ 226958 ] {} <Fatal> BaseDaemon: Stack trace: 0xe1eceaa 0x1e154ad1 0xe1ad816 0xe1bf559 0x1ffd1160 0x206253b2 0x20578b50 0x2057873c 0x20577825 0x20235b19 0x202359a8 0x20227c81 0x20228f08 0x20228de3 0xe21de5a 0xe220862 0x7fb360920609 0x7fb360847293
2021.12.28 11:20:34.624972 [ 226958 ] {} <Fatal> BaseDaemon: 0.1. inlined from ./obj-x86_64-linux-gnu/../src/Common/StackTrace.cpp:305: StackTrace::tryCapture()
2021.12.28 11:20:34.626859 [ 226958 ] {} <Fatal> BaseDaemon: 0. ../src/Common/StackTrace.cpp:266: StackTrace::StackTrace() @ 0xe1eceaa in /usr/bin/clickhouse
2021.12.28 11:20:34.753841 [ 226958 ] {} <Fatal> BaseDaemon: 1. ./obj-x86_64-linux-gnu/../base/daemon/BaseDaemon.cpp:391: sanitizerDeathCallback() @ 0x1e154ad1 in /usr/bin/clickhouse
2021.12.28 11:20:36.610203 [ 226958 ] {} <Fatal> BaseDaemon: 2. __sanitizer::Die() @ 0xe1ad816 in /usr/bin/clickhouse
2021.12.28 11:20:39.568075 [ 226958 ] {} <Fatal> BaseDaemon: 3. ? @ 0xe1bf559 in /usr/bin/clickhouse
2021.12.28 11:20:39.578382 [ 226958 ] {} <Fatal> BaseDaemon: 4. ./obj-x86_64-linux-gnu/../src/Storages/MergeTree/MergeTreeSink.cpp:0: DB::MergeTreeSink::consume(DB::Chunk) @ 0x1ffd1160 in /usr/bin/clickhouse
2021.12.28 11:20:39.687120 [ 226958 ] {} <Fatal> BaseDaemon: 5.1. inlined from ./obj-x86_64-linux-gnu/../src/Processors/Chunk.h:32: ~Chunk
2021.12.28 11:20:39.700289 [ 226958 ] {} <Fatal> BaseDaemon: 5. ../src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x206253b2 in /usr/bin/clickhouse
2021.12.28 11:20:39.715975 [ 226958 ] {} <Fatal> BaseDaemon: 6.1. inlined from ./obj-x86_64-linux-gnu/../src/Processors/Chunk.h:32: ~Chunk
2021.12.28 11:20:39.717349 [ 226958 ] {} <Fatal> BaseDaemon: 6.2. inlined from ../src/Processors/Transforms/ExceptionKeepingTransform.cpp:151: operator()
2021.12.28 11:20:39.718538 [ 226958 ] {} <Fatal> BaseDaemon: 6. ../contrib/libcxx/include/type_traits:3676: decltype(std::__1::forward<DB::ExceptionKeepingTransform::work()::$_1&>(fp)()) std::__1::__invoke<DB::ExceptionKeepingTransform::work()::$_1&>(DB::ExceptionKeepingTransform::work()::$_1&) @ 0x20578b50 in /usr/bin/clickhouse
2021.12.28 11:20:39.738575 [ 226958 ] {} <Fatal> BaseDaemon: 7. ./obj-x86_64-linux-gnu/../src/Processors/Transforms/ExceptionKeepingTransform.cpp:103: DB::runStep(std::__1::function<void ()>, DB::ThreadStatus*, std::__1::atomic<unsigned long>*) @ 0x2057873c in /usr/bin/clickhouse
2021.12.28 11:20:39.750930 [ 226958 ] {} <Fatal> BaseDaemon: 8. ./obj-x86_64-linux-gnu/../src/Processors/Transforms/ExceptionKeepingTransform.cpp:0: DB::ExceptionKeepingTransform::work() @ 0x20577825 in /usr/bin/clickhouse
2021.12.28 11:20:39.760677 [ 226958 ] {} <Fatal> BaseDaemon: 9. ./obj-x86_64-linux-gnu/../src/Processors/Executors/ExecutionThreadContext.cpp:53: DB::executeJob(DB::IProcessor*) @ 0x20235b19 in /usr/bin/clickhouse
2021.12.28 11:20:39.767664 [ 226958 ] {} <Fatal> BaseDaemon: 10. ./obj-x86_64-linux-gnu/../src/Processors/Executors/ExecutionThreadContext.cpp:65: DB::ExecutionThreadContext::executeTask() @ 0x202359a8 in /usr/bin/clickhouse
2021.12.28 11:20:39.794021 [ 226958 ] {} <Fatal> BaseDaemon: 11. ./obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:213: DB::PipelineExecutor::executeStepImpl(unsigned long, std::__1::atomic<bool>*) @ 0x20227c81 in /usr/bin/clickhouse
2021.12.28 11:20:39.821887 [ 226958 ] {} <Fatal> BaseDaemon: 12.1. inlined from ./obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2851: std::__1::shared_ptr<DB::ThreadGroupStatus>::operator bool() const
2021.12.28 11:20:39.822444 [ 226958 ] {} <Fatal> BaseDaemon: 12.2. inlined from ../src/Processors/Executors/PipelineExecutor.cpp:304: operator()
2021.12.28 11:20:39.822881 [ 226958 ] {} <Fatal> BaseDaemon: 12.3. inlined from ../base/base/../base/scope_guard.h:94: basic_scope_guard<DB::PipelineExecutor::executeImpl(unsigned long)::$_1::operator()() const::'lambda'()>::invoke()
2021.12.28 11:20:39.824319 [ 226958 ] {} <Fatal> BaseDaemon: 12.4. inlined from ../base/base/../base/scope_guard.h:44: ~basic_scope_guard
2021.12.28 11:20:39.824745 [ 226958 ] {} <Fatal> BaseDaemon: 12.5. inlined from ../src/Processors/Executors/PipelineExecutor.cpp:319: operator()
2021.12.28 11:20:39.826838 [ 226958 ] {} <Fatal> BaseDaemon: 12. ../contrib/libcxx/include/type_traits:3682: decltype(std::__1::forward<DB::PipelineExecutor::executeImpl(unsigned long)::$_1&>(fp)()) std::__1::__invoke_constexpr<DB::PipelineExecutor::executeImpl(unsigned long)::$_1&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_1&) @ 0x20228f08 in /usr/bin/clickhouse
2021.12.28 11:20:39.854119 [ 226958 ] {} <Fatal> BaseDaemon: 13.1. inlined from ./obj-x86_64-linux-gnu/../contrib/libcxx/include/tuple:0: operator()
2021.12.28 11:20:39.862599 [ 226958 ] {} <Fatal> BaseDaemon: 13. ../contrib/libcxx/include/type_traits:3676: decltype(std::__1::forward<DB::PipelineExecutor::executeImpl(unsigned long)::$_1>(fp)()) std::__1::__invoke<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_1>(DB::PipelineExecutor::executeImpl(unsigned long)::$_1&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_1&&) @ 0x20228de3 in /usr/bin/clickhouse
2021.12.28 11:20:39.881559 [ 226958 ] {} <Fatal> BaseDaemon: 14.1. inlined from ./obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:2533: std::__1::function<void ()>::operator=(std::nullptr_t)
2021.12.28 11:20:39.883253 [ 226958 ] {} <Fatal> BaseDaemon: 14. ../src/Common/ThreadPool.cpp:277: ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe21de5a in /usr/bin/clickhouse
2021.12.28 11:20:39.906606 [ 226958 ] {} <Fatal> BaseDaemon: 15. ./obj-x86_64-linux-gnu/../src/Common/ThreadPool.cpp:0: void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda0'()> >(void*) @ 0xe220862 in /usr/bin/clickhouse
2021.12.28 11:20:39.907045 [ 226958 ] {} <Fatal> BaseDaemon: 16. ? @ 0x7fb360920609 in ?
2021.12.28 11:20:39.907768 [ 226958 ] {} <Fatal> BaseDaemon: 17. __clone @ 0x7fb360847293 in ?
2021.12.28 11:20:40.407873 [ 226958 ] {} <Fatal> BaseDaemon: Calculated checksum of the binary: DA1C2963F18386906E3743CAEEA4B546. There is no information about the reference checksum.

Query:

2021.12.28 11:20:29.605877 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Debug> executeQuery: (from [::1]:38412) (comment: '00168_parallel_processing_on_replicas_part_1.sh') CREATE MATERIALIZED VIEW test.basic_00040 ENGINE = AggregatingMergeTree(StartDate, (CounterID, StartDate), 8192) POPULATE AS SELECT CounterID, StartDate, sumState(Sign) AS Visits, uniqState(UserID) AS Users FROM test.dist_visits GROUP BY CounterID, StartDate;
2021.12.28 11:20:29.730106 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ContextAccess (default): Access granted: CREATE VIEW ON test.basic_00040
2021.12.28 11:20:29.815689 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ContextAccess (default): Access granted: SELECT(CounterID, StartDate, Sign, UserID) ON test.dist_visits
2021.12.28 11:20:29.962365 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Debug> test.`.inner_id.ddda8da2-eb7f-46bc-9dda-8da2eb7fd6bc` (b10c2ef5-0483-43c7-b10c-2ef5048373c7): Loading data parts
2021.12.28 11:20:29.968479 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Debug> test.`.inner_id.ddda8da2-eb7f-46bc-9dda-8da2eb7fd6bc` (b10c2ef5-0483-43c7-b10c-2ef5048373c7): There are no data parts
2021.12.28 11:20:29.986942 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ContextAccess (default): Access granted: INSERT(CounterID, StartDate, Visits, Users) ON test.basic_00040
2021.12.28 11:20:30.024710 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ContextAccess (default): Access granted: SELECT(CounterID, StartDate, Sign, UserID) ON test.dist_visits
2021.12.28 11:20:30.101948 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ContextAccess (default): Access granted: SELECT(CounterID, StartDate, Sign, UserID) ON test.dist_visits
2021.12.28 11:20:30.111974 [ 1218 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> InterpreterSelectQuery: WithMergeableState -> Complete
2021.12.28 11:20:30.151356 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Debug> Connection (127.0.0.2:9000): Sent data for 2 scalars, total 2 rows in 6.2092e-05 sec., 31705 rows/sec., 68.00 B (1.03 MiB/sec.), compressed 0.4594594594594595 times to 148.00 B (2.23 MiB/sec.)
2021.12.28 11:20:30.151464 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Debug> Connection (127.0.0.1:9000): Sent data for 2 scalars, total 2 rows in 4.7941e-05 sec., 40748 rows/sec., 23.52 KiB (467.57 MiB/sec.), no compression.
2021.12.28 11:20:30.151626 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Debug> Connection (127.0.0.3:9000): Sent data for 2 scalars, total 2 rows in 5.8456e-05 sec., 33723 rows/sec., 68.00 B (1.09 MiB/sec.), compressed 0.4594594594594595 times to 148.00 B (2.38 MiB/sec.)
2021.12.28 11:20:30.167839 [ 32613 ] {2c5f2408-06f7-495c-89cd-4694625b3433} <Debug> executeQuery: (from [::ffff:127.0.0.1]:33454, initial_query_id: ec6d06f6-d13c-45a5-8825-75fc2b044935) (comment: '00168_parallel_processing_on_replicas_part_1.sh') SELECT `CounterID`, `StartDate`, sumState(`Sign`) AS `Visits`, uniqState(`UserID`) AS `Users` FROM `test`.`visits` GROUP BY `CounterID`, `StartDate`
2021.12.28 11:20:30.168169 [ 11396 ] {0c5e8d09-e124-4091-bb98-5ea4d5d52350} <Debug> executeQuery: (from [::ffff:127.0.0.1]:55934, initial_query_id: ec6d06f6-d13c-45a5-8825-75fc2b044935) (comment: '00168_parallel_processing_on_replicas_part_1.sh') SELECT `CounterID`, `StartDate`, sumState(`Sign`) AS `Visits`, uniqState(`UserID`) AS `Users` FROM `test`.`visits` GROUP BY `CounterID`, `StartDate`
2021.12.28 11:20:30.185033 [ 1330 ] {30d3f724-2dd3-4639-b21b-d389eb64b3d5} <Debug> executeQuery: (from [::ffff:127.0.0.1]:50870, initial_query_id: ec6d06f6-d13c-45a5-8825-75fc2b044935) (comment: '00168_parallel_processing_on_replicas_part_1.sh') SELECT `CounterID`, `StartDate`, sumState(`Sign`) AS `Visits`, uniqState(`UserID`) AS `Users` FROM `test`.`visits` GROUP BY `CounterID`, `StartDate`
2021.12.28 11:20:30.317004 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 136893ns
2021.12.28 11:20:30.317457 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 532991ns
2021.12.28 11:20:30.317748 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 221913ns
2021.12.28 11:20:30.318014 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 213985ns
2021.12.28 11:20:30.318315 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 226569ns
2021.12.28 11:20:30.318608 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 247833ns
2021.12.28 11:20:30.318902 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 213848ns
2021.12.28 11:20:30.319164 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 207067ns
2021.12.28 11:20:30.319462 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 187118ns
2021.12.28 11:20:30.319779 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 248709ns
2021.12.28 11:20:30.320056 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 211493ns
2021.12.28 11:20:30.320611 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 465099ns
2021.12.28 11:20:30.320915 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 224212ns
2021.12.28 11:20:30.321174 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 206049ns
2021.12.28 11:20:30.321460 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 188034ns
2021.12.28 11:20:30.321752 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 193970ns
2021.12.28 11:20:30.322022 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 172547ns
2021.12.28 11:20:30.322309 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 193264ns
2021.12.28 11:20:30.322595 [ 1149 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 234967ns
2021.12.28 11:20:30.459718 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 99499ns
2021.12.28 11:20:30.470595 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 124021ns
2021.12.28 11:20:30.471114 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 62825ns
2021.12.28 11:20:30.471601 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 70786ns
2021.12.28 11:20:30.482260 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 416859ns
2021.12.28 11:20:30.482894 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 10537417ns
2021.12.28 11:20:30.483697 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 84455ns
2021.12.28 11:20:30.484335 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 97772ns
2021.12.28 11:20:30.485549 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 71881ns
2021.12.28 11:20:30.487509 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 70508ns
2021.12.28 11:20:30.488096 [ 35675 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> ParallelReplicasReadingCoordinator: Time for handling request: 67435ns
2021.12.28 11:20:31.161114 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> Aggregator: Merging partially aggregated blocks (bucket = -1).
2021.12.28 11:20:31.638560 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Debug> Aggregator: Merged partially aggregated blocks. 239132 rows, 5.02 MiB. in 0.477001306 sec. (501323.575 rows/sec., 10.52 MiB/sec.)
2021.12.28 11:20:31.641556 [ 1399 ] {ec6d06f6-d13c-45a5-8825-75fc2b044935} <Trace> Aggregator: Destroying aggregate states

Metadata

Metadata

Assignees

No one assigned

    Labels

    fuzzProblem found by one of the fuzzers

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions