Skip to content

data-race in librdkafka (rd_kafka_toppar_leader_update vs rd_kafka_broker_fetch_toppars) #87654

@azat

Description

@azat
E             Write of size 4 at 0x726400b906b0 by thread T1105 (mutexes: write M0, write M1, write M2):
E               #0 rd_kafka_toppar_leader_update ci/tmp/build/./contrib/librdkafka/src/rdkafka_topic.c:719:33 (clickhouse+0x278de893) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #1 rd_kafka_topic_metadata_update ci/tmp/build/./contrib/librdkafka/src/rdkafka_topic.c:1393:21 (clickhouse+0x278de893)
E               #2 rd_kafka_topic_metadata_update2 ci/tmp/build/./contrib/librdkafka/src/rdkafka_topic.c:1476:13 (clickhouse+0x278e1315) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #3 rd_kafka_parse_Metadata_update_topic ci/tmp/build/./contrib/librdkafka/src/rdkafka_metadata.c:379:17 (clickhouse+0x277f3f09) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #4 rd_kafka_parse_Metadata0 ci/tmp/build/./contrib/librdkafka/src/rdkafka_metadata.c:839:17 (clickhouse+0x277e6a5b) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #5 rd_kafka_parse_Metadata ci/tmp/build/./contrib/librdkafka/src/rdkafka_metadata.c:1111:16 (clickhouse+0x277e1906) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #6 rd_kafka_handle_Metadata ci/tmp/build/./contrib/librdkafka/src/rdkafka_request.c:2590:15 (clickhouse+0x278a91c9) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #7 rd_kafka_buf_callback ci/tmp/build/./contrib/librdkafka/src/rdkafka_buf.c:515:17 (clickhouse+0x27788ab4) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #8 rd_kafka_buf_handle_op ci/tmp/build/./contrib/librdkafka/src/rdkafka_buf.c:458:9 (clickhouse+0x277898da) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #9 rd_kafka_op_handle_std ci/tmp/build/./contrib/librdkafka/src/rdkafka_op.c:912:17 (clickhouse+0x27867efc) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #10 rd_kafka_op_handle ci/tmp/build/./contrib/librdkafka/src/rdkafka_op.c:952:15 (clickhouse+0x27867efc)
E               #11 rd_kafka_q_serve ci/tmp/build/./contrib/librdkafka/src/rdkafka_queue.c:578:23 (clickhouse+0x2787a1a1) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #12 rd_kafka_thread_main ci/tmp/build/./contrib/librdkafka/src/rdkafka.c:2155:17 (clickhouse+0x2778e630) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #13 _thrd_wrapper_function ci/tmp/build/./contrib/librdkafka/src/tinycthread.c:576:9 (clickhouse+0x278f5abb) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E           
E             Previous read of size 4 at 0x726400b906b0 by thread T1107:
E               #0 rd_kafka_broker_fetch_toppars ci/tmp/build/./contrib/librdkafka/src/rdkafka_fetcher.c:1109:35 (clickhouse+0x277cd9e8) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #1 rd_kafka_broker_consumer_serve ci/tmp/build/./contrib/librdkafka/src/rdkafka_broker.c:4354:33 (clickhouse+0x2777dbb7) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #2 rd_kafka_broker_serve ci/tmp/build/./contrib/librdkafka/src/rdkafka_broker.c:4515:17 (clickhouse+0x2777dbb7)
E               #3 rd_kafka_broker_thread_main ci/tmp/build/./contrib/librdkafka/src/rdkafka_broker.c:4715:25 (clickhouse+0x27776dcb) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)
E               #4 _thrd_wrapper_function ci/tmp/build/./contrib/librdkafka/src/tinycthread.c:576:9 (clickhouse+0x278f5abb) (BuildId: bfff9390278dcd674398d2dcf9478ffe6e3478ec)

CI: https://s3.amazonaws.com/clickhouse-test-reports/json.html?PR=87584&sha=e1464e87807b4e09159c70abcf65cb979259946e&name_0=PR&name_1=Integration%20tests%20%28amd_tsan%2C%202%2F6%29

Metadata

Metadata

Labels

comp-message-queuesMessage queue integrations (Kafka, RabbitMQ, NATS table engines for stream ingestion/egress).sanitizer

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions