[Bug]: Kafka integration test log spam #1800
Description
Related Template(s)
N/A
Template Version
N/A
What happened?
Java PR Action has long been flaky, at least in the past it clearly shows which tests failed. However, recently the test log size has increased substantially, likely due to Kafka template and test development. Now the log is of > 80 MB.
A majority of the log reads
2024-08-19T15:39:29.6622952Z [kafka-producer-network-thread | producer-7] INFO org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-7] Node 1 disconnected.
2024-08-19T15:39:29.6626237Z [kafka-producer-network-thread | producer-7] WARN org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-7] Connection to node 1 (/10.128.0.40:57609) could not be established. Node may not be available.
2024-08-19T15:39:29.6629592Z [kafka-admin-client-thread | adminclient-3] INFO org.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-3] Node 1 disconnected.
2024-08-19T15:39:29.6633503Z [kafka-admin-client-thread | adminclient-3] WARN org.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-3] Connection to node 1 (/10.128.0.40:57609) could not be established. Node may not be available.
and
2024-08-19T13:31:21.7130918Z [docker-java-stream--996043679] INFO org.apache.beam.it.testcontainers.TestContainerResourceManager - confluentinc/cp-kafka:7.3.1: [2024-08-19 13:23:47,251] INFO [Broker id=1] Handling LeaderAndIsr request correlationId 1 from controller 1 for 5 partitions (state.change.logger)
2024-08-19T13:31:21.7133326Z
2024-08-19T13:31:21.7143323Z [docker-java-stream--996043679] INFO org.apache.beam.it.testcontainers.TestContainerResourceManager - confluentinc/cp-kafka:7.3.1: [2024-08-19 13:23:47,253] TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='testkafkatogcsbinaryencoding-20240819-132347-044185', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], partitionEpoch=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true, leaderRecoveryState=0) correlation id 1 from controller 1 epoch 1 (state.change.logger)
Relevant log output
No response