-
Notifications
You must be signed in to change notification settings - Fork 8.3k
Flaky test: 03780_failed_ssh #94687
Copy link
Copy link
Closed
Labels
flaky testflaky test found by CIflaky test found by CItestingSpecial issue with list of bugs found by CISpecial issue with list of bugs found by CI
Description
Important: This issue was automatically generated and is used by CI for matching failures. DO NOT modify the body content. DO NOT remove labels.
Test name: 03780_failed_ssh
Failure reason: return code
CI report: Stateless tests (amd_tsan, parallel)
Failing test history: cidb
Test output:
2026-01-20 13:19:46 Reason: return code: 1
2026-01-20 13:19:46 expect: spawn id exp8 not open
2026-01-20 13:19:46 while executing
2026-01-20 13:19:46 "expect "Code: 516. *""
2026-01-20 13:19:46 (file "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/03780_failed_ssh.expect" line 50)
2026-01-20 13:19:46
2026-01-20 13:19:46 /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/test_fd3zsi4n/03780_failed_ssh.expect.debuglog:
2026-01-20 13:19:46 + [2026-01-20 13:19:46] [:1] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_fd3zsi4n --log_comment 03780_failed_ssh.expect-test_fd3zsi4n --max_insert_threads 3 --group_by_two_level_threshold 24379 --group_by_two_level_threshold_bytes 40666195 --distributed_aggregation_memory_efficient 0 --fsync_metadata 0 --output_format_parallel_formatting 0 --input_format_parallel_parsing 0 --min_chunk_bytes_for_parallel_parsing 13527038 --max_read_buffer_size 746843 --prefer_localhost_replica 1 --max_block_size 88293 --max_joined_block_size_rows 85119 --joined_block_split_single_row 1 --join_output_by_rowlist_perkey_rows_threshold 0 --max_threads 3 --optimize_append_index 1 --use_hedged_requests 0 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 1 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 0 --read_in_order_two_level_merge_threshold 61 --optimize_aggregation_in_order 0 --aggregation_in_order_max_block_bytes 6410726 --use_uncompressed_cache 0 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 1 --local_filesystem_read_method read --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 1 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 1 --remote_filesystem_read_prefetch 1 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 64Mi --filesystem_prefetches_limit 10 --filesystem_prefetch_min_bytes_for_single_read_task 16Mi --filesystem_prefetch_step_marks 0 --filesystem_prefetch_step_bytes 100Mi --compile_expressions 0 --compile_aggregate_expressions 0 --compile_sort_description 1 --merge_tree_coarse_index_granularity 26 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 1065663857 --min_compress_block_size 675995 --max_compress_block_size 567293 --merge_tree_compact_parts_min_granules_to_multibuffer_read 16 --optimize_sorting_by_input_stream_properties 0 --http_response_buffer_size 6427757 --http_wait_end_of_query False --enable_memory_bound_merging_of_aggregation_results 1 --min_count_to_compile_expression 3 --min_count_to_compile_aggregate_expression 3 --min_count_to_compile_sort_description 3 --session_timezone America/Hermosillo --use_page_cache_for_disks_without_file_cache True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.56 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 100000000 --cross_join_min_bytes_to_compress 0 --min_external_table_block_size_bytes 1 --max_parsing_threads 0 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 0 --query_plan_join_swap_table false --enable_vertical_final 1 --optimize_extract_common_expressions 1 --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 1 --use_skip_indexes_on_data_read 1 --optimize_rewrite_like_perfect_affix 1 --input_format_parquet_use_native_reader_v3 1 --enable_lazy_columns_replication 1 --allow_special_serialization_kinds_in_output_formats 1 --short_circuit_function_evaluation_for_nulls_threshold 0.306505189399675 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 955032 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_sort 1346511667 --max_bytes_before_external_group_by 0 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 1 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 0.4211354487246518 --prefer_fetch_merged_part_size_threshold 10737418240 --vertical_merge_algorithm_min_rows_to_activate 74254 --vertical_merge_algorithm_min_columns_to_activate 100 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4385396 --merge_max_block_size 15576 --index_granularity 33971 --min_bytes_for_wide_part 0 --marks_compress_block_size 30182 --primary_key_compress_block_size 37669 --replace_long_file_name_to_hash 1 --max_file_name_length 0 --min_bytes_for_full_part_storage 0 --compact_parts_max_bytes_to_buffer 158264505 --compact_parts_max_granules_to_buffer 1 --compact_parts_merge_max_bytes_to_prefetch_part 10463001 --cache_populated_by_fetch 0 --concurrent_part_removal_threshold 76 --old_parts_lifetime 467 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v2 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts advanced --object_shared_data_buckets_for_compact_part 15 --object_shared_data_buckets_for_wide_part 23 --dynamic_serialization_version v3 --auto_statistics_types countmin,uniq,minmax --serialization_info_version basic --string_serialization_version with_size_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 1 --min_columns_to_activate_adaptive_write_buffer 318 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/03780_failed_ssh.stderr-fatal --disable_suggestion --no-warnings --enable-progress-table-toggle 0 --progress no --output-format-pretty-color 0 --highlight 0 --ssh-key-file id_rsa_03780_test_fd3zsi4n --user user_03780_test_fd3zsi4n
2026-01-20 13:19:46
2026-01-20 13:19:46 �[0J�[?25hClickHouse client version 26.1.1.695.
2026-01-20 13:19:46 Enter your SSH private key passphrase (leave empty for no passphrase):
2026-01-20 13:19:46 expect: does "\r\u001b[0J\u001b[?25hClickHouse client version 26.1.1.695.\r\nEnter your SSH private key passphrase (leave empty for no passphrase): " (spawn_id exp8) match glob pattern "Enter your SSH private key passphrase (leave empty for no passphrase): "? yes
2026-01-20 13:19:46 expect: set expect_out(0,string) "Enter your SSH private key passphrase (leave empty for no passphrase): "
2026-01-20 13:19:46 expect: set expect_out(spawn_id) "exp8"
2026-01-20 13:19:46 expect: set expect_out(buffer) "\r\u001b[0J\u001b[?25hClickHouse client version 26.1.1.695.\r\nEnter your SSH private key passphrase (leave empty for no passphrase): "
2026-01-20 13:19:46 send: sending "\r" to { exp8 }
2026-01-20 13:19:46
2026-01-20 13:19:46 expect: does "" (spawn_id exp8) match glob pattern "Connecting to * as user user_03780_*."? no
2026-01-20 13:19:46
2026-01-20 13:19:46
2026-01-20 13:19:46 expect: does "\r\n" (spawn_id exp8) match glob pattern "Connecting to * as user user_03780_*."? no
2026-01-20 13:19:46 Connecting to database test_fd3zsi4n at localhost:9000 as user user_03780_test_fd3zsi4n.
2026-01-20 13:19:46 Code: 516. DB::Exception: Received from localhost:9000. DB::Exception: Expected authentication with SSH key. (AUTHENTICATION_FAILED)
2026-01-20 13:19:46
2026-01-20 13:19:46
2026-01-20 13:19:46 expect: does "\r\nConnecting to database test_fd3zsi4n at localhost:9000 as user user_03780_test_fd3zsi4n.\r\nCode: 516. DB::Exception: Received from localhost:9000. DB::Exception: Expected authentication with SSH key. (AUTHENTICATION_FAILED)\r\n\r\n" (spawn_id exp8) match glob pattern "Connecting to * as user user_03780_*."? yes
2026-01-20 13:19:46 expect: set expect_out(0,string) "Connecting to database test_fd3zsi4n at localhost:9000 as user user_03780_test_fd3zsi4n.\r\nCode: 516. DB::Exception: Received from localhost:9000. DB::Exception: Expected authentication with SSH key."
2026-01-20 13:19:46 expect: set expect_out(spawn_id) "exp8"
2026-01-20 13:19:46 expect: set expect_out(buffer) "\r\nConnecting to database test_fd3zsi4n at localhost:9000 as user user_03780_test_fd3zsi4n.\r\nCode: 516. DB::Exception: Received from localhost:9000. DB::Exception: Expected authentication with SSH key."
2026-01-20 13:19:46
2026-01-20 13:19:46 expect: does " (AUTHENTICATION_FAILED)\r\n\r\n" (spawn_id exp8) match glob pattern "Code: 516. *"? no
2026-01-20 13:19:46 expect: read eof
2026-01-20 13:19:46 expect: set expect_out(spawn_id) "exp8"
2026-01-20 13:19:46 expect: set expect_out(buffer) " (AUTHENTICATION_FAILED)\r\n\r\n"
2026-01-20 13:19:46 expect: continuing expect after update
2026-01-20 13:19:46 expect: spawn id exp8 not open
2026-01-20 13:19:46 while executing
2026-01-20 13:19:46 "expect "Code: 516. *""
2026-01-20 13:19:46 (file "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/03780_failed_ssh.expect" line 50)
2026-01-20 13:19:46 , result:
2026-01-20 13:19:46
2026-01-20 13:19:46
2026-01-20 13:19:46
2026-01-20 13:19:46 stdout:
2026-01-20 13:19:46
2026-01-20 13:19:46
2026-01-20 13:19:46 Settings used in the test: --max_insert_threads 3 --group_by_two_level_threshold 24379 --group_by_two_level_threshold_bytes 40666195 --distributed_aggregation_memory_efficient 0 --fsync_metadata 0 --output_format_parallel_formatting 0 --input_format_parallel_parsing 0 --min_chunk_bytes_for_parallel_parsing 13527038 --max_read_buffer_size 746843 --prefer_localhost_replica 1 --max_block_size 88293 --max_joined_block_size_rows 85119 --joined_block_split_single_row 1 --join_output_by_rowlist_perkey_rows_threshold 0 --max_threads 3 --optimize_append_index 1 --use_hedged_requests 0 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 1 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 0 --read_in_order_two_level_merge_threshold 61 --optimize_aggregation_in_order 0 --aggregation_in_order_max_block_bytes 6410726 --use_uncompressed_cache 0 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 1 --local_filesystem_read_method read --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 1 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 1 --remote_filesystem_read_prefetch 1 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 64Mi --filesystem_prefetches_limit 10 --filesystem_prefetch_min_bytes_for_single_read_task 16Mi --filesystem_prefetch_step_marks 0 --filesystem_prefetch_step_bytes 100Mi --compile_expressions 0 --compile_aggregate_expressions 0 --compile_sort_description 1 --merge_tree_coarse_index_granularity 26 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 1065663857 --min_compress_block_size 675995 --max_compress_block_size 567293 --merge_tree_compact_parts_min_granules_to_multibuffer_read 16 --optimize_sorting_by_input_stream_properties 0 --http_response_buffer_size 6427757 --http_wait_end_of_query False --enable_memory_bound_merging_of_aggregation_results 1 --min_count_to_compile_expression 3 --min_count_to_compile_aggregate_expression 3 --min_count_to_compile_sort_description 3 --session_timezone America/Hermosillo --use_page_cache_for_disks_without_file_cache True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.56 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 100000000 --cross_join_min_bytes_to_compress 0 --min_external_table_block_size_bytes 1 --max_parsing_threads 0 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 0 --query_plan_join_swap_table false --enable_vertical_final 1 --optimize_extract_common_expressions 1 --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 1 --use_skip_indexes_on_data_read 1 --optimize_rewrite_like_perfect_affix 1 --input_format_parquet_use_native_reader_v3 1 --enable_lazy_columns_replication 1 --allow_special_serialization_kinds_in_output_formats 1 --short_circuit_function_evaluation_for_nulls_threshold 0.306505189399675 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 955032 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_sort 1346511667 --max_bytes_before_external_group_by 0 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 1
2026-01-20 13:19:46
2026-01-20 13:19:46 MergeTree settings used in test: --ratio_of_defaults_for_sparse_serialization 0.4211354487246518 --prefer_fetch_merged_part_size_threshold 10737418240 --vertical_merge_algorithm_min_rows_to_activate 74254 --vertical_merge_algorithm_min_columns_to_activate 100 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4385396 --merge_max_block_size 15576 --index_granularity 33971 --min_bytes_for_wide_part 0 --marks_compress_block_size 30182 --primary_key_compress_block_size 37669 --replace_long_file_name_to_hash 1 --max_file_name_length 0 --min_bytes_for_full_part_storage 0 --compact_parts_max_bytes_to_buffer 158264505 --compact_parts_max_granules_to_buffer 1 --compact_parts_merge_max_bytes_to_prefetch_part 10463001 --cache_populated_by_fetch 0 --concurrent_part_removal_threshold 76 --old_parts_lifetime 467 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v2 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts advanced --object_shared_data_buckets_for_compact_part 15 --object_shared_data_buckets_for_wide_part 23 --dynamic_serialization_version v3 --auto_statistics_types countmin,uniq,minmax --serialization_info_version basic --string_serialization_version with_size_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 1 --min_columns_to_activate_adaptive_write_buffer 318
2026-01-20 13:19:46
~~~~~ truncated 1 lines ~~~~~
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
flaky testflaky test found by CIflaky test found by CItestingSpecial issue with list of bugs found by CISpecial issue with list of bugs found by CI