00534_functions_bad_arguments tests are flaky #50619
Description
It seems it's mostly related with MSAN (too slow? too many things at once?)
SELECT
check_name,
test_name,
toStartOfDay(check_start_time) as t,
count() as runs,
100 * (countIf(test_status != 'OK' AND test_status != 'SKIPPED') AS f) / runs as failure_percentage
FROM checks
WHERE
test_name LIKE '00534_functions_bad_arguments%'
AND pull_request_number = 0
AND check_start_time > today() - interval 30 day
GROUP BY check_name, test_name, t
HAVING f > 0
ORDER by check_name, test_name, t
| № | check_name | test_name | t | runs | failure_percentage |
|---|---|---|---|---|---|
| 1 | Stateless tests (msan) [3/6] | 00534_functions_bad_arguments12 | 2023-06-02 00:00:00 | 32 | 3.125 |
| 2 | Stateless tests (msan) [3/6] | 00534_functions_bad_arguments12 | 2023-06-05 00:00:00 | 33 | 24.242424242424242 |
| 3 | Stateless tests (msan) [3/6] | 00534_functions_bad_arguments4_long | 2023-06-05 00:00:00 | 33 | 15.151515151515152 |
| 4 | Stateless tests (msan) [4/6] | 00534_functions_bad_arguments10 | 2023-06-02 00:00:00 | 30 | 20 |
| 5 | Stateless tests (msan) [4/6] | 00534_functions_bad_arguments10 | 2023-06-03 00:00:00 | 9 | 11.11111111111111 |
| 6 | Stateless tests (msan) [4/6] | 00534_functions_bad_arguments5 | 2023-06-02 00:00:00 | 30 | 20 |
| 7 | Stateless tests (msan) [4/6] | 00534_functions_bad_arguments5 | 2023-06-03 00:00:00 | 9 | 11.11111111111111 |
| 8 | Stateless tests (msan) [4/6] | 00534_functions_bad_arguments6 | 2023-06-02 00:00:00 | 30 | 20 |
| 9 | Stateless tests (msan) [4/6] | 00534_functions_bad_arguments6 | 2023-06-03 00:00:00 | 9 | 11.11111111111111 |
| 10 | Stateless tests (msan) [4/6] | 00534_functions_bad_arguments9 | 2023-06-02 00:00:00 | 30 | 20 |
| 11 | Stateless tests (msan) [4/6] | 00534_functions_bad_arguments9 | 2023-06-03 00:00:00 | 9 | 11.11111111111111 |