Skip to content

Fix replica online timing issue in failover test#1044

Merged
enjoy-binbin merged 1 commit into
valkey-io:unstablefrom
enjoy-binbin:fix_failover_timing_issue
Sep 23, 2024
Merged

Fix replica online timing issue in failover test#1044
enjoy-binbin merged 1 commit into
valkey-io:unstablefrom
enjoy-binbin:fix_failover_timing_issue

Conversation

@enjoy-binbin

Copy link
Copy Markdown
Member

Ci reported this failure:

[exception]: Executing test client: ERR FAILOVER target replica is not online..
ERR FAILOVER target replica is not online.
    while executing
"$node_0 failover to $node_1_host $node_1_port"

We can see somehow the replica is not online in time and
casuing this failure, added a verify_replica_online to make
sure the replica is online for the test.

Ci reported this failure:
```
[exception]: Executing test client: ERR FAILOVER target replica is not online..
ERR FAILOVER target replica is not online.
    while executing
"$node_0 failover to $node_1_host $node_1_port"
```

We can see somehow the replica is not online in time and
casuing this failure, added a verify_replica_online to make
sure the replica is online for the test.

Signed-off-by: Binbin <binloveplay1314@qq.com>
Comment thread tests/integration/failover.tcl
@enjoy-binbin

Copy link
Copy Markdown
Member Author

@codecov

codecov Bot commented Sep 18, 2024

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.61%. Comparing base (ba71c7e) to head (afdf871).
Report is 17 commits behind head on unstable.

Additional details and impacted files
@@             Coverage Diff              @@
##           unstable    #1044      +/-   ##
============================================
- Coverage     70.62%   70.61%   -0.02%     
============================================
  Files           114      114              
  Lines         61672    61672              
============================================
- Hits          43555    43548       -7     
- Misses        18117    18124       +7     

see 9 files with indirect coverage changes

@enjoy-binbin enjoy-binbin merged commit 6ce75cd into valkey-io:unstable Sep 23, 2024
@enjoy-binbin enjoy-binbin deleted the fix_failover_timing_issue branch September 23, 2024 09:35
@enjoy-binbin enjoy-binbin added the test-failure An issue indicating a test failure label Sep 26, 2024
naglera pushed a commit to naglera/placeholderkv that referenced this pull request Oct 10, 2024
Ci reported this failure:
```
[exception]: Executing test client: ERR FAILOVER target replica is not online..
ERR FAILOVER target replica is not online.
    while executing
"$node_0 failover to $node_1_host $node_1_port"
```

We can see somehow the replica is not online in time and
casuing this failure, added a verify_replica_online to make
sure the replica is online for the test.

Signed-off-by: Binbin <binloveplay1314@qq.com>
Signed-off-by: naglera <anagler123@gmail.com>
sarthakaggarwal97 added a commit to sarthakaggarwal97/valkey that referenced this pull request Apr 16, 2026
Cherry-pick of 6ce75cd from unstable.
Adds verify_replica_online after wait_for_sync to prevent
'ERR FAILOVER target replica is not online' race condition.

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
sarthakaggarwal97 added a commit to sarthakaggarwal97/valkey that referenced this pull request Apr 16, 2026
Cherry-pick of 6ce75cd from unstable.

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
sarthakaggarwal97 added a commit to sarthakaggarwal97/valkey that referenced this pull request Apr 27, 2026
Cherry-pick of 6ce75cd from unstable.
Adds verify_replica_online after wait_for_sync to prevent
'ERR FAILOVER target replica is not online' race condition.

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
(cherry picked from commit ccb12ca)
sarthakaggarwal97 added a commit to sarthakaggarwal97/valkey that referenced this pull request Apr 27, 2026
Cherry-pick of 6ce75cd from unstable.

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
(cherry picked from commit 2ac93c1)
sarthakaggarwal97 added a commit to sarthakaggarwal97/valkey that referenced this pull request May 3, 2026
Cherry-pick of 6ce75cd from unstable.
Adds verify_replica_online after wait_for_sync to prevent
'ERR FAILOVER target replica is not online' race condition.

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
(cherry picked from commit ccb12ca)
sarthakaggarwal97 added a commit to sarthakaggarwal97/valkey that referenced this pull request May 3, 2026
Cherry-pick of 6ce75cd from unstable.

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
(cherry picked from commit 2ac93c1)
madolson pushed a commit that referenced this pull request May 6, 2026
Cherry-pick of 6ce75cd from unstable.

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
(cherry picked from commit 2ac93c1)
madolson pushed a commit that referenced this pull request May 6, 2026
Cherry-pick of 6ce75cd from unstable.
Adds verify_replica_online after wait_for_sync to prevent
'ERR FAILOVER target replica is not online' race condition.

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
(cherry picked from commit ccb12ca)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

test-failure An issue indicating a test failure

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants