Skip to content

Add remote refresh segment pressure service, settings and tracker#7227

Merged
gbbafna merged 18 commits intoopensearch-project:mainfrom
ashking94:6851-tracker
May 2, 2023
Merged

Add remote refresh segment pressure service, settings and tracker#7227
gbbafna merged 18 commits intoopensearch-project:mainfrom
ashking94:6851-tracker

Conversation

@ashking94
Copy link
Copy Markdown
Member

@ashking94 ashking94 commented Apr 18, 2023

Description

This PR adds the required core classes for tracking remote refresh segment upload. This PR does not have the integration of the remote refresh segment pressure service with the remote refresh listener. #7219 has details on how the integration would look like. It would follow up in the next PR.

Issues Resolved

This solves #7226

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions
Copy link
Copy Markdown
Contributor

Gradle Check (Jenkins) Run Completed with:

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Apr 18, 2023

Codecov Report

❌ Patch coverage is 87.36462% with 35 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.51%. Comparing base (72ed13b) to head (c82ffb7).
⚠️ Report is 3934 commits behind head on main.

Files with missing lines Patch % Lines
...arch/index/remote/RemoteRefreshSegmentTracker.java 83.19% 15 Missing and 5 partials ⚠️
...ex/remote/RemoteRefreshSegmentPressureService.java 82.14% 12 Missing and 3 partials ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #7227      +/-   ##
============================================
- Coverage     70.55%   70.51%   -0.04%     
- Complexity    59441    59518      +77     
============================================
  Files          4862     4865       +3     
  Lines        285544   285816     +272     
  Branches      41153    41164      +11     
============================================
+ Hits         201453   201552      +99     
- Misses        67544    67680     +136     
- Partials      16547    16584      +37     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@github-actions
Copy link
Copy Markdown
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Copy Markdown
Contributor

Gradle Check (Jenkins) Run Completed with:

Signed-off-by: Ashish Singh <ssashish@amazon.com>
Signed-off-by: Ashish Singh <ssashish@amazon.com>
Signed-off-by: Ashish Singh <ssashish@amazon.com>
@github-actions
Copy link
Copy Markdown
Contributor

Gradle Check (Jenkins) Run Completed with:

  • RESULT: UNSTABLE ❕
  • TEST FAILURES:
      1 org.opensearch.search.basic.SearchWithRandomIOExceptionsIT.testRandomDirectoryIOExceptions
      1 org.opensearch.search.basic.SearchWithRandomIOExceptionsIT.classMethod

Signed-off-by: Ashish Singh <ssashish@amazon.com>
@github-actions
Copy link
Copy Markdown
Contributor

Gradle Check (Jenkins) Run Completed with:

  • RESULT: UNSTABLE ❕
  • TEST FAILURES:
      1 org.opensearch.indices.replication.SegmentReplicationIT.testReplicationPostDeleteAndForceMerge

Signed-off-by: Ashish Singh <ssashish@amazon.com>
@github-actions
Copy link
Copy Markdown
Contributor

Gradle Check (Jenkins) Run Completed with:

Signed-off-by: Ashish Singh <ssashish@amazon.com>
@gbbafna gbbafna added the backport 2.x Backport to 2.x branch label May 2, 2023
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented May 2, 2023

Gradle Check (Jenkins) Run Completed with:

  • RESULT: UNSTABLE ❕
  • TEST FAILURES:
      1 org.opensearch.indices.replication.SegmentReplicationIT.testScrollWithOngoingSegmentReplication

@gbbafna gbbafna merged commit 18390f9 into opensearch-project:main May 2, 2023
opensearch-trigger-bot bot pushed a commit that referenced this pull request May 2, 2023
)

Signed-off-by: Ashish Singh <ssashish@amazon.com>
(cherry picked from commit 18390f9)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
@ashking94
Copy link
Copy Markdown
Member Author

Backport failing as the PR #6875 is yet to be backported which changes in classes referred in this PR.

linuxpi pushed a commit to linuxpi/OpenSearch that referenced this pull request May 19, 2023
…ensearch-project#7227)

Signed-off-by: Ashish Singh <ssashish@amazon.com>
(cherry picked from commit 18390f9)
@ashking94 ashking94 added backport 2.x Backport to 2.x branch and removed backport 2.x Backport to 2.x branch labels May 23, 2023
@opensearch-trigger-bot
Copy link
Copy Markdown
Contributor

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/backport-2.x 2.x
# Navigate to the new working tree
pushd ../.worktrees/backport-2.x
# Create a new branch
git switch --create backport/backport-7227-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 18390f9e314f79aa53a251db788217c01732cf1c
# Push it to GitHub
git push --set-upstream origin backport/backport-7227-to-2.x
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-7227-to-2.x.

ashking94 added a commit to ashking94/OpenSearch that referenced this pull request May 23, 2023
gbbafna pushed a commit that referenced this pull request May 23, 2023
) (#7684)

Signed-off-by: Ashish Singh <ssashish@amazon.com>
shiv0408 pushed a commit to Gaurav614/OpenSearch that referenced this pull request Apr 25, 2024
…ensearch-project#7227)

Signed-off-by: Ashish Singh <ssashish@amazon.com>
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport 2.x Backport to 2.x branch skip-changelog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants