Skip to content

Conversation

@xliuqq
Copy link
Collaborator

@xliuqq xliuqq commented Feb 22, 2024

Ⅰ. Describe what this PR does

support parallel data migrate for cron policy.

previous pr see #3645.

Ⅱ. Does this pull request fix one issue?

fixes #XXXX

Ⅲ. List the added test cases (unit test/integration test) if any, please explain if no tests are needed.

Ⅳ. Describe how to verify it

Ⅴ. Special notes for reviews

Signed-off-by: xliuqq <xlzq1992@gmail.com>
Signed-off-by: xliuqq <xlzq1992@gmail.com>
@codecov
Copy link

codecov bot commented Feb 22, 2024

Codecov Report

Attention: Patch coverage is 0% with 12 lines in your changes are missing coverage. Please review.

Project coverage is 64.31%. Comparing base (34fb81a) to head (d6df7be).
Report is 72 commits behind head on master.

Files Patch % Lines
pkg/ddc/base/operation.go 0.00% 10 Missing ⚠️
pkg/utils/kubeclient/job.go 0.00% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #3732      +/-   ##
==========================================
- Coverage   64.40%   64.31%   -0.09%     
==========================================
  Files         474      474              
  Lines       28339    28422      +83     
==========================================
+ Hits        18252    18281      +29     
- Misses       7913     7967      +54     
  Partials     2174     2174              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

parallelism: 1
{{- if gt (.Values.datamigrate.parallelism | int) 1 }}
# when using parallel tasks, default suspend is true, the reconciler will set it to false after scale the workers statefulset.
suspend: true
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Which Kubernetes version can support this?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

job suspend field release notes: kubernetes/enhancements#2232

Alpha release target (x.y): 1.21, need explictly enable the SuspendJob feature gate;
Beta release target (x.y): 1.22, gated by SuspendJob feature flag (enabled by default);
Stable release target (x.y): 1.24

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So I think we should stress the known limitations in the documentation. The endusers could be aware of this.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed.

Signed-off-by: xliuqq <xlzq1992@gmail.com>
@sonarqubecloud
Copy link

sonarqubecloud bot commented Mar 1, 2024

Quality Gate Passed Quality Gate passed

Issues
6 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
2.5% Duplication on New Code

See analysis details on SonarCloud

TrafalgarZZZ

This comment was marked as resolved.

Copy link
Collaborator

@cheyang cheyang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@fluid-e2e-bot
Copy link

fluid-e2e-bot bot commented Apr 26, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cheyang

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@fluid-e2e-bot fluid-e2e-bot bot merged commit d33ba74 into fluid-cloudnative:master Apr 26, 2024
Ricky-Daxia pushed a commit to Ricky-Daxia/fluid that referenced this pull request May 6, 2024
* support parallel tasks for cron datamigrate

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* update logs

Signed-off-by: xliuqq <xlzq1992@gmail.com>

* fix: add docs for parallel cron datamigrate

Signed-off-by: xliuqq <xlzq1992@gmail.com>

---------

Signed-off-by: xliuqq <xlzq1992@gmail.com>
Signed-off-by: Ricky-Daxia <1915754435@qq.com>
@xliuqq xliuqq deleted the parallel_cron branch May 26, 2024 07:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants