Skip to content

cluster formation DSL - Gradle integration - part 2#32028

Merged
alpar-t merged 8 commits intoelastic:masterfrom
alpar-t:fix/30904-cluster-formation-part2
Aug 15, 2018
Merged

cluster formation DSL - Gradle integration - part 2#32028
alpar-t merged 8 commits intoelastic:masterfrom
alpar-t:fix/30904-cluster-formation-part2

Conversation

@alpar-t
Copy link
Copy Markdown
Contributor

@alpar-t alpar-t commented Jul 13, 2018

Adds the initial cluster formation DSL and integration with Gradle task graph and task life-cycle.
The main purpose of the CI is to exercise this integration and add integration tests for it.
The actual syntax of the DSL will be subject to change ( some things are already changed ),
I don't think it's worth focusing on it much as long as it's not something that drives into a corner.
Keeping it easy to change the DSL is a design goal. I already have local changes that iterate on it.
I think the best time to talk about the DSL syntax is when we actually start using it.

Starting the review with ClusterformationPluginIT.java and buildSrc/src/testKit/clusterformation/build.gradle might make it easier to understand other changes.

@rjernst I will extend the DSL to restrict to specific task types in a future PR.

alpar-t added 4 commits July 12, 2018 17:23
- This allows to move all  all .java files from .groovy.
- Will prevent eclipse from tangling up in this setup
- make it possible to use Version from Java
```
> Task :plugins:ingest-user-agent:listElasticSearchClusters
Starting cluster: myTestCluster
   * myTestCluster: /home/alpar/work/elastic/elasticsearch/plugins/ingest-user-agent/foo
Asked to unClaimAndStop myTestCluster, since cluster still has 1 claim it will not be stopped

> Task :plugins:ingest-user-agent:testme UP-TO-DATE
Stopping myTestCluster, since no of claims is 0
```

- Meant to auto manage the clusters lifecycle
- Add integration test for cluster formation
@alpar-t alpar-t added the :Delivery/Build Build or test infrastructure label Jul 13, 2018
@alpar-t alpar-t requested review from nik9000 and rjernst July 13, 2018 08:50
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-core-infra

@alpar-t
Copy link
Copy Markdown
Contributor Author

alpar-t commented Jul 13, 2018

I don't understand why this diff shows changes already in master. cddb550 is the first commit on the branch, all the others were rebased away and merged to master as part 1. Looking at the diffs locally shows correctly and git push says everything is up to date.

@alpar-t
Copy link
Copy Markdown
Contributor Author

alpar-t commented Jul 19, 2018

@rjernst @nik9000 would be great if you could take a look, I need the new methods in GradleIntegrationTestCase for other changes. I can break those out of this PR if you think it needs more time to review as a whole.

@alpar-t
Copy link
Copy Markdown
Contributor Author

alpar-t commented Aug 8, 2018

task whatever {
    useCluster clusters.mycluster
}

@alpar-t alpar-t added the WIP label Aug 10, 2018
@alpar-t alpar-t merged commit e680a64 into elastic:master Aug 15, 2018
alpar-t added a commit that referenced this pull request Aug 15, 2018
jasontedor added a commit that referenced this pull request Aug 15, 2018
* elastic/master:
  Revert "cluster formation DSL - Gradle integration -  part 2 (#32028)" (#32876)
  cluster formation DSL - Gradle integration -  part 2 (#32028)
  Introduce global checkpoint listeners (#32696)
  Move connection profile into connection manager (#32858)
  [ML] Temporarily disabling rolling-upgrade tests
  Use generic AcknowledgedResponse instead of extended classes (#32859)
  [ML] Removing old per-partition normalization code (#32816)
  Use JDK 10 for 6.4 BWC builds (#32866)
  Removed flaky test. Looks like randomisation makes these assertions unreliable.
  [test] mute IndexShardTests.testDocStats
  Introduce the dissect library (#32297)
  Security: remove password hash bootstrap check (#32440)
  Move validation to server for put user requests (#32471)
  [ML] Add high level REST client docs for ML put job endpoint (#32843)
  Test: Fix forbidden uses in test framework (#32824)
  Painless: Change fqn_only to no_import (#32817)
  [test] mute testSearchWithSignificantTermsAgg
  Watcher: Remove unused hipchat render method (#32211)
  Watcher: Remove extraneous auth classes (#32300)
  Watcher: migrate PagerDuty v1 events API to v2 API (#32285)
@mark-vieira mark-vieira added the Team:Delivery Meta label for Delivery team label Nov 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Delivery/Build Build or test infrastructure >non-issue Team:Delivery Meta label for Delivery team v7.0.0-beta1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants