Skip to content

Add data frame feature#38934

Merged
hendrikmuhs merged 98 commits intomasterfrom
feature/data-frame-transforms
Feb 18, 2019
Merged

Add data frame feature#38934
hendrikmuhs merged 98 commits intomasterfrom
feature/data-frame-transforms

Conversation

@hendrikmuhs
Copy link
Copy Markdown

@hendrikmuhs hendrikmuhs commented Feb 15, 2019

The data frame plugin allows users to create feature indexes by pivoting a source index. In a nutshell this can be understood as reindex supporting aggregations or similar to the so called entity centric indexing.

This PR merges the feature branch feature/data-frame-transforms into master. Additionally it will be backported to 7.x.

Hendrik Muhs added 30 commits July 24, 2018 11:40
This is a temporary (squashed) commit of #32743 till ed4feb6,
to be reverted and replaced by the final version of this PR
this change enables testing as well as adds basic tests
Replace mocked indexer and use AsyncTwoPhaseIndexer (introduced in #32743) instead.
add rest endpoints to stop and delete feature build indexer tasks and fix task saving/reloading
add basic configuration for feature index builder job, reads the source, destination index, aggregation source and aggregation config
re-enables tests after upstream fixes, see #34005
implement support for multiple sources and aggregations
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/ml-core

Copy link
Copy Markdown
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hendrikmuhs hendrikmuhs merged commit 869de3f into master Feb 18, 2019
hendrikmuhs pushed a commit to hendrikmuhs/elasticsearch that referenced this pull request Feb 18, 2019
The data frame plugin allows users to create feature indexes by pivoting a source index. In a
nutshell this can be understood as reindex supporting aggregations or similar to the so called entity
centric indexing.

Full history is provided in: feature/data-frame-transforms
hendrikmuhs pushed a commit that referenced this pull request Feb 18, 2019
The data frame plugin allows users to create feature indexes by pivoting a source index. In a
nutshell this can be understood as reindex supporting aggregations or similar to the so called entity
centric indexing.

Full history is provided in: feature/data-frame-transforms
jasontedor added a commit to jasontedor/elasticsearch that referenced this pull request Feb 18, 2019
…ate-file

* elastic/master:
  Remove tests and branches that will never execute (elastic#38772)
  also check ccr stats api return empty response in ensureNoCcrTasks()
  Add overlapping, before, after filters to intervals query (elastic#38999)
  Mute test elastic#38949
  Add remote recovery to ShardFollowTaskReplicationTests (elastic#39007)
  [ML] More advanced post-test cleanup of ML indices (elastic#39049)
  wait for shard to be allocated before executing a resume follow api
  Update track-total-hits.asciidoc
  Force kill testcluster nodes (elastic#37353)
  Make pullFixture a task dependency of resolveAllDependencies (elastic#38956)
  set minimum supported version (elastic#39043)
  Enforce Completion Context Limit (elastic#38675)
  Mute test
  Don't close caches while there might still be in-flight requests. (elastic#38958)
  Fix elastic#38623 remove xpack namespace REST API (elastic#38625)
  Add data frame feature (elastic#38934)
  Test bi-directional index following during a rolling upgrade. (elastic#38962)
  Generate mvn pom for ssl-config library (elastic#39019)
  Mute testRetentionLeaseIsRenewedDuringRecovery
@hendrikmuhs hendrikmuhs deleted the feature/data-frame-transforms branch February 12, 2020 13:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants