Skip to content

INGEST: Move all Pipeline State into IngestService#32617

Merged
original-brownbear merged 5 commits intoelastic:masterfrom
original-brownbear:real-ingest-service
Aug 21, 2018
Merged

INGEST: Move all Pipeline State into IngestService#32617
original-brownbear merged 5 commits intoelastic:masterfrom
original-brownbear:real-ingest-service

Conversation

@original-brownbear
Copy link
Copy Markdown
Contributor

  • Moves all pipeline state into the ingest service
    • Retains the existing pipeline store and pipeline execution service as inner classes to make the review easier, they should be flattened out in the next step
    • All tests for these classes were copied (and adapted) to the ingest service tests
  • This is a refactoring step to enable a clean implementation of a pipeline processor (See INGEST: Add Pipeline Processor #32473)

* Moves all pipeline state into the ingest service
   * Retains the existing pipeline store and pipeline execution service as inner classes to make the review easier, they should be flattened out in the next step
   * All tests for these classes were copied (and adapted) to the ingest service tests
* This is a refactoring step to enable a clean implementation of a pipeline processor (See #32473)
@original-brownbear original-brownbear added WIP :Distributed/Ingest Node Execution or management of Ingest Pipelines v7.0.0 >refactoring labels Aug 3, 2018
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-core-infra

Copy link
Copy Markdown
Member

@rjernst rjernst left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we really need to keep classes for PipelineExecutionService and PipelineStore? What I meant by my original suggestion was to actually fold the implementation/methods of these classes into IngestService.

Also, /cc @martijnvg who should review as he is more familiar with why these were built as separate services in the first place.

@original-brownbear
Copy link
Copy Markdown
Contributor Author

@rjernst <= 🎂

on to business:

See my PR description, the only reason I did it this way was to make it easier to review. I was gonna fold those together for sure in the next step, the classes just introduce a bunch of complication without benefit outside of making the review easier here imo.

@original-brownbear
Copy link
Copy Markdown
Contributor Author

@martijnvg see #32473 (comment) for the motivation behind this.

@original-brownbear
Copy link
Copy Markdown
Contributor Author

Jenkins test this

@original-brownbear
Copy link
Copy Markdown
Contributor Author

@martijnvg can you take a look here please? :)

Copy link
Copy Markdown
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@original-brownbear LGTM. I just got back from vacation :)

There was no particular reason why these services were separated classes, encapsulating PipelineExecutionService and PipelineStore into IngestService make sense to me.

@original-brownbear
Copy link
Copy Markdown
Contributor Author

@martijnvg right (with the vacation thing), sorry for being annoying and thanks for the review! :)

Merging then, will further flatten this out like suggested by @rjernst in a follow up :)

@original-brownbear original-brownbear merged commit 8fc213f into elastic:master Aug 21, 2018
@original-brownbear original-brownbear deleted the real-ingest-service branch August 21, 2018 03:05
original-brownbear added a commit that referenced this pull request Aug 21, 2018
* INGEST: Simplify IngestService

* Follow up to #32617
* Flatten redundant inner classes of `IngestService`
original-brownbear added a commit that referenced this pull request Sep 4, 2018
* INGEST: Simplify IngestService (#33008)
* Follow up to #32617
* Flatten redundant inner classes of `IngestService`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants