Skip to content

Preserve parent task id for data frame analytics#55046

Merged
albertzaharovits merged 5 commits intoelastic:masterfrom
albertzaharovits:data-frame-analytics-track-parent-task
Apr 10, 2020
Merged

Preserve parent task id for data frame analytics#55046
albertzaharovits merged 5 commits intoelastic:masterfrom
albertzaharovits:data-frame-analytics-track-parent-task

Conversation

@albertzaharovits
Copy link
Copy Markdown
Contributor

This change makes sure that all internal client requests spawned by the data frame analytics persistent task executor and that use the end user security credentials, have the parent task id assigned. The objective here is to permit auditing (as well as tracking for debugging purposes) of all the end-user requests executed on its behalf by persistent tasks. Because data frame analytics taks already implements graceful shutdown of child tasks, this change does not interfere with it by opting out of the persistent task cancellation of child tasks.

Relates #54943 #52314


Note to reviewers: Some internal requests that are spawned by the data frame analytics persistent task executor, but which do not contain the end user credentials, also have their parent task id assigned, where this didn't entail butchering the existing code. Also, some requests which are using the end user credentials but which are not spawned by the persistent task executor, have their parent task id assigned (no-op) out of extra diligence to ensure that no legit case escapes.

@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/ml-core (:ml)

Copy link
Copy Markdown
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM Thanks for fixing this!

@albertzaharovits albertzaharovits merged commit f7809dd into elastic:master Apr 10, 2020
@albertzaharovits albertzaharovits deleted the data-frame-analytics-track-parent-task branch April 10, 2020 13:51
albertzaharovits added a commit that referenced this pull request Apr 10, 2020
This change makes sure that all internal client requests spawned by the
data frame analytics persistent task executor and that use the end user
security credentials, have the parent task id assigned. The objective here
is to permit auditing (as well as tracking for debugging purposes) of all
the end-user requests executed on its behalf by persistent tasks.
Because data frame analytics taks already implements graceful shutdown
of child tasks, this change does not interfere with it by opting out of
the persistent task cancellation of child tasks.

Relates #54943 #52314
albertzaharovits added a commit that referenced this pull request Apr 14, 2020
This change ensures that internal client requests spawned by the
transform persistent task executor and that use the end user security
credentials, have the parent task id assigned. The objective here is
to permit auditing (as well as tracking for debugging purposes) of all
the end-user requests executed on its behalf by persistent tasks.
Because transform tasks already implements graceful shutdown of the
child tasks, this change does not interfere with that by opting out of
the persistent task cancellation of child tasks.

Relates #55046 #54943 #52314
Closes #54957
albertzaharovits added a commit that referenced this pull request Apr 14, 2020
This change ensures that internal client requests spawned by the
transform persistent task executor and that use the end user security
credentials, have the parent task id assigned. The objective here is
to permit auditing (as well as tracking for debugging purposes) of all
the end-user requests executed on its behalf by persistent tasks.
Because transform tasks already implements graceful shutdown of the
child tasks, this change does not interfere with that by opting out of
the persistent task cancellation of child tasks.

Relates #55046 #54943 #52314
Closes #54957
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants