-
Notifications
You must be signed in to change notification settings - Fork 8.6k
[Fleet] Split asset installation into chunks to avoid high memory pressure #189043
Copy link
Copy link
Closed
Closed
Copy link
Labels
8.16 candidateFeature:Prebuilt Detection RulesSecurity Solution Prebuilt Detection Rules areaSecurity Solution Prebuilt Detection Rules areaTeam: SecuritySolutionSecurity Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.Team:Detection Rule ManagementSecurity Detection Rule Management TeamSecurity Detection Rule Management TeamTeam:Detections and RespSecurity Detection Response TeamSecurity Detection Response TeamTeam:FleetTeam label for Observability Data Collection Fleet teamTeam label for Observability Data Collection Fleet team
Metadata
Metadata
Assignees
Labels
8.16 candidateFeature:Prebuilt Detection RulesSecurity Solution Prebuilt Detection Rules areaSecurity Solution Prebuilt Detection Rules areaTeam: SecuritySolutionSecurity Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.Team:Detection Rule ManagementSecurity Detection Rule Management TeamSecurity Detection Rule Management TeamTeam:Detections and RespSecurity Detection Response TeamSecurity Detection Response TeamTeam:FleetTeam label for Observability Data Collection Fleet teamTeam label for Observability Data Collection Fleet team
Type
Fields
Give feedbackNo fields configured for issues without a type.
Related to: #187969
Summary
For packages with a large number of assets, when performing reinstall or upgrade, we need to limit the number of saved objects installed in a single request.
Currently, during the package installation, before and inside the
savedObjectsImporter.importmethod, a substantial number of auxiliary objects proportional to the package size are being created. Not all of these created objects are used after the installation. We can reduce memory pressure by chunking the installation requests so that unused objects can be garbage collected, leading to less peak memory consumption.