[CI] Fixed container images packaging by pazone · Pull Request #6972 · elastic/elastic-agent

pazone · 2025-02-21T14:59:25Z

What does this PR do?

Fixed container image packaging by setting proper packaging variables
We now have 9 packaging steps:

Packaging: linux/amd64 rpm

Artifacts :

elastic-agent-9.0.0-SNAPSHOT-x86_64.rpm
elastic-agent-9.0.0-SNAPSHOT-x86_64.rpm.sha512

Packaging: linux/arm64 rpm

Artifacts :

elastic-agent-9.0.0-SNAPSHOT-aarch64.rpm
elastic-agent-9.0.0-SNAPSHOT-aarch64.rpm.sha512

Packaging: linux/amd64 deb

Artifacts :

elastic-agent-9.0.0-SNAPSHOT-amd64.deb
elastic-agent-9.0.0-SNAPSHOT-amd64.deb.sha512

Packaging: linux/arm64 deb

Artifacts:

elastic-agent-9.0.0-SNAPSHOT-arm64.deb
elastic-agent-9.0.0-SNAPSHOT-arm64.deb.sha512

Packaging: linux/amd64 tar.gz

Artifacts:

elastic-agent-9.0.0-SNAPSHOT-linux-x86_64.tar.gz
elastic-agent-9.0.0-SNAPSHOT-linux-x86_64.tar.gz.sha512

Packaging: linux/arm64 tar.gz

Artifacts:

elastic-agent-9.0.0-SNAPSHOT-linux-arm64.tar.gz
elastic-agent-9.0.0-SNAPSHOT-linux-arm64.tar.gz.sha512

Packaging: Containers linux/amd64

14 amd64 images. See the build

Packaging: Containers linux/arm64

14 arm64 images. See the build

Packaging: windows/amd64 zip

elastic-agent-9.0.0-SNAPSHOT-windows-x86_64.zip
elastic-agent-9.0.0-SNAPSHOT-windows-x86_64.zip.sha512

Why is it important?

The container images will be used by k8s integration tests instead of rebuilding them.

Checklist

I have read and understood the pull request guidelines of this project.
My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have added an entry in ./changelog/fragments using the changelog tool
I have added an integration test or an E2E test

Disruptive User Impact

How to test this PR locally

Related issues

Questions to ask yourself

How are we going to support this in production?
How are we going to measure its adoption?
How are we going to debug this?
What are the metrics I should take care of?
...

…tic-agent into ci_fix_packaging_containers

.buildkite/bk.integration.pipeline.yml

mergify · 2025-02-26T07:35:03Z

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b ci_fix_packaging_containers upstream/ci_fix_packaging_containers
git merge upstream/main
git push upstream ci_fix_packaging_containers

pazone · 2025-02-26T10:26:33Z

Build takes too long because of the emulation

mergify · 2025-03-03T10:44:02Z

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b ci_fix_packaging_containers upstream/ci_fix_packaging_containers
git merge upstream/main
git push upstream ci_fix_packaging_containers

elastic-sonarqube · 2025-03-04T17:46:54Z

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

.buildkite/bk.integration.pipeline.yml

.buildkite/integration.pipeline.yml

elasticmachine · 2025-03-04T23:48:23Z

💛 Build succeeded, but was flaky

Buildkite Build
Commit: 7677e85

Failed CI Steps

History

💔 Build #18039 failed cbc3489
💔 Build #18033 failed c84271d
💔 Build #18014 failed a404b1d
💔 Build #18009 failed 4c6d45e
💔 Build #17996 failed 8e20566
💔 Build #17569 failed ea79860

cc @pazone

dliappis

LGTM

.buildkite/integration.pipeline.yml

* [CI] Fixed container images packaging * Packaging Ubuntu matrix * Improve matrix representation * Removed matrix packaging if favour to unique step keys * Cleanup * Added binfmt * Pinned binfmt to v8.1.5 * Correct step names * Changed packaging ARM machine type * pinned qemu-v9.2.0-51 * Remove qemu * Removed deb and rpm integration packaging * Reordered packaging steps * [CI] Build FIPS ARM Linux on ARM machine. Added missing retries * Fixed FIPS * [CI] Corrected integration tests packaging dependencies * [CI] single buildkite download invocation * Added missing retries (cherry picked from commit 14943f0) # Conflicts: # .buildkite/integration.pipeline.yml

* [CI] Fixed container images packaging (#6972) * [CI] Fixed container images packaging * Packaging Ubuntu matrix * Improve matrix representation * Removed matrix packaging if favour to unique step keys * Cleanup * Added binfmt * Pinned binfmt to v8.1.5 * Correct step names * Changed packaging ARM machine type * pinned qemu-v9.2.0-51 * Remove qemu * Removed deb and rpm integration packaging * Reordered packaging steps * [CI] Build FIPS ARM Linux on ARM machine. Added missing retries * Fixed FIPS * [CI] Corrected integration tests packaging dependencies * [CI] single buildkite download invocation * Added missing retries (cherry picked from commit 14943f0) # Conflicts: # .buildkite/integration.pipeline.yml * Resolved conflicts --------- Co-authored-by: Pavel Zorin <pavel.zorin@elastic.co>

* [CI] Fixed container images packaging (#6972) * [CI] Fixed container images packaging * Packaging Ubuntu matrix * Improve matrix representation * Removed matrix packaging if favour to unique step keys * Cleanup * Added binfmt * Pinned binfmt to v8.1.5 * Correct step names * Changed packaging ARM machine type * pinned qemu-v9.2.0-51 * Remove qemu * Removed deb and rpm integration packaging * Reordered packaging steps * [CI] Build FIPS ARM Linux on ARM machine. Added missing retries * Fixed FIPS * [CI] Corrected integration tests packaging dependencies * [CI] single buildkite download invocation * Added missing retries (cherry picked from commit 14943f0) # Conflicts: # .buildkite/integration.pipeline.yml * Resolved conflicts * Resolved conflicts --------- Co-authored-by: Pavel Zorin <pavel.zorin@elastic.co>

* [CI] Fixed container images packaging (#6972) * [CI] Fixed container images packaging * Packaging Ubuntu matrix * Improve matrix representation * Removed matrix packaging if favour to unique step keys * Cleanup * Added binfmt * Pinned binfmt to v8.1.5 * Correct step names * Changed packaging ARM machine type * pinned qemu-v9.2.0-51 * Remove qemu * Removed deb and rpm integration packaging * Reordered packaging steps * [CI] Build FIPS ARM Linux on ARM machine. Added missing retries * Fixed FIPS * [CI] Corrected integration tests packaging dependencies * [CI] single buildkite download invocation * Added missing retries (cherry picked from commit 14943f0) # Conflicts: # .buildkite/integration.pipeline.yml * Resolved conflicts --------- Co-authored-by: Pavel Zorin <pavel.zorin@elastic.co>

* [CI] Fixed container images packaging (#6972) * [CI] Fixed container images packaging * Packaging Ubuntu matrix * Improve matrix representation * Removed matrix packaging if favour to unique step keys * Cleanup * Added binfmt * Pinned binfmt to v8.1.5 * Correct step names * Changed packaging ARM machine type * pinned qemu-v9.2.0-51 * Remove qemu * Removed deb and rpm integration packaging * Reordered packaging steps * [CI] Build FIPS ARM Linux on ARM machine. Added missing retries * Fixed FIPS * [CI] Corrected integration tests packaging dependencies * [CI] single buildkite download invocation * Added missing retries (cherry picked from commit 14943f0) # Conflicts: # .buildkite/integration.pipeline.yml * Resolved conflicts * Removed FIPS packaging --------- Co-authored-by: Pavel Zorin <pavel.zorin@elastic.co>

[CI] Fixed container images packaging

4aa8682

pazone added enhancement New feature or request skip-changelog Team:Ingest-EngProd backport-active-all Automated backport with mergify to all the active branches labels Feb 21, 2025

pazone requested a review from pkoutsovasilis February 21, 2025 14:59

mergify bot assigned pazone Feb 21, 2025

Packaging Ubuntu matrix

2e78431

pkoutsovasilis mentioned this pull request Feb 24, 2025

feat: bump go to 1.24.0 #6932

Merged

8 tasks

Pavel Zorin added 7 commits February 24, 2025 13:46

Improve matrix representation

fa0aa63

Removed matrix packaging if favour to unique step keys

cb26440

Cleanup

97ca59d

Added binfmt

4f97115

Merge branch 'main' into ci_fix_packaging_containers

08efd9f

Pinned binfmt to v8.1.5

dcfd931

Merge branch 'ci_fix_packaging_containers' of github.com:elastic/elas…

57591b2

…tic-agent into ci_fix_packaging_containers

pazone commented Feb 25, 2025

View reviewed changes

.buildkite/bk.integration.pipeline.yml Outdated Show resolved Hide resolved

Correct step names

841ab70

pazone marked this pull request as ready for review February 26, 2025 00:14

pazone requested a review from a team as a code owner February 26, 2025 00:14

pazone requested a review from dliappis February 26, 2025 00:14

Pavel Zorin added 3 commits February 26, 2025 10:06

Changed packaging ARM machine type

e8e4546

pinned qemu-v9.2.0-51

0a73c85

Resolved conflicts

cd3e102

Remove qemu

ea79860

oakrizan approved these changes Mar 3, 2025

View reviewed changes

pazone mentioned this pull request Mar 3, 2025

fix(go/base): set GOTOOLCHAIN=local and skip building arm using the base Dockerfile elastic/golang-crossbuild#524

Merged

Pavel Zorin added 6 commits March 4, 2025 12:49

[CI] Build FIPS ARM Linux on ARM machine. Added missing retries

b4c15c4

Resolved conflicts

4c6d45e

Fixed FIPS

a404b1d

[CI] Corrected integration tests packaging dependencies

c84271d

[CI] single buildkite download invocation

cbc3489

Added missing retries

7677e85

dliappis reviewed Mar 4, 2025

View reviewed changes

.buildkite/bk.integration.pipeline.yml Show resolved Hide resolved

.buildkite/bk.integration.pipeline.yml Show resolved Hide resolved

.buildkite/bk.integration.pipeline.yml Show resolved Hide resolved

.buildkite/integration.pipeline.yml Show resolved Hide resolved

pkoutsovasilis approved these changes Mar 5, 2025

View reviewed changes

dliappis approved these changes Mar 5, 2025

View reviewed changes

.buildkite/integration.pipeline.yml Show resolved Hide resolved

pazone merged commit 14943f0 into main Mar 5, 2025
14 checks passed

pazone deleted the ci_fix_packaging_containers branch March 5, 2025 10:55

mergify bot mentioned this pull request Mar 5, 2025

[9.0](backport #6972) [CI] Fixed container images packaging #7192

Merged

8 tasks

mergify bot mentioned this pull request Mar 5, 2025

[8.18](backport #6972) [CI] Fixed container images packaging #7193

Merged

8 tasks

mergify bot mentioned this pull request Mar 5, 2025

[8.17](backport #6972) [CI] Fixed container images packaging #7194

Merged

8 tasks

mergify bot mentioned this pull request Mar 5, 2025

[8.16](backport #6972) [CI] Fixed container images packaging #7195

Merged

8 tasks

mergify bot mentioned this pull request Mar 5, 2025

[8.x](backport #6972) [CI] Fixed container images packaging #7196

Merged

8 tasks

This was referenced Jun 13, 2025

[Automation] Bump Golang version to 1.24.4 elastic/beats#44696

Merged

[main] Update to Beats github.com/elastic/beats@0678f4d96212 #8471

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[CI] Fixed container images packaging#6972

[CI] Fixed container images packaging#6972
pazone merged 24 commits intomainfrom
ci_fix_packaging_containers

pazone commented Feb 21, 2025 •

edited

Loading

Uh oh!

Uh oh!

mergify bot commented Feb 26, 2025

Uh oh!

pazone commented Feb 26, 2025

Uh oh!

mergify bot commented Mar 3, 2025

Uh oh!

elastic-sonarqube bot commented Mar 4, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

elasticmachine commented Mar 4, 2025

Uh oh!

dliappis left a comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

pazone commented Feb 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Packaging: linux/amd64 rpm

Packaging: linux/arm64 rpm

Packaging: linux/amd64 deb

Packaging: linux/arm64 deb

Packaging: linux/amd64 tar.gz

Packaging: linux/arm64 tar.gz

Packaging: Containers linux/amd64

Packaging: Containers linux/arm64

Packaging: windows/amd64 zip

Why is it important?

Checklist

Disruptive User Impact

How to test this PR locally

Related issues

Questions to ask yourself

Uh oh!

Uh oh!

mergify bot commented Feb 26, 2025

Uh oh!

pazone commented Feb 26, 2025

Uh oh!

mergify bot commented Mar 3, 2025

Uh oh!

elastic-sonarqube bot commented Mar 4, 2025

Quality Gate passed

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

elasticmachine commented Mar 4, 2025

💛 Build succeeded, but was flaky

Failed CI Steps

History

Uh oh!

dliappis left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

pazone commented Feb 21, 2025 •

edited

Loading