Skip to content

Update Kafka versions#17819

Merged
ycombinator merged 1 commit intoelastic:masterfrom
ycombinator:testing-docker-kafka-version-update
Apr 20, 2020
Merged

Update Kafka versions#17819
ycombinator merged 1 commit intoelastic:masterfrom
ycombinator:testing-docker-kafka-version-update

Conversation

@ycombinator
Copy link
Copy Markdown
Contributor

@ycombinator ycombinator commented Apr 20, 2020

What does this PR do?

Updates the version of Kafka we use in our tests.

Why is it important?

The libbeat CI job has been failing the past few days with this error:


[2020-04-19T19:37:28.974Z] Step 9/15 : RUN mkdir -p ${KAFKA_LOGS_DIR} && mkdir -p ${KAFKA_HOME} && curl -s -o $INSTALL_DIR/kafka.tgz     "http://mirror.easyname.ch/apache/kafka/${KAFKA_VERSION}/kafka_2.11-${KAFKA_VERSION}.tgz" &&     tar xzf ${INSTALL_DIR}/kafka.tgz -C ${KAFKA_HOME} --strip-components 1

[2020-04-19T19:37:28.975Z]  ---> Running in 3dc3dbc4603f

[2020-04-19T19:37:29.914Z] 

[2020-04-19T19:37:29.915Z] gzip: stdin: not in gzip format

[2020-04-19T19:37:29.915Z] tar: Child returned status 1

[2020-04-19T19:37:29.915Z] tar: Error is not recoverable: exiting now

[2020-04-19T19:37:29.915Z] Removing intermediate container 3dc3dbc4603f

[2020-04-19T19:37:29.915Z] Service 'kafka' failed to build: The command '/bin/sh -c mkdir -p ${KAFKA_LOGS_DIR} && mkdir -p ${KAFKA_HOME} && curl -s -o $INSTALL_DIR/kafka.tgz     "http://mirror.easyname.ch/apache/kafka/${KAFKA_VERSION}/kafka_2.11-${KAFKA_VERSION}.tgz" &&     tar xzf ${INSTALL_DIR}/kafka.tgz -C ${KAFKA_HOME} --strip-components 1' returned a non-zero code: 2

[2020-04-19T19:37:29.915Z] scripts/Makefile:405: recipe for target 'build-image' failed

[2020-04-19T19:37:29.915Z] make[1]: *** [build-image] Error 1

[2020-04-19T19:37:29.915Z] make[1]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17381/src/github.com/elastic/beats/libbeat'

[2020-04-19T19:37:29.915Z] scripts/Makefile:305: recipe for target 'testsuite' failed

[2020-04-19T19:37:29.915Z] make: *** [testsuite] Error 2

Visiting http://mirror.easyname.ch/apache/kafka/ shows that the 2.1.1 sub-folder is no longer available, which is causing the failure seen in the CI logs. The next version available is 2.2.2 so this PR updates the Kafka version in our codebase to 2.2.2.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc

@ycombinator ycombinator added [zube]: In Review Team:Services (Deprecated) Label for the former Integrations-Services team labels Apr 20, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Apr 20, 2020

Pinging @elastic/integrations-services (Team:Services)

@ycombinator ycombinator added needs_backport PR is waiting to be backported to other branches. v7.7.1 v7.8.0 v8.0.0 labels Apr 20, 2020
@ycombinator ycombinator mentioned this pull request Apr 20, 2020
Merged
6 tasks
kaiyan-sheng
kaiyan-sheng approved these changes Apr 20, 2020
View reviewed changes
Copy link
Copy Markdown
Contributor

@kaiyan-sheng kaiyan-sheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CI is still red but doesn't seem to be related to kafka version anymore.

@kaiyan-sheng kaiyan-sheng mentioned this pull request Apr 20, 2020
Merged
1 task
@ycombinator ycombinator merged commit 43a07da into elastic:master Apr 20, 2020
@ycombinator ycombinator deleted the testing-docker-kafka-version-update branch April 20, 2020 03:08
This was referenced Apr 20, 2020
Merged
Merged
Closed
@jsoriano jsoriano mentioned this pull request Apr 20, 2020
Merged
@tonymeehan tonymeehan mentioned this pull request Apr 20, 2020
Merged
5 tasks
ycombinator added a commit that referenced this pull request Apr 21, 2020
@ycombinator
Update Kafka versions (#17819) (#17821)
516e792
ycombinator added a commit that referenced this pull request Apr 21, 2020
@ycombinator
Update Kafka versions (#17819) (#17822)
a164b71
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
@ycombinator
Update Kafka versions (elastic#17819) (elastic#17822)
9af7c80
@khushijain21 khushijain21 mentioned this pull request Jan 29, 2025
Merged
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@kaiyan-sheng kaiyan-sheng kaiyan-sheng approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

needs_backport PR is waiting to be backported to other branches. Team:Services (Deprecated) Label for the former Integrations-Services team v7.7.1 v7.8.0 v8.0.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@ycombinator @elasticmachine @kaiyan-sheng @andresrc