Skip to content

kafka 3.5.1#133887

Merged
BrewTestBot merged 2 commits into
Homebrew:masterfrom
chenrui333:bump-kafka-3.5.0
Sep 3, 2023
Merged

kafka 3.5.1#133887
BrewTestBot merged 2 commits into
Homebrew:masterfrom
chenrui333:bump-kafka-3.5.0

Conversation

@chenrui333

Copy link
Copy Markdown
Member

Created by brew bump


Created with brew bump-formula-pr.

@github-actions github-actions Bot added java Java use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels Jun 15, 2023
@chenrui333

Copy link
Copy Markdown
Member Author
    BuildError: Failed executing: /home/linuxbrew/.linuxbrew/Cellar/kafka/3.5.0/bin/kafka-server-stop

@chenrui333 chenrui333 added test failure CI fails while running the test-do block CI-requeued PR has been re-added to the queue CI-no-fail-fast Continue CI tests despite failing GitHub Actions matrix builds. labels Jun 16, 2023
@github-actions

This comment was marked as resolved.

@github-actions github-actions Bot added the stale No recent activity label Jun 18, 2023
@chenrui333 chenrui333 added help wanted Task(s) needing PRs from the community or maintainers and removed stale No recent activity labels Jun 19, 2023
@chenrui333 chenrui333 added the linux Linux is specifically affected label Jul 23, 2023
@chenrui333

Copy link
Copy Markdown
Member Author

@chenrui333

Copy link
Copy Markdown
Member Author

only test failure on linux

  ==> /home/linuxbrew/.linuxbrew/Cellar/kafka/3.5.0/bin/kafka-server-stop
  No kafka server to stop
  Killing child processes...
  Error: kafka: failed
  An exception occurred within a child process:
    BuildError: Failed executing: /home/linuxbrew/.linuxbrew/Cellar/kafka/3.5.0/bin/kafka-server-stop

@chenrui333 chenrui333 changed the title kafka 3.5.0 kafka 3.5.1 Jul 24, 2023
@Moisan Moisan mentioned this pull request Jul 30, 2023
1 task
@ZhongRuoyu ZhongRuoyu mentioned this pull request Aug 5, 2023
@miimou

miimou commented Aug 16, 2023

Copy link
Copy Markdown
Contributor
  • putting line ENV["COLUMNS"] = "" after ENV["LOG_DIR"] = "#{testpath}/kafkalog" will solve CI problem.
diff --git a/Formula/k/kafka.rb b/Formula/k/kafka.rb
index ed872f218a9..3b0e0239eb9 100644
--- a/Formula/k/kafka.rb
+++ b/Formula/k/kafka.rb
@@ -68,6 +68,7 @@ class Kafka < Formula

   test do
     ENV["LOG_DIR"] = "#{testpath}/kafkalog"
+    ENV["COLUMNS"] = ""

     (testpath/"kafka").mkpath
     cp "#{etc}/kafka/zookeeper.properties", testpath/"kafka"
  • this problem is caused by 3 things

    1. brew test-bot sets environment variable COLUMNS for brew test (maybe after Homebrew/brew#15255)
    2. kafka-server-stop script uses ps ax command to determine Process ID of kafka instances (kafka/bin/kafka-server-stop.sh, lines 18-28)
    3. ps command implementation of Ubuntu truncates its output if environment variable COLUMNS is set even if its output is piped (procps-ng/procps/src/ps/global.c, lines 226-230)
  • there are some possible fixes

    • treat it as upstream problem of kafka which does not use ps axww to avoid truncation
    • treat it as brew-test-bot problem that causes unexpected environment variable is set for brew test
    • add patch that replaces ps ax to ps axww, to kafka formula
  • but, in my thought, because this problem blocks openjdk 20.0.2 which is a security fix, adding ENV["COLUMNS"] = "" is good because it can be applied quickly

@Parsa-Sedigh

Copy link
Copy Markdown

Is it possible one of the solutions will be used?

@SMillerDev

Copy link
Copy Markdown
Member

If someone reports the bug upstream I'm fine accepting a workaround in brew

@miimou

miimou commented Aug 28, 2023

Copy link
Copy Markdown
Contributor

I reported to kafka Jira (KAFKA-15413).

They have some issues about kafka-server-stop script and ps ax truncation for some years. (KAFKA-4931 and KAFKA-4110) So, this report may need long time or be rejected.

Also, add a workaround for an upstream issue.

Co-authored-by: Sakai Takashi <30765803+miimou@users.noreply.github.com>
Co-authored-by: Ruoyu Zhong <zhongruoyu@outlook.com>
@ZhongRuoyu

Copy link
Copy Markdown
Member

Thank you for the fix and upstream report, @miimou.

@ZhongRuoyu ZhongRuoyu removed help wanted Task(s) needing PRs from the community or maintainers CI-requeued PR has been re-added to the queue test failure CI fails while running the test-do block labels Sep 2, 2023
@ZhongRuoyu ZhongRuoyu added ready to merge PR can be merged once CI is green and removed linux Linux is specifically affected CI-no-fail-fast Continue CI tests despite failing GitHub Actions matrix builds. labels Sep 2, 2023
@ZhongRuoyu ZhongRuoyu mentioned this pull request Sep 2, 2023
1 task
@github-actions

github-actions Bot commented Sep 3, 2023

Copy link
Copy Markdown
Contributor

🤖 An automated task has requested bottles to be published to this PR.

@github-actions github-actions Bot added the CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. label Sep 3, 2023
@BrewTestBot BrewTestBot added this pull request to the merge queue Sep 3, 2023
Merged via the queue into Homebrew:master with commit 8001fea Sep 3, 2023
@chenrui333

Copy link
Copy Markdown
Member Author

@miimou thanks for getting this forward 💯

@chenrui333 chenrui333 mentioned this pull request Sep 3, 2023
1 task
@chenrui333 chenrui333 deleted the bump-kafka-3.5.0 branch January 22, 2024 17:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bump-formula-pr PR was created using `brew bump-formula-pr` CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. java Java use is a significant feature of the PR or issue ready to merge PR can be merged once CI is green

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants