Skip to content

GC Dataproc image version 1.2.37 expects zkServer.sh #276

Closed
mirohla wants to merge 1 commit intoGoogleCloudDataproc:masterfrom
mirohla:master
Closed

GC Dataproc image version 1.2.37 expects zkServer.sh #276
mirohla wants to merge 1 commit intoGoogleCloudDataproc:masterfrom
mirohla:master

Conversation

@mirohla
Copy link

@mirohla mirohla commented Jun 5, 2018

script in /usr/share/zookeeper/bin instead of /usr/lib/zookeeper/bin.

…hare/zookeeper/bin instead of /usr/lib/zookeeper/bin.
@googlebot
Copy link

Thanks for your pull request. It looks like this may be your first contribution to a Google open source project (if not, look below for help). Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

📝 Please visit https://cla.developers.google.com/ to sign.

Once you've signed (or fixed any issues), please reply here (e.g. I signed it!) and we'll verify it.


What to do if you already signed the CLA

Individual signers
Corporate signers

@mirohla
Copy link
Author

mirohla commented Jun 5, 2018

CLA signed

@googlebot
Copy link

CLAs look good, thanks!

@googlebot googlebot added cla: yes and removed cla: no labels Jun 5, 2018
@ekampf
Copy link

ekampf commented Jun 5, 2018

Had the same problem on my cluster, this fix worked.

@soelu
Copy link

soelu commented Jun 7, 2018

Any chance of getting this approved soon? This somehow blocks our deployment atm.

@karth295
Copy link
Contributor

karth295 commented Jun 7, 2018

Thanks for the patch and feedback folks. You can (and should) copy the initialization action to your own GCS bucket for your production pipelines: https://github.com/GoogleCloudPlatform/dataproc-initialization-actions#how-initialization-actions-are-used. 1) That protects your automation in case we make a breaking change, and 2) you don't need to wait on us merging PRs.

Copy link
Contributor

@karth295 karth295 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems reasonable, but I'm afraid this will break 1.0/1.1 clusters. Give me a bit to check out why this path changed in the first place.

@pmkc
Copy link
Contributor

pmkc commented Jun 8, 2018

As described in #279 the path changed because the incorrect (and problematic) Debian 8 zookeeper package was installed instead. This affects all image versions (until next week's unreleased versions) and should be fixed by installing the correct package.

As a very quick work around I would simply delete the apt-get install zookeeper line, because it is already installed.

@pmkc pmkc closed this Jun 8, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants