Skip to content

Error while submitting spark jobs on k8s V1.14.6 #82131

@dharam1

Description

@dharam1

In previous version of K8s i.e. 1.12.x spark jobs were running properly, but when i update the version to 1.14.6 and running spark jobs on updated version faced the following error:

Error : 566984292910-driver-svc.default.svc:7078/jars/spark-examples_2.11-2.4.0.jar with timestamp 1566984300797
2019-08-28 09:25:02 INFO ExecutorPodsAllocator:54 - Going to request 2 executors from Kubernetes.
2019-08-28 09:25:02 WARN WatchConnectionManager:185 - Exec Failure: HTTP 403, Status: 403 -
java.net.ProtocolException: Expected HTTP 101 response but was '403 Forbidden'
at okhttp3.internal.ws.RealWebSocket.checkResponse(RealWebSocket.java:216)
at okhttp3.internal.ws.RealWebSocket$2.onResponse(RealWebSocket.java:183)
at okhttp3.RealCall$AsyncCall.execute(RealCall.java:141)
at okhttp3.internal.NamedRunnable.run(NamedRunnable.java:32)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

If anyone can help with this. Would really appreciate it. Productionn landscape is getting break due to this.
Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/bugCategorizes issue or PR as related to a bug.needs-sigIndicates an issue or PR lacks a `sig/foo` label and requires one.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions