Skip to content

Add SPARK_LOCAL_IP in cross version tests config#4237

Merged
harupy merged 5 commits intomlflow:masterfrom
harupy:fix-spark-port-issue-again
Apr 12, 2021
Merged

Add SPARK_LOCAL_IP in cross version tests config#4237
harupy merged 5 commits intomlflow:masterfrom
harupy:fix-spark-port-issue-again

Conversation

@harupy
Copy link
Copy Markdown
Member

@harupy harupy commented Apr 11, 2021

Signed-off-by: harupy 17039389+harupy@users.noreply.github.com

What changes are proposed in this pull request?

Add SPARK_LOCAL_IP in the cross version tests config.

The cross version tests for keras have been failing:
https://github.com/mlflow/mlflow/actions/runs/737661908

How is this patch tested?

Existing unit tests

Release Notes

Is this a user-facing change?

  • No. You can skip the rest of this section.
  • Yes. Give a description of this change to be included in the release notes for MLflow users.

(Details in 1-2 sentences. You can just refer to another PR with a description if this PR is part of a larger change.)

What component(s), interfaces, languages, and integrations does this PR affect?

Components

  • area/artifacts: Artifact stores and artifact logging
  • area/build: Build and test infrastructure for MLflow
  • area/docs: MLflow documentation pages
  • area/examples: Example code
  • area/model-registry: Model Registry service, APIs, and the fluent client calls for Model Registry
  • area/models: MLmodel format, model serialization/deserialization, flavors
  • area/projects: MLproject format, project running backends
  • area/scoring: Local serving, model deployment tools, spark UDFs
  • area/server-infra: MLflow server, JavaScript dev server
  • area/tracking: Tracking Service, tracking client APIs, autologging

Interface

  • area/uiux: Front-end, user experience, JavaScript, plotting
  • area/docker: Docker use across MLflow's components, such as MLflow Projects and MLflow Models
  • area/sqlalchemy: Use of SQLAlchemy in the Tracking Service or Model Registry
  • area/windows: Windows support

Language

  • language/r: R APIs and clients
  • language/java: Java APIs and clients
  • language/new: Proposals for new client languages

Integrations

  • integrations/azure: Azure and Azure ML integrations
  • integrations/sagemaker: SageMaker integrations
  • integrations/databricks: Databricks integrations

How should the PR be classified in the release notes? Choose one:

  • rn/breaking-change - The PR will be mentioned in the "Breaking Changes" section
  • rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section
  • rn/feature - A new user-facing feature worth mentioning in the release notes
  • rn/bug-fix - A user-facing bug fix worth mentioning in the release notes
  • rn/documentation - A user-facing documentation change worth mentioning in the release notes

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
@harupy harupy requested a review from WeichenXu123 April 11, 2021 15:22
@github-actions github-actions Bot added the rn/none List under Small Changes in Changelogs. label Apr 11, 2021
harupy added 3 commits April 12, 2021 08:48
Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
Comment thread mlflow/keras.py Outdated
@@ -1,3 +1,4 @@
# Revert this
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added this line to trigger the keras tests. I'll revert this once I confrim setting SPARK_LOCAL_IP make them stable.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Confirmed that they are stable now:

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
Copy link
Copy Markdown
Collaborator

@WeichenXu123 WeichenXu123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@harupy harupy merged commit 72099f7 into mlflow:master Apr 12, 2021
@harupy harupy deleted the fix-spark-port-issue-again branch April 12, 2021 01:27
harupy added a commit to wamartin-aml/mlflow that referenced this pull request Jun 7, 2021
* Add SPARK_LOCAL_IP in cross version tests config

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* add dummy change to trigger test

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* attempt2

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* attempt3

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>

* revert dummy change

Signed-off-by: harupy <17039389+harupy@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

rn/none List under Small Changes in Changelogs.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants