Skip to content

[MRG+1] add scorer based on explained_variance_score#9259

Merged
lesteve merged 4 commits intoscikit-learn:masterfrom
qinhanmin2014:my-feature-3
Aug 8, 2017
Merged

[MRG+1] add scorer based on explained_variance_score#9259
lesteve merged 4 commits intoscikit-learn:masterfrom
qinhanmin2014:my-feature-3

Conversation

@qinhanmin2014
Copy link
Copy Markdown
Member

@qinhanmin2014 qinhanmin2014 commented Jul 1, 2017 •
edited
Loading

Reference Issue

Finish up #9183
proposed by @jnothman

What does this implement/fix? Explain your changes.

I change the regressor used in the test because the result of the regressor is so bad that make the test fail.

Any other comments?

irrelevant test failure due to #9254

@qinhanmin2014 qinhanmin2014 changed the title [MRG] add scorer based on explained_variance_score [WIP] add scorer based on explained_variance_score Jul 1, 2017
@qinhanmin2014 qinhanmin2014 changed the title [WIP] add scorer based on explained_variance_score [MRG] add scorer based on explained_variance_score Jul 1, 2017
@qinhanmin2014 qinhanmin2014 mentioned this pull request Jul 1, 2017
Closed
jnothman
jnothman approved these changes Jul 2, 2017
View reviewed changes
doc/modules/model_evaluation.rst Outdated
'v_measure_score' :func:`metrics.v_measure_score`

**Regression**
'explained_variance_score' :func:`metrics.explained_variance_score`
Copy link
Copy Markdown
Member

@jnothman jnothman Jul 2, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't usually use _score here.

sklearn/metrics/tests/test_score_objects.py
def _make_estimators(X_train, y_train, y_ml_train):
# Make estimators that make sense to test various scoring methods
sensible_regr = DummyRegressor(strategy='median')
sensible_regr = DecisionTreeRegressor(random_state=0)
Copy link
Copy Markdown
Member

@jnothman jnothman Jul 2, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how much longer does the test take?

Copy link
Copy Markdown
Member Author

@qinhanmin2014 qinhanmin2014 Jul 2, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jnothman Thanks. After modification, the test takes around 0.1s on my PC, only slightly longer than before. In Travis, the test is not among the most time consuming tests. For the default parameter of random forest, n_estimators(10) is small, considering the number of training samples(100) is also small, the execution time seems to be acceptable.

@qinhanmin2014
Copy link
Copy Markdown
Member Author

qinhanmin2014 commented Jul 2, 2017

@jnothman Thanks. Corrected.

@qinhanmin2014
Copy link
Copy Markdown
Member Author

qinhanmin2014 commented Aug 6, 2017

ping @jnothman
Could you please give a further review? Thanks.

@jnothman
Copy link
Copy Markdown
Member

jnothman commented Aug 6, 2017

LGTM

@jnothman jnothman changed the title [MRG] add scorer based on explained_variance_score [MRG+1] add scorer based on explained_variance_score Aug 6, 2017
@qinhanmin2014
Copy link
Copy Markdown
Member Author

qinhanmin2014 commented Aug 6, 2017

ping @lesteve @amueller
Could you kindly please have a look at it? (already [MRG+1])

@lesteve
Copy link
Copy Markdown
Member

lesteve commented Aug 7, 2017 •
edited
Loading

Can you add an entry in doc/whats_new.rst? Otherwise LGTM.

@qinhanmin2014
Copy link
Copy Markdown
Member Author

qinhanmin2014 commented Aug 8, 2017

@jnothman @lesteve Thanks. What's new updated. CIs are green.

@lesteve
Copy link
Copy Markdown
Member

lesteve commented Aug 8, 2017

LGTM, merging, thanks a lot!

@lesteve lesteve merged commit 9f91ec7 into scikit-learn:master Aug 8, 2017
@jnothman jnothman mentioned this pull request Aug 8, 2017
Merged
jnothman pushed a commit to jnothman/scikit-learn that referenced this pull request Aug 8, 2017
@qinhanmin2014 @jnothman
[MRG+1] add scorer based on explained_variance_score (scikit-learn#9259)
fd2e0f7
yarikoptic added a commit to yarikoptic/scikit-learn that referenced this pull request Aug 12, 2017
@yarikoptic
Merge tag '0.19.0' into releases
445af38 
Release 0.19.0

* tag '0.19.0': (99 commits)
  DOC one more version issue in doc
  skip docstring tests because not useful to users and has some issues
  deprecation of n_components happened in 0.19 not 0.18 (scikit-learn#9527)
  sync whatsnew with master so I'm less confused
  DOC more navigation links
  DOC a note on data leakage and pipeline (scikit-learn#9510)
  DOC set release date to Friday
  DOC Update news and menu for 0.19 release
  DOC list of contributors to 0.19
  DOC Change release date to Thursday
  DOC Remove some whitespace from what's new
  Update what's new for recent changes
  Use base.is_classifier instead instead of isinstance (scikit-learn#9482)
  Fix safe_indexing with read-only indices (scikit-learn#9507)
  [MRG+1] add scorer based on explained_variance_score (scikit-learn#9259)
  fix wrong assert in test_validation (scikit-learn#9480)
  [MRG+1] FIX Add missing mixins to ClassifierChain (scikit-learn#9473)
  Bring last code block in line with the image. (scikit-learn#9488)
  FIX Pass sample_weight as kwargs in VotingClassifier (scikit-learn#9493)
  FIX Incorrent implementation of noise_variance_ in PCA._fit_truncated (scikit-learn#9108)
  ...
yarikoptic added a commit to yarikoptic/scikit-learn that referenced this pull request Aug 12, 2017
@yarikoptic
Merge branch 'releases' into dfsg
8f9558b 
* releases: (99 commits)
  DOC one more version issue in doc
  skip docstring tests because not useful to users and has some issues
  deprecation of n_components happened in 0.19 not 0.18 (scikit-learn#9527)
  sync whatsnew with master so I'm less confused
  DOC more navigation links
  DOC a note on data leakage and pipeline (scikit-learn#9510)
  DOC set release date to Friday
  DOC Update news and menu for 0.19 release
  DOC list of contributors to 0.19
  DOC Change release date to Thursday
  DOC Remove some whitespace from what's new
  Update what's new for recent changes
  Use base.is_classifier instead instead of isinstance (scikit-learn#9482)
  Fix safe_indexing with read-only indices (scikit-learn#9507)
  [MRG+1] add scorer based on explained_variance_score (scikit-learn#9259)
  fix wrong assert in test_validation (scikit-learn#9480)
  [MRG+1] FIX Add missing mixins to ClassifierChain (scikit-learn#9473)
  Bring last code block in line with the image. (scikit-learn#9488)
  FIX Pass sample_weight as kwargs in VotingClassifier (scikit-learn#9493)
  FIX Incorrent implementation of noise_variance_ in PCA._fit_truncated (scikit-learn#9108)
  ...
yarikoptic added a commit to yarikoptic/scikit-learn that referenced this pull request Aug 12, 2017
@yarikoptic
Merge branch 'dfsg' into debian
c9e232e 
* dfsg: (99 commits)
  DOC one more version issue in doc
  skip docstring tests because not useful to users and has some issues
  deprecation of n_components happened in 0.19 not 0.18 (scikit-learn#9527)
  sync whatsnew with master so I'm less confused
  DOC more navigation links
  DOC a note on data leakage and pipeline (scikit-learn#9510)
  DOC set release date to Friday
  DOC Update news and menu for 0.19 release
  DOC list of contributors to 0.19
  DOC Change release date to Thursday
  DOC Remove some whitespace from what's new
  Update what's new for recent changes
  Use base.is_classifier instead instead of isinstance (scikit-learn#9482)
  Fix safe_indexing with read-only indices (scikit-learn#9507)
  [MRG+1] add scorer based on explained_variance_score (scikit-learn#9259)
  fix wrong assert in test_validation (scikit-learn#9480)
  [MRG+1] FIX Add missing mixins to ClassifierChain (scikit-learn#9473)
  Bring last code block in line with the image. (scikit-learn#9488)
  FIX Pass sample_weight as kwargs in VotingClassifier (scikit-learn#9493)
  FIX Incorrent implementation of noise_variance_ in PCA._fit_truncated (scikit-learn#9108)
  ...
paulha pushed a commit to paulha/scikit-learn that referenced this pull request Aug 19, 2017
@qinhanmin2014 @paulha
[MRG+1] add scorer based on explained_variance_score (scikit-learn#9259)
22d05e6
AishwaryaRK pushed a commit to AishwaryaRK/scikit-learn that referenced this pull request Aug 29, 2017
@qinhanmin2014 @AishwaryaRK
[MRG+1] add scorer based on explained_variance_score (scikit-learn#9259)
3d301db
maskani-moh pushed a commit to maskani-moh/scikit-learn that referenced this pull request Nov 15, 2017
@qinhanmin2014 @maskani-moh
[MRG+1] add scorer based on explained_variance_score (scikit-learn#9259)
bf07f67
jwjohnson314 pushed a commit to jwjohnson314/scikit-learn that referenced this pull request Dec 18, 2017
@qinhanmin2014
[MRG+1] add scorer based on explained_variance_score (scikit-learn#9259)
9e4dfb3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jnothman jnothman jnothman approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@qinhanmin2014 @jnothman @lesteve