Skip to content

Updates for make_derived_metric#649

Merged
riedgar-ms merged 12 commits intofairlearn:masterfrom
riedgar-ms:riedgar-ms/tweak-make-derived-metric
Dec 11, 2020
Merged

Updates for make_derived_metric#649
riedgar-ms merged 12 commits intofairlearn:masterfrom
riedgar-ms:riedgar-ms/tweak-make-derived-metric

Conversation

@riedgar-ms
Copy link
Copy Markdown
Member

@riedgar-ms riedgar-ms commented Dec 3, 2020

I had overlooked some comments on the previous PR for make_derived_metric(). This is to address those points.

The largest change is to the data preprocessing, which has been adjusted to avoid the problem of Data Leakage between the training and test sets (credit to @adrinjalali for the actual Pipeline code). This fix has been ported to the other metrics example.

Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
@adrinjalali
Copy link
Copy Markdown
Member

It was easier for me to implement the changes in a PR @riedgar-ms , which you can see here: https://github.com/riedgar-ms/fairlearn/pull/1

adrinjalali and others added 4 commits December 9, 2020 16:30
Convert to use an `sklearn` pipeline for the data processing.

Signed-off-by: adrinjalali <adrin.jalali@gmail.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Signed-off-by: Richard Edgar <riedgar@microsoft.com>
Copy link
Copy Markdown
Member

@adrinjalali adrinjalali left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @riedgar-ms , LGTM.

@adrinjalali
Copy link
Copy Markdown
Member

woohoo, two approvals, merging :)

@adrinjalali
Copy link
Copy Markdown
Member

oh, I can't lol

@riedgar-ms
Copy link
Copy Markdown
Member Author

oh, I can't lol

That's for our ToDo list - make sure you have the right permissions @adrinjalali (and @hildeweerts too). Although in this case, since there's a DCO mess up (I think I did this when I squashed the PR you made against my fork, rather than just merging it), it might take owner permissions. At least until we kill off DCO....

@riedgar-ms riedgar-ms merged commit e61cfc9 into fairlearn:master Dec 11, 2020
@riedgar-ms riedgar-ms deleted the riedgar-ms/tweak-make-derived-metric branch December 11, 2020 11:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants