Skip to content

TSC/TSR: evaluation functionality and interface to losses/metrics #3

@fkiraly

Description

@fkiraly

implementation of rudimentary evaluation functionality, should include:

  • computation of methods' predictions on test set, after training on training set
  • computation of common average and aggregate losses/scores for classification and regression
  • interface to metrics/scoring functionality as in sklearn
  • at first, preliminary design of the above

Note: not full-blown orchestration and experiment management

Conditional on #2 since calls the estimator interface which needs to be consolidated first.

Metadata

Metadata

Labels

implementing frameworkImplementing or improving framework for learning tasks, e.g., base class functionality

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions