Skip to content

Conversation

@elfeck
Copy link
Contributor

@elfeck elfeck commented Mar 28, 2019

Hello SG++ developers,

this PR intends to add functionality to the UniversalMiner within the datamining pipeline such that a complete "out-of-the-box", JSON-config-only exectuable can be used.

All examples for the datamining pipeline should then be transitioned to only supply the JSON config and use the same UniversalMiner executable.

Questions:

  • How can we unify hpo and non-hpo configs. Currently MinerFactory treats these two options very differently
  • There are examples that do not create a learner at all but show off different features of the pipeline, e.g. dataMatrixDatabase.cpp or DataMatrixDatabaseFromConfigFile.cpp. What to do with these?
  • Similar to hpo, how to treat this new parallel stuff and how to integrate it with UniversalMiner
  • Renaming of many .json files to be more descriptive and pleasant to work with

Notes to self:

  • In builder/DEMinerFactory the buildHPO function is overwritten with a custom version but not in LSQ (and now classification). Investigate why
  • Investigate if any special adjustments need to be made for HPO and fitter type classification

@krsgpp

nico roesel added 30 commits December 3, 2018 18:38
…arser, added AnisotropicFullGrid as supported Gridtype in ModelFittingBase
@elfeck
Copy link
Contributor Author

elfeck commented Jun 2, 2019

Proposal: New available example configurations:

  • Basic Regression
  • Basic Classification
  • Basic DE
  • Geometry Aware
  • HPO
  • Parallel

Additionally the database configuration which is not a datamining pipeline config.

@elfeck
Copy link
Contributor Author

elfeck commented Jun 12, 2019

The latest commit adds a 7x7 downsized mnist dataset of 200 data points. Adds 100KB to the datasets directory. Gives decent results with the geometryAwareClassification config.

To do and missing:

  • parallel test to make sure it works as intended
  • HPO test ~

@elfeck elfeck closed this Jun 13, 2019
@elfeck elfeck mentioned this pull request Jun 13, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

4 participants