There are two dimensions in which model selection searches can vary:
Does the search...
- use
partial_fit or fit?
- use previous evaluations to choose which models to evaluate?
(adapted from #370 (comment), which is a response to #370 (comment))
I think (1) should be named "incremental" and (2) should be named "adaptive".
Currently, IncrementalSearchCV implements
- a complex adaptive algorithm
- stopping on plateau
- an incremental search that's used with
_incremental.fit.
I'd like to clean the naming of IncrementalSearchCV.