I recently stumbled upon this issue, I needed to clone a CalibratedClassifierCV object when the latter is defined on top on a pre-fit (cv="prefit") base estimator. Unfortunately, because of the semantic of the clone interface, this cannot be achieved without "unfitting" the pre-fit base estimator.

I think this is somehow related to @jnothman long standing frozen estimator discussion.