This seems like something we should maybe commit to as part of Base's API. See the discussion here: JuliaStats/Klara.jl#24 as an example of the kind of thing you want this for.