Otherwise they will pollute PlotArea._selectors, it's best to get rid of them. This is especially the case with mesmerize-viz for the cnmf viz, it's better to add a new LineSelector each time.

This sorta depends on #172 so they can easily be managed by PlotArea