Avoid almost white colors in plots with spatial_colors=True

As mentioned in #6678, spatial colors are sometimes almost white and therefore very hard to see. I think we should restrict these colors from getting almost white.