As discussed with @spalger, the include/exclude pattern will actually work with numeric fields, although currently in Visualize, it is hidden unless the field being aggregated is a string.