Is your feature request related to a problem? Please describe.
Currently, we have no way to easily deduplicate data.

Describe the solution you'd like
I'd like to see an equivalent of bash's uniq, or sort -u [1]

Describe alternatives you've considered
Super complex filters, while impractical, should be able to "work around" this issue for the time being...