Shorts can't be removed from the history. It would be nice if there were an “X” or a trash can icon, like there is for songs and videos, that could be used to delete them.