This is a problem for nodes that aren't caught up - they will receive evidence for blocks they don't have yet, think the evidence is invalid, and thus disconnect the peer: https://github.com/tendermint/tendermint/blob/master/evidence/reactor.go#L99
Maybe we need to limit this behaviour during fast sync ?
Might be related to #1623