I've noticed that the annotation line is somehow z-indexed on the Canvas higher than the hover tooltips for the normal Chart.js line tooltips.