When we detect that a page is swiped we should immediately stop issuing new `layoutCallback` invocations for the page that is being swiped. CC @ericfs @dvoytenko @jridgewell