Describe the bug
Configuring useErrorBoundary for a given query doesn't result in the error being thrown for an error boundary to catch it.

To Reproduce
Minimal reproducible example here: https://codesandbox.io/s/condescending-mountain-q8hty

Expected behavior
In the codesandbox above, the error boundary I have defined in src/index.js should render immediately.

Additional context
I'm not familiar with the codebase, but perhaps the culprit lies in !errorResetBoundary.isReset() evaluating as false (see here)