Via @mrdoob, once the PMREM is generated, we'll need to update the mag filter:

texture.magFilter = THREE.LinearFilter;
texture.needsUpdate = true;