According to the glTF KHR_materials_specular specification, specularFactor can work together with specularTexture and specularColorTexture. Right now if there are maps the specularFactor constant does not make it to the shader and is ignored even if the value is not 1.

Comparison with other engines that account for it: