I noticed this while testing #5263 - if you open the settings alongside an editor and change them, the closing labels don't update correctly. They also appear/disappear inconsistently when an editor is not visible or active.
We should try to remove the use of vs.window.activeTextEditor in the closing labels (and perhaps other files that work the same as this, like UI guides?) and instead just handle all vs.window.visibleTextEditors instead.