Just took the update to 26100, and all by windows and tabs did get restored! But it was all the windows and tabs that were persisted the previous time. I had since closed a bunch of tabs - all those came back. And I didn't have buffer history for any of them. (I haven't quit the terminal manually, so that kinda tracks. I've only had it closed for updates).
I hope this is repro-able outside of the update scenario 😨