This is because opening a CSV imports into the temporary in-memory database, and installing a plugin restarts the server.
Could maybe keep track of which CSVs have been opened and re-import them after a restart of the server within the current application session?
Might not be worth fixing this.