I found that ClearModifiedPoints3D() is invoked in the end of IterativeLocalRefinement, https://github.com/colmap/colmap/blob/dcfd14b300868c7eb1b360ebbca0dc21acd641b6/src/colmap/sfm/incremental_mapper.cc#L780 but it is not the same for IterativeGlobalRefinement. https://github.com/colmap/colmap/blob/dcfd14b300868c7eb1b360ebbca0dc21acd641b6/src/colmap/sfm/incremental_mapper.cc#L810 Is it expected or just a bug?