Make preprocessor lazy #674
Description
Overview issue with laziness status of preprocessor functions:
Checked means lazy, unchecked means not lazy or partially lazy, a question mark behind the preprocessor name means that it is unknown whether this preprocessor function is lazy or not.
- fix_file - copies files on disk Avoid copying input data in CMIP6 CESM2 air pressure level fixes #2454
- load
- fix_metadata - depends on model/variable
- fix_data - depends on model/variable
- cmor_check_metadata
- cmor_check_data
- concatenate
- derive - lazy for most variables, see Lazy derive preprocessor function #2451 for exceptions
- extract_time
- extract_season
- extract_month
- resample_hours
- resample_time
- extract_levels
- weighting_landsea_fraction
- mask_landsea
- mask_glaciated
- mask_landseaice
- regrid
- extract_coordinate_points - No, see Make extract_point/extract_location/extract_coordinate_points preprocessor functions lazy #2446
- extract_point - No, see Make extract_point/extract_location/extract_coordinate_points preprocessor functions lazy #2446
- extract_location - No, see Make extract_point/extract_location/extract_coordinate_points preprocessor functions lazy #2446
- mask_multimodel - yes, but reads all data twice
- mask_fillvalues Lazy mask_fillvalues preprocessor function #2340
- mask_above_threshold
- mask_below_threshold
- mask_inside_range
- mask_outside_range
- clip
- rolling_window_statistics - not yet, but will be in iris 3.10, see Lazy
iris.cube.Cube.rolling_windowSciTools/iris#5795 - extract_region
- extract_shape
- extract_volume
- extract_trajectory - no, underlying
iris.analysis.trajectory.interpolatefunction is not lazy - extract_transect
- detrend - no non-lazy version available
- extract_named_regions
- axis_statistics
- depth_integration
- area_statistics
- volume_statistics - Make preprocessor function volume_statistics lazy #647, Performance of volume_statistics #1498
- local_solar_time
- amplitude
- zonal_statistics
- meridional_statistics
- accumulate_coordinate
- hourly_statistics
- daily_statistics
- monthly_statistics
- seasonal_statistics
- annual_statistics
- decadal_statistics
- climate_statistics
- anomalies
- regrid_time
- timeseries_filter - not yet, but will be in iris 3.10, see Lazy
iris.cube.Cube.rolling_windowSciTools/iris#5795 - linear_trend
- linear_trend_stderr
- convert_units
- ensemble_statistics
- multi_model_statistics
- bias
Note that *_statistics preprocessor functions are lazy except for median, workaround is to use operator: percentile; percent: 50 (should be fixed in Iris 3.12 SciTools/iris#6167).
It would be great if we could make more preprocessor functions lazy. The laziness status should also be indicated in the docstrings.
Related to #51