Skip to content

Conversation

@davidhassell
Copy link
Contributor

@davidhassell davidhassell commented Jun 20, 2024

Fixes #285 and #286

  • Implements reading of netCDF files with h5netcdf, which also allows files in S3-compatible storage to be read.
  • Implements netcdf_flattener in-house, rather than with an import. The new flattener can flatten files opened with h5netcdf, can flatten all CF references, and is more extensible to future CF references.
  • Creates netcdf_indexer (based on netCDF4 functionality) that allows orthogonal indexing on h5netcdf variables.

davidhassell and others added 22 commits July 23, 2024 16:18
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Co-authored-by: Sadie L. Bartholomew <sadie.bartholomew@ncas.ac.uk>
Copy link
Member

@sadielbartholomew sadielbartholomew left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for addressing all of my feedback. I've done a final sanity check and it is all good. Great stuff, please merge!

@davidhassell
Copy link
Contributor Author

Thanks again for your customary careful and detailed review - merging now ....

@davidhassell davidhassell merged commit 9ceb39e into NCAS-CMS:main Jul 25, 2024
@davidhassell davidhassell modified the milestones: H5, 1.11.2.0 Jan 29, 2025
@davidhassell davidhassell deleted the h5-read branch March 3, 2025 10:48
@davidhassell davidhassell linked an issue Mar 3, 2025 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dataset read Relating to reading datasets enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Refactor the flattening of netCDF-4 groups Allow access to netCDF-4 files in S3 object stores

2 participants