Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

On the use of reduced precision #63

Open
martinjuckes opened this issue Oct 29, 2020 · 0 comments
Open

On the use of reduced precision #63

martinjuckes opened this issue Oct 29, 2020 · 0 comments

Comments

@martinjuckes
Copy link
Contributor

Matt
Not directly related to FORTRAN types; I wonder if there is capacity here for considering stored precision of the data we have. There are studies considering the benefits of lossy compression, e.g. Zender (doi:10.5194/gmd-2016-63), Baker et al (doi:10.5194/gmd-9-4381-2016), , and being able to specify variables are held with limited precision enough could lead to significant savings in storage costs.

Martin N Juckes
I can put in something to specify what the precision is -- but the biggest problem is trying to decide on any reduction. There are some issues around diagnosing what is going on in the model. E.g. data may have a lot of noise in which has no physical meaning but gives clues about what is going on in the model ... perhaps we don't care about that sort of data in CMIP? Getting a lossy compression algorithm into the NetCDF library would make it a lot easier.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant