-
Notifications
You must be signed in to change notification settings - Fork 8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add separate epi_archive constructor based on a "iterator"/list/df of snapshots #173
Comments
We can be a lot more memory-friendly than an in-memory list/df of snapshots, by only reading in one / a few snapshots at a time, and compactifying along the way (plus suggesting to save the compactified version on disk if we compactified a lot, or more complicated things regarding proposed "updating" archives that are out of scope for this initial feature). |
Status: I have the iterator stuff ready in a separate repo + a version of a |
See #172 for background. This would work around some of the caveats noted there by:
next_after(version)
was provided. If not, insert a snapshot revising all observations to NA with this version tag (next_after(version)
). ---- This is pretty inefficient space-wise. Maybe we would want to do something with the design of epi_archive to make more efficient options available.The text was updated successfully, but these errors were encountered: