Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make checkpoint files read/write operations faster #159

Open
bersler opened this issue Jul 14, 2024 · 0 comments
Open

Make checkpoint files read/write operations faster #159

bersler opened this issue Jul 14, 2024 · 0 comments
Labels
enhancement New feature or request Low priority Low priority issues

Comments

@bersler
Copy link
Owner

bersler commented Jul 14, 2024

Is your feature request related to a problem? Please describe.
When the schema is very big, the checkpoint file with schema might reach big values. Writing and loading JSON files might be slow.

Describe the solution you'd like
Increase speed of reading and writing JSON files or use a different faster format.

Describe alternatives you've considered
If the checkpoint file is very big, the operation of writing it can be made faster by increasing the interval when the 'interval-mb' and 'interval-s' values. This would force the checkpoint files creation to be done less often.
There is currently no workaround to make faster startup, where the checkpoint file is too big.

Additional context
A different format might be considered to be used.

@bersler bersler added enhancement New feature or request Low priority Low priority issues labels Jul 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Low priority Low priority issues
Projects
None yet
Development

No branches or pull requests

1 participant