Implement Bulk Loading/Writing for Chunks#535

Open

Mili-ssm wants to merge 101 commits intoPumpkin-MC:masterfrom Mili-ssm:chunk_bulk_api_v2

+1,942-1,574

Commits on Jan 24, 2025

Commits on Jan 25, 2025

refactor: improve clarity on validation methods
Mili
committed
fix: invert version check in LinearFile header validation
Mili
committed
fix: remove leading dot from file path formatting in LinearChunkFormat
Mili
committed
refactor: improve error handling and method naming in LinearFile operations
Mili
committed
fix: ensure file is flushed after writing in LinearFile operations
Mili
committed
fix: lints and warnings
Mili
committed
fix: more lints
Mili
committed
refactor: streamline LinearFile structure and improve header management
Mili
committed
refactor: change chunks_headers to use Box for improved memory management and use exception to know if file exist
Mili
committed
refactor: update path parameter types to PathBuf for consistency and improved usability
Mili
committed
refactor: update path parameter types to Path avoiding uknown changes and adjust file truncation logic
Mili
committed

Commits on Jan 26, 2025

Commits on Jan 27, 2025

Commits on Jan 28, 2025

feat: add error logging for invalid file headers and data size checks in LinearFile and tmp filenames on write
Mili
committed

Commits on Jan 29, 2025

Commits on Jan 30, 2025

feat: (Bulk API) refactor chunk reading and writing to handle multiple chunks at once
Mili
committed

Commits on Jan 31, 2025

refactor: streamline chunk reading and writing methods, improve chunk management logic
Mili
committed

Commits on Feb 1, 2025

feat: enhance chunk reading and writing to support bulk and improve concurrency
Mili
committed

Commits on Feb 5, 2025

feat: add file locking during chunk writing to ensure safe concurrent access
Mili
committed

Commits on Feb 6, 2025

Commits on Feb 9, 2025

Commits on Feb 10, 2025

Commits on Feb 13, 2025

Commits on Feb 17, 2025

Merge branch 'master' into chunk_bulk_api_v2
Mili-ssm
authored

Commits on Feb 19, 2025

fix logging issue and refactor some locks bindings
Mili
committed

Commits on Feb 21, 2025

Commits on Feb 22, 2025

Commits on Feb 24, 2025

Commits on Feb 25, 2025

Commits on Feb 27, 2025

Commits on Mar 1, 2025

Commits on Mar 2, 2025

Commits on Mar 3, 2025