Code

Player join optimizations#584

Code

Closed

suprohub wants to merge 69 commits intoPumpkin-MC:masterPumpkin-MC/Pumpkin:masterfrom suprohub:player-optimizesuprohub/Pumpkin:player-optimizeCopy head branch name to clipboard

+1,887-1,467

Commits

Commits on Jan 24, 2025

• feat: add linear chunk format with zstd lib dependency

  

  Mili

  committed
  d5f3797

  Copy full SHA for d5f3797

• fixing a typo

  

  Mili

  committed
  65f1904

  Copy full SHA for 65f1904

• Merge remote-tracking branch 'upstream/master' into linear_chunk_format

  

  Mili

  committed
  9517837

  Copy full SHA for 9517837

• refactor: rename file handling methods for clarity and more lint fixes

  

  Mili

  committed
  a02003f

  Copy full SHA for a02003f

Commits on Jan 25, 2025

• refactor: improve clarity on validation methods

  

  Mili

  committed
  9f85aa6

  Copy full SHA for 9f85aa6

• fix: invert version check in LinearFile header validation

  

  Mili

  committed
  28e1222

  Copy full SHA for 28e1222

• fix: remove leading dot from file path formatting in LinearChunkFormat

  

  Mili

  committed
  c9f6a7e

  Copy full SHA for c9f6a7e

• refactor: improve error handling and method naming in LinearFile operations

  

  Mili

  committed
  a1cbe33

  Copy full SHA for a1cbe33

• fix: ensure file is flushed after writing in LinearFile operations

  

  Mili

  committed
  f2d51fd

  Copy full SHA for f2d51fd

• fix: lints and warnings

  

  Mili

  committed
  2f8c589

  Copy full SHA for 2f8c589

• fix: more lints

  

  Mili

  committed
  63a73a9

  Copy full SHA for 63a73a9

• refactor: streamline LinearFile structure and improve header management

  

  Mili

  committed
  8f8ef47

  Copy full SHA for 8f8ef47

• refactor: change chunks_headers to use Box for improved memory management and use exception to know if file exist

  

  Mili

  committed
  21c46e4

  Copy full SHA for 21c46e4

• refactor: update path parameter types to PathBuf for consistency and improved usability

  

  Mili

  committed
  9308469

  Copy full SHA for 9308469

• refactor: update path parameter types to Path avoiding uknown changes and adjust file truncation logic

  

  Mili

  committed
  48a2883

  Copy full SHA for 48a2883

Commits on Jan 26, 2025

• fix: avoid using the same path for different tests

  

  Mili

  committed
  7563a81

  Copy full SHA for 7563a81

• fix: fix some bytes sizes for the header based on the spec

  

  Mili

  committed
  34604ea

  Copy full SHA for 34604ea

• refactor: enable file truncation when opening for writing and simplify save method

  

  Mili

  committed
  c14ee64

  Copy full SHA for c14ee64

• fix: removing IoSlices for windows issues.

  

  Mili

  committed
  f5405b2

  Copy full SHA for f5405b2

• fix: clippy lints

  

  Mili

  committed
  0ca59aa

  Copy full SHA for 0ca59aa

Commits on Jan 27, 2025

• refactor: improve incompatible files cheking, some documentation and variable nameing

  

  Mili

  committed
  fc543cf

  Copy full SHA for fc543cf

• feat: add file_format to ChunkConfig and implement format handling in Level

  

  Mili

  committed
  3612b71

  Copy full SHA for 3612b71

• Merge branch 'master' into linear_chunk_format

  Mili-ssm

  authored
  9340bbc

  Copy full SHA for 9340bbc

Commits on Jan 28, 2025

• feat: add error logging for invalid file headers and data size checks in LinearFile and tmp filenames on write

  

  Mili

  committed
  3404700

  Copy full SHA for 3404700

Commits on Jan 29, 2025

• feat: implement file locking mechanism for concurrent chunk read/write operations

  

  Mili

  committed
  1953773

  Copy full SHA for 1953773

• fix: bug at desserializing the chunks headers.

  

  Mili

  committed
  c89bbc7

  Copy full SHA for c89bbc7

Commits on Jan 30, 2025

• feat: (Bulk API) refactor chunk reading and writing to handle multiple chunks at once

  

  Mili

  committed
  5c8f799

  Copy full SHA for 5c8f799

Commits on Jan 31, 2025

• refactor: streamline chunk reading and writing methods, improve chunk management logic

  

  Mili

  committed
  293886e

  Copy full SHA for 293886e

Commits on Feb 1, 2025

• feat: enhance chunk reading and writing to support bulk and improve concurrency

  

  Mili

  committed
  7c89480

  Copy full SHA for 7c89480

Commits on Feb 5, 2025

• feat: add file locking during chunk writing to ensure safe concurrent access

  

  Mili

  committed
  f469867

  Copy full SHA for f469867

Commits on Feb 6, 2025

• Merge branch 'chunk_bulk_api' into chunk_bulk_api_v2

  Mili-ssm

  authored
  d768b3d

  Copy full SHA for d768b3d

• fix: resolve some issues with the merge

  

  Mili

  committed
  5782014

  Copy full SHA for 5782014

• fix: update chunk header size calculation in linear chunk parsing

  

  Mili

  committed
  0b48790

  Copy full SHA for 0b48790

• refactor: optimize chunk processing and improve concurrency handling

  

  Mili

  committed
  4c57d85

  Copy full SHA for 4c57d85

Commits on Feb 9, 2025

• feat: implement chunk I/O management with file locking for safe concurrent access

  

  Mili

  committed
  6f0bf27

  Copy full SHA for 6f0bf27

• Merge remote-tracking branch 'upstream/master' into chunk_bulk_api_v2

  

  Mili

  committed
  44cd9eb

  Copy full SHA for 44cd9eb

• refactor: simplify public load method and fix clippy issues

  

  Mili

  committed
  ab110ae

  Copy full SHA for ab110ae

Commits on Feb 10, 2025

• feature: add file cache for files with ongoing IO ops

  

  Mili

  committed
  3616e7e

  Copy full SHA for 3616e7e

• refactor: update LoadedData enum variants for consistency and clarity and include docs.

  

  Mili

  committed
  239e2c1

  Copy full SHA for 239e2c1

• refactor: restore compression enum and replace ChunkSerializingError with ChunkWritingError for improved error handling

  

  Mili

  committed
  d29e90f

  Copy full SHA for d29e90f

• refactor: enhance chunk cache cleaning logic and improve logging during chunk fetching

  

  Mili

  committed
  40d70ca

  Copy full SHA for 40d70ca

Commits on Feb 13, 2025

• refactor: optimize chunk data handling with parallel processing and improve chunk fetching logic

  

  Mili

  committed
  3c1d91a

  Copy full SHA for 3c1d91a

• fix: lints and logging

  

  Mili

  committed
  32496b0

  Copy full SHA for 32496b0

• fix: correct typo and import format

  

  Mili

  committed
  58ce0c6

  Copy full SHA for 58ce0c6

• refactor: anvil code organization and llinear chunk reading code.

  

  Mili

  committed
  709efb3

  Copy full SHA for 709efb3

Commits on Feb 17, 2025

• Merge branch 'master' into chunk_bulk_api_v2

  Mili-ssm

  authored
  d1acce2

  Copy full SHA for d1acce2

Commits on Feb 19, 2025

• fix logging issue and refactor some locks bindings

  

  Mili

  committed
  5b46f40

  Copy full SHA for 5b46f40

Commits on Feb 20, 2025

• refactor: reduce chunk cloning, ensure drop bindings/guards

  

  Mili

  committed
  66c31f0

  Copy full SHA for 66c31f0

• Merge remote-tracking branch 'upstream/master' into chunk_bulk_api_v2

  

  Mili

  committed
  2ced481

  Copy full SHA for 2ced481

• refactor: reduce some threading overhead when not needed

  

  Mili

  committed
  f3bfb48

  Copy full SHA for f3bfb48

• fix: clippy lints

  

  Mili

  committed
  9a5c4d7

  Copy full SHA for 9a5c4d7

• refactor: simplify chunk data processing in Anvil and Linear serializers

  

  Mili

  committed
  8cd5352

  Copy full SHA for 8cd5352

• Merge remote-tracking branch 'upstream/master' into chunk_bulk_api_v2

  

  Mili

  committed
  f77625c

  Copy full SHA for f77625c

• fix: clippy lints rust 1.84.1 to 1.85.0

  

  Mili

  committed
  7855381

  Copy full SHA for 7855381

Commits on Feb 21, 2025

• add file drop guard and rework some logic

  kralverde

  committed
  e46956b

  Copy full SHA for e46956b

• refactor: improve AnvilChunkFile and AnvilChunkData serialization logic and docs

  

  Mili

  committed
  373b4bb

  Copy full SHA for 373b4bb

• fix: typos

  

  Mili

  committed
  4e34235

  Copy full SHA for 4e34235

• Merge pull request Pumpkin-MC#2 from kralverde/bulk_chunk

  Show description for cab6493
  Mili-ssm

  authored
  cab6493

  Copy full SHA for cab6493

Commits on Feb 22, 2025

• feature: initial async implementation of Bulk API

  

  Mili

  committed
  fb271f9

  Copy full SHA for fb271f9

• fix: chunk writing with async read

  Mili-ssm

  authored
  40e4c34

  Copy full SHA for 40e4c34

• refactor: improve async handling and use asyn IO for reading files

  

  Mili

  committed
  2fa6e6d

  Copy full SHA for 2fa6e6d

• fix: sorry i delet a mod xd

  

  Mili

  committed
  002aac2

  Copy full SHA for 002aac2

• refactor: enhance chunk management with async locks and OneCells

  

  Mili

  committed
  08e0704

  Copy full SHA for 08e0704

Commits on Feb 23, 2025

• use async methods where avaliable and stream chunks instead of collecting them

  kralverde

  committed
  c927364

  Copy full SHA for c927364

• Merge pull request Pumpkin-MC#4 from kralverde/chunk_batching_3

  Show description for b4563a3
  Mili-ssm

  authored
  b4563a3

  Copy full SHA for b4563a3

• refactor: streamline chunk management by removing unnecessary mutex and optimizing cache cleanup

  

  Mili

  committed
  d1fdb9c

  Copy full SHA for d1fdb9c

• Split data

  suprohub

  committed
  9e4e24f

  Copy full SHA for 9e4e24f

• Move format related stuff from chunk

  suprohub

  committed
  2d4e7f8

  Copy full SHA for 2d4e7f8

• First optimizations

  suprohub

  committed
  ead910c

  Copy full SHA for ead910c