Lazy loading datasets: Change default chunk size?

[isimonsm]

Hello!
I am currently using the feature you described in this issue to handle loading large files from our server:
#4 (comment)

The lazy loading works great, but currently datasets are always loaded in chunks of 1MB, which affects the performance greatly on large datasets. Is there any way to change the chunk size? I tried to find a solution in your documentation and in emscripten, but cannot find any mention on how to control this.
Thank you for this great library btw!

[bmaranville]

The chunk size is hardcoded in the Emscripten source here: https://github.com/emscripten-core/emscripten/blob/main/src/library_fs.js#L1714

As an alternative, you could use this if you like - it allows you to specify the chunk size at initialization time. It is based on the Emscripten code (through the SQL.js version of the lazyFile loader) https://github.com/bmaranville/lazyFileLRU

[bmaranville]

You could also modify the library_fs.js file yourself, and load your custom lazyFile implmentation with your page - the virtual FS initializer can be hooked into the FS object after the webassembly is loaded (that is how the lazyFileLRU code works, too)

[isimonsm]

Thank you for the quick answer, the lazyFileLRU implementation worked for me.