Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How do I change the batch size? #225

Open
djensen47 opened this issue Oct 28, 2018 · 2 comments
Open

How do I change the batch size? #225

djensen47 opened this issue Oct 28, 2018 · 2 comments
Assignees

Comments

@djensen47
Copy link

djensen47 commented Oct 28, 2018

It looks like the batch size may not be configurable and it is hardcoded to 600000. But I might be wrong. Is there a way to configure a smaller batch size. I think I have a query that is running long.

@akhoury akhoury self-assigned this Oct 31, 2018
@akhoury
Copy link
Owner

akhoury commented Oct 31, 2018

not yet, but I can add it, if you can't wait, find this file node_module/nodebb-plugin-import/server/exporter/index.js and change these 2 values, see if this helps

var COUNT_BATCH_SIZE = 600000;
var DEFAULT_EXPORT_BATCH_SIZE = 600000;

https://github.com/akhoury/nodebb-plugin-import/blob/master/server/exporter/index.js#L8-L9

@CherryDT
Copy link

Note that there also seems to be a bug where it always skips 1 record after each batch. Change batch + 1 to batch in the same file to fix that (there is only one occurence).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants