Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to reduce the size of .mgbmp file ? #12

Open
netwenchao opened this issue Nov 7, 2018 · 3 comments
Open

How to reduce the size of .mgbmp file ? #12

netwenchao opened this issue Nov 7, 2018 · 3 comments

Comments

@netwenchao
Copy link

How to reduse the size of .mgbmp file ? RemoveKey only remove key from idx and mark the storageitem in *.mgbmp as deleted.

But the file size has not decreased.
Is there anyway to remove storageitem from raptordb??

@netwenchao netwenchao changed the title How to reduse the size of .mgbmp file ? How to reducethe size of .mgbmp file ? Nov 7, 2018
@netwenchao netwenchao changed the title How to reducethe size of .mgbmp file ? How to reduce the size of .mgbmp file ? Nov 7, 2018
@mgholam
Copy link
Owner

mgholam commented Nov 7, 2018

The bitmap index has an Optimize() method which is currently only being used by the hOOt full text index, I will add this to all other indexes.

No you can't remove a StorageItem as it is by design, if you are working with transient data use the high frequency storage instead.

Thanks.

@netwenchao
Copy link
Author

The bitmap index has an Optimize() method which is currently only being used by the hOOt full text index, I will add this to all other indexes.

No you can't remove a StorageItem as it is by design, if you are working with transient data use the high frequency storage instead.

Thanks.

After the system has been running for a while, the size of the .mgbm file is increasing (currently 7G). I need to periodically delete the old data to reduce the disk space.

But the most recent data needs to be retained. Is there any other way?

@mgholam
Copy link
Owner

mgholam commented Nov 9, 2018

Ah! Interesting.

Can you answer a few questions for me:

  • How many items are in your view?
  • Can you post a "dir" of the view folder contents (with the 7gb index)?
  • How big is the docs folder?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants