Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve compaction #132

Open
ambud opened this issue May 16, 2018 · 1 comment
Open

Improve compaction #132

ambud opened this issue May 16, 2018 · 1 comment

Comments

@ambud
Copy link
Member

ambud commented May 16, 2018

Compaction right now is a bit sensitive to running large number of buffer re-writes. Compaction's goal is to reduce the data size and reduce writer list sizes that saves heap and allows deletion of older files.

Enhancement would allow Sidewinder to reduce heap utilization while preventing dangling old data files that still require memory mapping.

@pauljv92
Copy link

pauljv92 commented Aug 1, 2018

while autocorrelation w GPU takes it own sweet time, Im down to look at this! :) pls help to point me to the code I should be looking at

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants