Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pagination tests #73

Open
CodyCBakerPhD opened this issue Aug 7, 2024 · 0 comments
Open

Pagination tests #73

CodyCBakerPhD opened this issue Aug 7, 2024 · 0 comments
Assignees

Comments

@CodyCBakerPhD
Copy link
Collaborator

From meeting today

Pagination

From @oruebel, should use the current testing files for consistency

Create paginated copies

Can use the very slow h5repack -i < input NWB file > -o < output NWB file > -S PAGE -G < page size in bytes, but forming whole MiB >

For page size matrix: 2, 4, 8, 16, 32 MiB

Test the read speed of entire file reading (opening) and streaming of contents from its series data

Page buffer and chunk cache

@oruebel Do you know the syntax for handling page buffer and chunk cache?

@rly suggested followup tests for this after page size experiments, but also points out that testing LINDI reading can simplify these aspects even more

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants