Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mandatory data_revision on all obs-readers, disable last-file check in caching #1244

Open
2 tasks
heikoklein opened this issue Jul 5, 2024 · 0 comments
Open
2 tasks
Labels
enhancement New feature or request
Milestone

Comments

@heikoklein
Copy link
Member

Is your feature request related to a problem? Please describe.
Caching of ungridded data relies on both data_revision and newest_file_in_read_dir, see #1242 . The newest_file_in_read_dir test is error prone since a touch or another minor filesystem operation will invalidate the cache, in addition it can be very slow, e.g. for the EEA-reader. If observation-readers deliver their own mandatory data_revision, the too general test can be removed.

Describe the solution you would like to see

@heikoklein heikoklein added the enhancement New feature or request label Jul 5, 2024
@heikoklein heikoklein added this to the m2024-09 milestone Jul 5, 2024
@heikoklein heikoklein modified the milestones: m2024-09, m2024-10 Sep 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant