Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up old GFileCache implementation #22253

Merged
merged 1 commit into from
Jul 4, 2024

Conversation

ayaka14732
Copy link
Member

@ayaka14732 ayaka14732 commented Jul 3, 2024

This PR is a follow-up of #21926. It is part of the efforts to add LRU cache eviction policy for the JAX persistent compilation cache.

Since we now have the new LRUChache class, which supports both local filesystem and GCS, the old GFileCache class can be removed.

@ayaka14732 ayaka14732 marked this pull request as ready for review July 3, 2024 13:13
@ayaka14732 ayaka14732 force-pushed the lru-cache-5 branch 4 times, most recently from 6dddbd5 to 3f823c0 Compare July 3, 2024 13:38
@ayaka14732
Copy link
Member Author

Manually tested on GPU VM and it works.

@@ -19,8 +19,10 @@

try:
import etils.epath as epath
epath_installed = True
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess you could use epath is not None instead of epath_installed?

Copy link
Member Author

@ayaka14732 ayaka14732 Jul 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think having a epath_installed is clearer, because it is imported in another file and is used multiple times.

jax/_src/lru_cache.py Outdated Show resolved Hide resolved
@google-ml-butler google-ml-butler bot added kokoro:force-run pull ready Ready for copybara import and testing labels Jul 3, 2024
@ayaka14732 ayaka14732 force-pushed the lru-cache-5 branch 5 times, most recently from 28c1e41 to c291eab Compare July 4, 2024 11:51
@copybara-service copybara-service bot merged commit 9214ace into google:main Jul 4, 2024
15 checks passed
@ayaka14732 ayaka14732 deleted the lru-cache-5 branch July 4, 2024 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pull ready Ready for copybara import and testing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants