Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Don't clone all the repo contents when crawling #249

Closed
bfabio opened this issue Nov 11, 2021 · 0 comments · Fixed by #269
Closed

Don't clone all the repo contents when crawling #249

bfabio opened this issue Nov 11, 2021 · 0 comments · Fixed by #269

Comments

@bfabio
Copy link
Member

bfabio commented Nov 11, 2021

The crawler clones all the repo contents when it runs so that it can check for the software's vitality, but this is suboptimal and doesn't scale as more projects join the catalog.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: clone bare repositories without blobs italia/publiccode-crawler
1 participant
@bfabio