Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create /sources Page to Track Data Sources #137

Closed
kouloumos opened this issue Jul 4, 2024 · 1 comment
Closed

Create /sources Page to Track Data Sources #137

kouloumos opened this issue Jul 4, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request medium priority

Comments

@kouloumos
Copy link
Contributor

As part of our efforts to improve data curation, we need a clear understanding of our current data sources and the process for integrating new ones. The first step is to create a new page at /sources where we can monitor and manage our data sources more effectively.

Proposed Solution

Create a simple view, such as a table, that shows:

  • Each data source
  • The timestamp of when the source was last scraped
  • The number of documents we have for each source
  • [your suggestions]

We should be able to get this information by querying Elasticsearch.

@kouloumos
Copy link
Contributor Author

closed by #144

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request medium priority
Projects
None yet
Development

No branches or pull requests

2 participants