Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Job and Message archival #154

Open
imyousuf opened this issue Mar 11, 2023 · 0 comments
Open

[FEATURE] Job and Message archival #154

imyousuf opened this issue Mar 11, 2023 · 0 comments
Labels
enhancement New feature or request
Milestone

Comments

@imyousuf
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
Production DB having millions of messages and jobs that are no longer required/relevant. This could also potentially be GBs of data that can be moved to cold storage

Describe the solution you'd like
We would want to design a command under webhook broker main process that would trigger a archival for dispatched messages and without any dead jobs. If there is even one dead job for the message would not be archived. We would also optionally provide a priorToDate to choose the messages and event, by default it would be a week prior to the command. The messages to be archived would be written against a cold storage (compared to DB) like AWS S3.

Describe alternatives you've considered
Manually dumping from the Database and deleting the rows.

Additional context

@imyousuf imyousuf added the enhancement New feature or request label Mar 11, 2023
@imyousuf imyousuf added this to the v0.2 milestone Mar 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant