As a user, I want to monitor the progress of Data Upload Manager in a visual dashboard in AWS

[jordanpadams]

Checked for duplicates

Yes - I've already checked

🧑‍🔬 User Persona(s)

Node Operator

💪 Motivation

...so that I can monitor how successful DUM is on the upload of data, and whether or not there are any errors or issues encountered

📖 Additional Details

Interested to see if there is some way for us to setup a Cloudwatch dashboard or something else to be able to help aid in monitoring of DUM uploads from AWS. The on-prem logs are great, but we also have those logs flowing into AWS. As we continue to move from the cloud, more and more node operations are going to be happening within the AWS console (e.g. Airflow, S3, etc.).

How can we monitor these more easily? CloudWatch dashboard? Athena? Logstash -> OpenSearch and use Kibana?

Acceptance Criteria

Given
When I perform
Then I expect

⚙️ Engineering Details

No response

🎉 I&T

No response