Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read cost observability table [VS-475] #7923

Merged
merged 6 commits into from
Jul 5, 2022

Conversation

mcovarr
Copy link
Collaborator

@mcovarr mcovarr commented Jun 28, 2022

Reads the cost_observability table for the specified project_id / dataset_name / call_set_identifier and sums up the associated event bytes:

[
  {
    "event_key": "BigQuery Query Scanned", 
    "step": "CreateAltAlleles", 
    "sum_event_gibibytes": "3.89"
  }, 
  {
    "event_key": "BigQuery Query Scanned", 
    "step": "GvsPrepareRanges", 
    "sum_event_gibibytes": "22.5"
  }
]

@codecov
Copy link

codecov bot commented Jun 28, 2022

Codecov Report

❗ No coverage uploaded for pull request base (ah_var_store@586f3f7). Click here to learn what that means.
The diff coverage is n/a.

@@               Coverage Diff                @@
##             ah_var_store     #7923   +/-   ##
================================================
  Coverage                ?   86.286%           
  Complexity              ?     35188           
================================================
  Files                   ?      2170           
  Lines                   ?    164888           
  Branches                ?     17786           
================================================
  Hits                    ?    142276           
  Misses                  ?     16289           
  Partials                ?      6323           

> cost_observability.json
>>>
runtime {
docker: "gcr.io/google.com/cloudsdktool/cloud-sdk:390.0.0"
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: any reason not to do latest?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should have a team agreement on this - I would think we'd want to stick with known versions for repeatability?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We had an issue in Batch when we used 'latest' and that upgraded to a version with a bug that broke our CI in a weird way

> cost_observability.json
>>>
runtime {
docker: "gcr.io/google.com/cloudsdktool/cloud-sdk:390.0.0"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should have a team agreement on this - I would think we'd want to stick with known versions for repeatability?

@mcovarr mcovarr merged commit a75a399 into ah_var_store Jul 5, 2022
@mcovarr mcovarr deleted the vs_475_read_cost_observability branch July 5, 2022 12:58
This was referenced Mar 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants