Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"build-base" Docker image for faster variantstore image builds [VS-712] #8085

Merged
merged 19 commits into from
Nov 8, 2022

Conversation

mcovarr
Copy link
Collaborator

@mcovarr mcovarr commented Nov 7, 2022

Creates a new "build-base" Docker image for the expensive and less frequently changed layers of the build image allowing for much improved variantstore image build times. Successful integration run here.

Other improvements:

  • Bumps version of Google Cloud SDK base Docker image to latest 408.0.1-alpine
  • Bumps Arrow library version from 8.0.0 to 10.0.0
  • Simplifies Arrow build to use ninja

@codecov
Copy link

codecov bot commented Nov 7, 2022

Codecov Report

❗ No coverage uploaded for pull request base (ah_var_store@7dd6ede). Click here to learn what that means.
The diff coverage is n/a.

Additional details and impacted files
@@               Coverage Diff                @@
##             ah_var_store     #8085   +/-   ##
================================================
  Coverage                ?   84.371%           
  Complexity              ?     34536           
================================================
  Files                   ?      2173           
  Lines                   ?    165041           
  Branches                ?     17793           
================================================
  Hits                    ?    139246           
  Misses                  ?     19641           
  Partials                ?      6154           

@mcovarr mcovarr requested review from gbggrant, rsasch and koncheto-broad and removed request for gbggrant November 7, 2022 15:12
Copy link

@rsasch rsasch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you link to successful run(s) using the new image (or would you like others to test it out)?

@mcovarr
Copy link
Collaborator Author

mcovarr commented Nov 8, 2022

Can you link to successful run(s) using the new image (or would you like others to test it out)?

Can has! Please ignore the confusingness of the branch name 🙈

https://job-manager.dsde-prod.broadinstitute.org/jobs/245e1b69-a628-41c0-8e64-ebd3ae37ce30

@rsasch
Copy link

rsasch commented Nov 8, 2022

Can has! Please ignore the confusingness of the branch name 🙈
https://job-manager.dsde-prod.broadinstitute.org/jobs/245e1b69-a628-41c0-8e64-ebd3ae37ce30

Sorry if this is a dumb question, but how do I verify that the new image is being used since we can't see the WDLs of the subworkflows that are being called by the integration WDL?

Copy link

@rsasch rsasch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mobbed about how to verify that the workflow run was on the expected docker

Copy link

@koncheto-broad koncheto-broad left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mcovarr mcovarr merged commit d1907a8 into ah_var_store Nov 8, 2022
@mcovarr mcovarr deleted the vs_707_azure_setup branch November 8, 2022 19:31
This was referenced Mar 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants