-
Notifications
You must be signed in to change notification settings - Fork 587
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
VS-1395 Have create vat from vds optionally take sites only vcf #8851
VS-1395 Have create vat from vds optionally take sites only vcf #8851
Conversation
…terIzeCreateVATFromVDS
…terIzeCreateVATFromVDS
…ve_CreateVATFromVDS_OptionallyTakeSitesOnlyVCF
@@ -1307,3 +1309,47 @@ task PopulateFilterSetInfo { | |||
File monitoring_log = "monitoring.log" | |||
} | |||
} | |||
|
|||
# TODO - should put in a do not overwrite that file logic |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this going to be covered by this PR/ticket or a subsequent one?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'll make a ticket for that.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actually, I ended up doing that work in this PR>
Co-authored-by: Bec Asch <[email protected]>
Co-authored-by: Bec Asch <[email protected]>
hail_generate_sites_only_script_path = select_first([hail_generate_sites_only_script_path]), | ||
ancestry_file_path = MakeSubpopulationFilesAndReadSchemaFiles.ancestry_file_path, | ||
workspace_bucket = GetToolVersions.workspace_bucket, | ||
region = "us-central1", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I realize this is preexisting but IMHO the region
should be out in a declaration rather than hardcoded
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
and definitely no need to consult git blame
on the baseline code
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Taken care of .
input_vcf = GenerateSitesOnlyVcf.sites_only_vcf, | ||
gatk_docker = effective_gatk_docker, | ||
input_file = select_first([sites_only_vcf_index, IndexVcf.output_vcf_index]), | ||
output_gcs_dir = output_path + "sites_only_vcf", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
are we sure there will be a trailing slash on output_path
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I added code to validate that it does end with a trailing slash.
…ve_CreateVATFromVDS_OptionallyTakeSitesOnlyVCF
if (!defined(split_intervals_scatter_count)) { | ||
call Utils.GetBQTableLastModifiedDatetime as SampleDateTime { | ||
String output_path_without_a_trailing_slash = sub(output_path, "/$", "") | ||
if (output_path == output_path_without_a_trailing_slash) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
oh nice
|
||
call Utils.GetNumSamplesLoaded { | ||
if (!defined(sites_only_vcf) && ((!defined(vds_path) || !defined(hail_generate_sites_only_script_path)))) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe treat the two cases separately? If sites_only_vcf
then those other two params really shouldn't be?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah. I wondered about it. I kind of figured there's no harm if a user leaves an unneeded parameter defined, but it could cause confusion.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Okay - did that
…ve_CreateVATFromVDS_OptionallyTakeSitesOnlyVCF
* Have GvsCreateVATfromVDS.wdl take sites-only-vcf as an optional input. * Added logic to allow/disallow CopyFile to overwrite.
Modify GvsCreateVATFromVDS to take as an optional input the
sites_only_vcf
- if provided, the code bypasses the logic to create it from VDS.This PR also modifies IndexVcf and SelectVariants to use localization_optional for their inputs.
Updated Passing Integration test here
Rerun of GvsCreateVATFromVDS using a passed in sites_only VCF here.
Rerun of GvsCreateVATFromVDS NOT using a passed in sites_only VCF here.