Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

clearer error when values are missing #7939

Merged
merged 3 commits into from
Aug 30, 2022

Conversation

RoriCremer
Copy link
Contributor

@RoriCremer RoriCremer commented Jul 12, 2022

In the VAT validation, give clearer error msg about which clinvar classification values are missing

@codecov
Copy link

codecov bot commented Jul 12, 2022

Codecov Report

❗ No coverage uploaded for pull request base (ah_var_store@d3f63e5). Click here to learn what that means.
The diff coverage is n/a.

Additional details and impacted files
@@               Coverage Diff                @@
##             ah_var_store     #7939   +/-   ##
================================================
  Coverage                ?   86.241%           
  Complexity              ?     35201           
================================================
  Files                   ?      2173           
  Lines                   ?    165016           
  Branches                ?     17792           
================================================
  Hits                    ?    142311           
  Misses                  ?     16378           
  Partials                ?      6327           

@RoriCremer RoriCremer marked this pull request as ready for review July 20, 2022 18:07
Copy link
Collaborator

@mcovarr mcovarr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nits picked, looks good but some comments for posterity would be great 👍

@@ -990,29 +990,38 @@ task ClinvarSignificance {
# "other",
# "not provided"]

bq query --nouse_legacy_sql --project_id=~{query_project_id} --format=csv 'SELECT
bq query --nouse_legacy_sql --project_id=~{query_project_id} --format=csv 'SELECT
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔙


echo "false" > ~{pf_file}
# if the result of the query has any rows, that means gvs_all_an has not been calculated correctly
if [[ $NUMRESULTS -ge 13 && $INCLUVALUES = "0" ]]; then
# if the result of the query less than 13 rows, that means clinvar_classification must not have all the expected values
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# if the result of the query less than 13 rows, that means clinvar_classification must not have all the expected values
# If the result of the query has fewer than 13 rows, that means clinvar_classification must not have all the expected values.

# if the result of the query has any rows, that means gvs_all_an has not been calculated correctly
if [[ $NUMRESULTS -ge 13 && $INCLUVALUES = "0" ]]; then
# if the result of the query less than 13 rows, that means clinvar_classification must not have all the expected values
if [[ $NUMRESULTS -ge 13 && $NUMMISS = "0" ]]; then
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if [[ $NUMRESULTS -ge 13 && $NUMMISS = "0" ]]; then
if [[ $NUMRESULTS -ge 13 && $NUMMISS -eq 0 ]]; then

index($0,"not provided"))}' bq_clinvar_classes.csv)
~{fq_vat_table}, UNNEST(clinvar_classification) AS unnested_clinvar_classification'| sed "2 d" > bq_clinvar_classes.csv

echo "affects" >> expected_clinvar_classes.csv
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TOL this could be DRYed

echo 'affects
association
benign
.
.
.
uncertain significance' > expected_clinvar_classes.csv

@RoriCremer RoriCremer force-pushed the rc-update-clinvar-validate-vat branch from f12853c to 7238988 Compare August 29, 2022 16:47
@RoriCremer RoriCremer merged commit 08b62a8 into ah_var_store Aug 30, 2022
@RoriCremer RoriCremer deleted the rc-update-clinvar-validate-vat branch August 30, 2022 19:17
This was referenced Mar 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants