Update quickstart #7439
Merged
Update quickstart #7439
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
kcibul
approved these changes
Aug 26, 2021
| @@ -19,12 +19,28 @@ This quickstart assumes that you are familiar with Terra workspaces, the data mo | |||
| - BigQuery data editor | |||
| - BigQuery job user | |||
| - BigQuery Read Session User | |||
| 4. These tools expect reblocked gvcf files as input. | |||
There was a problem hiding this comment.
Is there some kind of link for "Reblocking", like a GATK article or something? @ldgauthier ?
|
|
||
| ## 1. Import Data | ||
| In order to load data into BigQuery without hitting daily load limits, we recommend you group your input files into samples sets and follow these steps for each sample set. |
There was a problem hiding this comment.
Are you thinking of limits beyond the 15TB per load limit? If so and we have to chunk up the loads anyway, maybe we can remove all the 15TB logic from the WDL since it adds a lot of complexity
There was a problem hiding this comment.
no this was just a general comment as to why ops should load sample sets instead of individual samples. even though the logic for 15 TB is complicated, it is working well (well, after my other PR fix goes in). hopefully it won't actually be utilized much - but just as a fail safe
This was referenced Mar 17, 2023
Closed
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
update for assign ids and changes in import