Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Row Hash validation with BQ - TypeError: Object of type bytes is not JSON serializable #399

Closed
nehanene15 opened this issue Mar 22, 2022 · 0 comments · Fixed by #400
Closed
Assignees
Labels
priority: p0 Highest priority. Critical issue. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@nehanene15
Copy link
Collaborator

Getting errors when running a row hash validation like so between BQ to BQ and Hive to BQ.
data-validation -v validate row -sc my_bq_conn -tc my_bq_conn -tbls pso-kokoro-resources.hivetest.mascot --hash '*' -pk id

The return value from the BQ sha256() function is a bytestring value that cannot be compared to the string return value from the Hive sha2() function. This also throws an error when outputting results to BigQuery result handler.

@nehanene15 nehanene15 self-assigned this Mar 22, 2022
@nehanene15 nehanene15 added type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. priority: p0 Highest priority. Critical issue. Will be fixed prior to next release. labels Mar 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority: p0 Highest priority. Critical issue. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
1 participant