Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FR: Support Impala connection from CLI #262

Closed
nehanene15 opened this issue Jun 18, 2021 · 3 comments · Fixed by #281
Closed

FR: Support Impala connection from CLI #262

nehanene15 opened this issue Jun 18, 2021 · 3 comments · Fixed by #281
Assignees
Labels
priority: p0 Highest priority. Critical issue. Will be fixed prior to next release. Release Next release candidate type: feature request 'Nice-to-have' improvement, new feature or different behavior or design.

Comments

@nehanene15
Copy link
Collaborator

nehanene15 commented Jun 18, 2021

The DVT supports Impala connections but it is not documented or supported via the CLI.

A user should be able to add a connection with this command:

data-validation connections add --connection-name $IMPALA_CONN Impala --host $HOST --database $DATABASE --hdfs-client $CLIENT 

We should also document this connection type, as well as an example of connecting to Hive.

@nehanene15 nehanene15 added type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. priority: p1 High priority. Fix may be included in the next release. labels Jun 18, 2021
@danieldeleo
Copy link
Contributor

Looks like supporting Impala connection will also enable Hive as a connection

@danieldeleo
Copy link
Contributor

The following packages are necessary to use impala connection type:

  • pip install thrift_sasl
  • pip install hdfs

@danieldeleo
Copy link
Contributor

I was able to create a hive connection type using the following command:

data-validation connections add -c hive Raw --json "$(cat hive.json)"

where hive.json contains the following:

{   
  "source_type": "Impala",
  "host": "HIVE_IP_ADDRESS",
  "port": 10000,
  "database": "default",
  "auth_mechanism":"PLAIN"
}

@afleisc afleisc self-assigned this Jul 1, 2021
@freedomofnet freedomofnet changed the title Support Impala connection from CLI FR: Support Impala connection from CLI Jul 1, 2021
@freedomofnet freedomofnet added type: feature request 'Nice-to-have' improvement, new feature or different behavior or design. and removed type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Jul 1, 2021
@freedomofnet freedomofnet added priority: p0 Highest priority. Critical issue. Will be fixed prior to next release. Release Next release candidate and removed Beta priority: p1 High priority. Fix may be included in the next release. labels Jul 14, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority: p0 Highest priority. Critical issue. Will be fixed prior to next release. Release Next release candidate type: feature request 'Nice-to-have' improvement, new feature or different behavior or design.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants