Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

control-service: Expose supported python versions in helm #1935

Merged
merged 1 commit into from
Apr 25, 2023

Conversation

doks5
Copy link
Contributor

@doks5 doks5 commented Apr 20, 2023

As part of the initiative to support multiple python versions in data job deployments, new configurations were introduced in the form of datajobs.deployment.supportedPythonVersions and datajobs.deployment.defaultPythonVersion configuration properties.

To facilitate proper production setup of the Control Service with the new functionality, the configuration needs to be exposed in the helm chart.

This change updates the values.yaml and deployment.yaml files of the Control Service helm chart to expose the supportedPythonVersions and defaultPythonVersion configurations and set them as environment variables.

Testing Done: CI/CD and local run of helm lint on the chart.

@doks5 doks5 self-assigned this Apr 20, 2023
@doks5 doks5 linked an issue Apr 20, 2023 that may be closed by this pull request
@doks5 doks5 force-pushed the person/andonova/expose-in-helm branch 2 times, most recently from 03f340a to 7f7161b Compare April 24, 2023 07:19
Copy link
Contributor

@gageorgiev gageorgiev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good, maybe tighten up the comments a bit since its a bit wall-of-text-y

@mivanov1988
Copy link
Collaborator

When are you planning to deprecate the old properties?

@doks5 doks5 force-pushed the person/andonova/expose-in-helm branch from 7f7161b to d982bae Compare April 24, 2023 11:56
@doks5
Copy link
Contributor Author

doks5 commented Apr 24, 2023

When are you planning to deprecate the old properties?

I was thinking of doing it in a separate PR, but I guess it wouldn't make much of a difference if it happens in this one.

@doks5 doks5 force-pushed the person/andonova/expose-in-helm branch 4 times, most recently from f560e22 to 230c12d Compare April 25, 2023 10:14
@doks5 doks5 requested a review from mivanov1988 April 25, 2023 10:15
@doks5 doks5 force-pushed the person/andonova/expose-in-helm branch from 230c12d to 2628ca2 Compare April 25, 2023 11:55
As part of the initiative to support multiple python versions in data job deployments,
new configurations were introduced in the form of `datajobs.deployment.supportedPythonVersions`
and `datajobs.deployment.defaultPythonVersion` configuration properties.

To facilitate proper production setup of the Control Service with the new functionality, the
configuration needs to be exposed in the helm chart.

This change updates the values.yaml and deployment.yaml files of the Control Service helm chart
to expose the supportedPythonVersions and defaultPythonVersion configurations and set them as
environment variables.

Testing Done: CI/CD and local run of `helm lint` on the chart.

Signed-off-by: Andon Andonov <[email protected]>
@doks5 doks5 force-pushed the person/andonova/expose-in-helm branch from 2628ca2 to 213f204 Compare April 25, 2023 13:06
@doks5 doks5 merged commit 54914a0 into main Apr 25, 2023
5 checks passed
@doks5 doks5 deleted the person/andonova/expose-in-helm branch April 25, 2023 13:35
doks5 added a commit that referenced this pull request May 29, 2023
As part of the initiative to support multiple python versions for data
job deployments, we introduced new configurations through the
`datajobs.deployment.supportedPythonVersions` and
`datajobs.deployment.defaultPythonVersion` properties. This new
configuration renders the old configurations through
`datajobs.vdk.image` and `datajobs.deployment.dataJobBaseImage`
essentially useless, as these are no longer used.

This change cleans up the old configurations and related code and tests,
so that only the new configurations remain. A more descriptive list of
the changes is as follows:
* The `DOCKER_VDK_BASE_IMAGE` and `DATAJOBS_DEPLOYMENT_DATAJOBBASEIMAGE`
environment variables are removed, as they are not needed anymore.
* The templates associated with the above-mentioned env vars,
projects/control-service/projects/helm_charts/pipelines-control-service/templates/_helpers.tpl,
is also removed.
* The JobImageDeployer,
projects/control-service/projects/pipelines_control_service/src/main/java/com/vmware/taurus/service/deploy/JobImageDeployer.java,
logic related to the stand-alone vdk image configuration is also cleaned
up to use only the `supportedPythonVersions` functionality. Tests
associated with the cleaned up logic are also removed.

The new configurations were introduced in
#2022 and
#1935

Testing Done: CI/CD

---------

Signed-off-by: Andon Andonov <[email protected]>
Co-authored-by: github-actions <>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Expose new configuration for supported python versions
4 participants