Skip to content

Latest commit

 

History

History
312 lines (175 loc) · 10.9 KB

CHANGELOG.md

File metadata and controls

312 lines (175 loc) · 10.9 KB
Raw

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Unreleased

Added

Changed

  • The max allowed timeout for CloudRunJobs is now 24hrs.

Deprecated

Removed

Fixed

  • Fix list_folders and list_blobs now logging bucket name and bucket path - #184

Security

0.5.1

Released October 12th, 2023.

Changed

  • Updated workers to respect default command from base worker configuration - #216

0.5.0

Released October 5th, 2023.

Fixed

  • Empty logging in list_folders and list_blobs - #214

Added

  • Conditional imports to support operating with pydantic>2 installed - #215

0.4.7

Released September 22nd, 2023.

Added

  • Vertex AI CustomJob worker - #211
  • Add kill_infrastructure method to Vertex AI worker - #213

Changed

  • Use flow run name for name of created custom jobs - #208

0.4.6

Released September 5th, 2023.

Changed

  • Persist Labels to Vertex AI Custom Job - #198

0.4.5

Released July 20th, 2023.

Changed

  • Promoted workers to GA, removed beta disclaimers

0.4.4

Released June 26th, 2023.

Changed

  • Vertex agent now attempts to retry create custom job up to three times to recover from transient errors - #192
  • Updated prefect.docker import to prefect.utilities.dockerutils - #194

0.4.3

Released June 15th, 2023.

Deprecated

  • prefect_gcp.projects module. Use prefect_gcp.deployments instead. - #189
  • pull_project_from_gcs step. Use pull_from_gcs instead. - #189
  • push_project_to_gcs step. Use push_to_gcs instead. - #189
  • PullProjectFromGcsOutput step output. Use PullFromGcsOutput instead. - #189
  • PushProjectToGcsOutput step output. Use PushToGcsOutput instead. - #189

Fixed

  • Bug that list_folders method removes dot(".")s in the middle of paths

0.4.2

Released on May 25th, 2023.

Added

  • accelerator_count property for VertexAICustomTrainingJob - #174
  • result_transformer parameter to customize the return structure of bigquery_query - #176
  • boot_disk_type and boot_disk_size_gb properties for VertexAICustomTrainingJob - #177
  • Support to stream worker logs for executed flow runs - #183

0.4.1

Released on April 20th, 2023.

Added

  • CloudRunWorker for executing Prefect flows via Google Cloud Run - #172

Fixed

  • Fix CloudRunJob with VPC Connector usage. - #170

0.4.0

Released on April 6th, 2023.

Added

  • pull_project_from_gcs and push_project_to_gcs steps - #167

Fixed

  • upload_from_dataframe docstring - #162
  • upload_from_dataframe file extensions for compressed parquet ('.snappy.parquet', '.gz.parquet') - #166

0.3.0

Released on February 28th, 2023.

Added

  • upload_from_dataframe method in GcsBucket - #140

Fixed

  • Using GcsBucket as a deployment storage option - #147
  • Breaking: Stop decoding and return a bytes type in GcpSecret.read_secret, as originally annotated - #149
  • Resolving paths in GcsBucket unintentionally generating an arbitrary UUID when path is an empty string - #150

0.2.6

Released on February 7th, 2023.

Fixed

  • get_directory method in GcsBucket returns the list of downloaded file paths and supports relative path for local_path - #129.
  • Reporting the state of the VertexAICustomTrainingJob to the Prefect API by passing the base env in job spec - #132.

0.2.5

Released on January 27th, 2023.

Added

  • vpc_connector_name field to CloudRunJob - #123
  • list_folders method for GcsBucket - #121

Fixed

  • Listing blobs at the root folder - #120

0.2.4

Released on January 20th, 2023.

Fixed

  • Correctly format GCS paths on Windows machines - #117

0.2.3

Released on January 5th, 2023.

Fixed

  • Wrapping type annotations in quotes to prevent them from loading if the object is not found - #105

0.2.2

Released on January 3rd, 2023.

Added

  • The CloudRunJob timeout parameter is now passed to the GCP TaskSpec. This allows Cloud Run tasks to run for longer than their default of 10min - #99

Fixed

  • Improper imports on the top level - #100

0.2.1

Released on December 23rd, 2022.

Changed

  • Adds handling for service_account_info supplied to GcpCredentials as a json formatted string - #94

0.2.0

Released on December 22nd, 2022.

Added

  • list_blobs, download_object_to_path, download_object_to_file_object, download_folder_to_path, upload_from_path, upload_from_file_object, upload_from_folder methods in GcsBucket - #85
  • GcpSecret block with read_secret, write_secret, and delete_secret methods - #86
  • BigQueryWarehouse block with get_connection, fetch_one, fetch_many, fetch_all, execute, execute_many, methods - #88

Changed

  • Made GcpCredentials.get_access_token sync compatible - #80
  • Breaking: Obfuscated GcpCredentials.service_account_info by using SecretDict type - #88
  • GcsBucket additionally inherits from ObjectStorageBlock - #85
  • Expose all blocks available in the collection to top level init - #88
  • Inherit CredentialsBlock in GcpCredentials - #92

Fixed

  • Warning stating Failed to load collection 'prefect_gcp_aiplatform' - #87

0.1.8

Released on December 5th, 2022.

Added

  • VertexAICustomTrainingJob infrastructure block - #75

0.1.7

Released on December 2nd, 2022.

Added

  • CloudJobRun.kill method for cancellation support - #76

0.1.6

Released on October 7th, 2022.

Fixed

  • Validation errors for CPU and Memory being raised incorrectly - #64

0.1.5

Released on September 28th, 2022.

Changed

  • Invoke google.auth.default if both service_account_info and service_account_file is not specified - #57

Fixed

  • Retrieving the project_id from service account or quota_project_id from gcloud CLI if project is not specified - #57

0.1.4

Released on September 19th, 2022.

Added

  • CloudRunJob infrastructure block - #48
  • GcsBucket block - #41
  • external_config keyword argument in bigquery_create_table task - #53
  • content_type keyword argument in cloud_storage_upload_blob_from_file task - #47
  • **kwargs for all tasks in the module cloud_storage.py - #47

Changed

  • Made schema keyword argument optional in bigquery_create_table task, thus the position of the keyword changed - #53
  • Allowed ~ character to be used in the path for service account file - #38

Fixed

  • ValidationError using GcpCredentials.service_account_info in prefect-dbt - #44

0.1.3

Released on July 22nd, 2022.

Added

  • Added setup.py entry point - #35

0.1.2

Released on July 22nd, 2022.

Changed

  • Updated tests to be compatible with core Prefect library (v2.0b9) and bumped required version - #30
  • Converted GcpCredentials into a Block - #31.

0.1.1

Released on July 11th, 2022

Changed

  • Improved error handle and instruction for extras - #18

0.1.0

Released on March 17th, 2022.

Added

  • cloud_storage_copy_blob, cloud_storage_create_bucket, cloud_storage_download_blob_as_bytes, cloud_storage_download_blob_to_file, cloud_storage_upload_blob_from_file, and cloud_storage_upload_blob_from_string tasks - #1
  • bigquery_create_table, bigquery_insert_stream, bigquery_load_cloud_storage, bigquery_load_file, and bigquery_query, tasks - #2
  • create_secret, delete_secret, delete_secret_version, read_secret, and update_secret tasks - #3