Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/cloud/improve post process #384

Merged
merged 15 commits into from
Jul 16, 2024

Conversation

itutu-tienday
Copy link
Collaborator

@itutu-tienday itutu-tienday commented Jul 9, 2024

  • Contents

    • Improved status management of post process processing in workflow
      • update workflow pkl operation
      • add attribute "procs" for experiment.yaml
      • Improved post process finish confirmation process
      • etc.
  • GUI Changes

    • Added post_process processing results display to the Experiment Table on the RECORD screen
      • image

tienday and others added 7 commits July 8, 2024 19:42
- Cleanup of pkl at start of workflow
- Forced pkl save process in case of error in post_process.py
- update ProcessType define
- minor improvement
- BE) update WorkflowResult for support PostProcessResult
- FE) update post process result check request
# Operate remote storage.
if RemoteStorageController.use_remote_storage():
# Get workspace_id, unique_id from output file path
workspace_id, unique_id = __rule.output.split("/")[-4:-2]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

他の部分でも出てくるようなら専用のパーサ関数を書いてもいいかもしれません

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

現行コードの類似コードを踏襲していましたが(output_pathよりid情報を取得)、ご指摘のように関数化が適切なロジックのため、他の箇所と合わせて整理を行います。(別途 refactoring PR を発行予定)

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emuemuJP
以下で、上記のreview指摘に関する修正PRを作成しています。

上記PRがOKであれば、同内容を こちらにも反映します。

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

以下にて修正を適用

studio/app/common/core/rules/post_process.py Outdated Show resolved Hide resolved
Copy link
Collaborator Author

@itutu-tienday itutu-tienday left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

各コメント事項への対応を実施しています。
再reviewを お願いいたします。

# Operate remote storage.
if RemoteStorageController.use_remote_storage():
# Get workspace_id, unique_id from output file path
workspace_id, unique_id = __rule.output.split("/")[-4:-2]
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

以下にて修正を適用

studio/app/common/core/rules/post_process.py Outdated Show resolved Hide resolved
@itutu-tienday itutu-tienday merged commit 7c20b5d into develop-cloud Jul 16, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Cloud Support] クラウドストレージ連携_不足機能実装
2 participants