sc-12597 split data creation and change directory walking to directly upload to CT

[mattwwarren]

No description provided.

[codecov]

Codecov Report

Attention: Patch coverage is 94.87179% with 2 lines in your changes are missing coverage. Please review.

Project coverage is 88.02%. Comparing base (b73e4e9) to head (b812ca1).

Files	Patch %	Lines
src/dynamic_importer/main.py	94.87%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #11      +/-   ##
==========================================
+ Coverage   87.77%   88.02%   +0.25%     
==========================================
  Files          11       11              
  Lines         687      693       +6     
==========================================
+ Hits          603      610       +7     
+ Misses         84       83       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.