Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generalize file splitting for output writers #3515

Merged
merged 29 commits into from
Mar 24, 2024
Merged

Generalize file splitting for output writers #3515

merged 29 commits into from
Mar 24, 2024

Commits on Mar 15, 2024

  1. Generalize file splitting for JLD2OutputWriter so that alternative cr… 

    …iterion to file size may be used
    @glwagner
    glwagner committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    e06d78e View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2024

  1. Update src/OutputWriters/jld2_output_writer.jl 

    Co-authored-by: Navid C. Constantinou <[email protected]>
    @glwagner @navidcy
    glwagner and navidcy committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    b1ad9b6 View commit details
    Browse the repository at this point in the history

  2. Export FileSizeLimit and update JLD2OutputWriter test

    @glwagner
    glwagner committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    183e729 View commit details
    Browse the repository at this point in the history

  3. implementing file splitting in netcdf

    @josuemtzmo
    josuemtzmo committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    0f5fedb View commit details
    Browse the repository at this point in the history

  4. Properly export FileSizeLimit

    @glwagner
    glwagner committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    9276ba6 View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2024

  1. fix handeling of path writer.filepath with the file_splitting

    @josuemtzmo
    josuemtzmo committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    6c6e07e View commit details
    Browse the repository at this point in the history

  2. merge with glw/generalized-file-splitting

    @josuemtzmo
    josuemtzmo committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    ab7fec6 View commit details
    Browse the repository at this point in the history

  3. add support to file splitting by size in netCDFs

    @josuemtzmo
    josuemtzmo committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    2937dc1 View commit details
    Browse the repository at this point in the history

  4. add support to file splitting by size in netCDFs

    @josuemtzmo
    josuemtzmo committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    4f9af7e View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. update warning to properly print variable. 

    Co-authored-by: Gregory L. Wagner <[email protected]>
    @josuemtzmo @glwagner
    josuemtzmo and glwagner committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    73a94ef View commit details
    Browse the repository at this point in the history

  2. return to the use of FileSizeLimit(200KiB) in the test to make it eas… 

    …ier to read
    @josuemtzmo
    josuemtzmo committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    cd30f3e View commit details
    Browse the repository at this point in the history

  3. update netcdf to match jld2, and add return in update_file_splitting_… 

    …schedule
    @josuemtzmo
    josuemtzmo committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    2f0e4f6 View commit details
    Browse the repository at this point in the history

  4. fix tests filesize tests

    @josuemtzmo
    josuemtzmo committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    09c4abb View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. Apply suggestions from code review

    @navidcy
    navidcy committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    db94858 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into glw/generalized-file-splitting

    @navidcy
    navidcy committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    14ce9a8 View commit details
    Browse the repository at this point in the history

  3. Update test_jld2_output_writer.jl

    @navidcy
    navidcy committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    4804fc2 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into glw/generalized-file-splitting

    @josuemtzmo
    josuemtzmo committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    3a846e5 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2024

  1. fix show for NetCDFOutputWriter

    @navidcy
    navidcy committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    4c1db46 View commit details
    Browse the repository at this point in the history

  2. fix doctests

    @navidcy
    navidcy committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    f9b082f View commit details
    Browse the repository at this point in the history

  3. Update src/OutputWriters/netcdf_output_writer.jl 

    Co-authored-by: Gregory L. Wagner <[email protected]>
    @navidcy @glwagner
    navidcy and glwagner committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    527ac31 View commit details
    Browse the repository at this point in the history

  4. Update src/OutputWriters/jld2_output_writer.jl 

    Co-authored-by: Gregory L. Wagner <[email protected]>
    @navidcy @glwagner
    navidcy and glwagner committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    78998bc View commit details
    Browse the repository at this point in the history

  5. fix doctests

    @navidcy
    navidcy committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    60de913 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'glw/generalized-file-splitting' of github.com:CliMA/Oce… 

    …ananigans.jl into glw/generalized-file-splitting
    @navidcy
    navidcy committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    fc49fb7 View commit details
    Browse the repository at this point in the history

  7. fix doctests

    @navidcy
    navidcy committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    d8233b0 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2024

  1. fix doctest

    @navidcy
    navidcy committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    28cc203 View commit details
    Browse the repository at this point in the history

  2. cleanup unecessary imports

    @navidcy
    navidcy committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    97fa9bb View commit details
    Browse the repository at this point in the history

  3. fix doctest

    @navidcy
    navidcy committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    71dab3a View commit details
    Browse the repository at this point in the history

  4. fix doctests

    @navidcy
    navidcy committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    4c1cb92 View commit details
    Browse the repository at this point in the history

  5. fix doctests

    @navidcy
    navidcy committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    6c0e974 View commit details
    Browse the repository at this point in the history