Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read MDS in tiles using Zarr #331

Draft
wants to merge 16 commits into
base: master
Choose a base branch
from
Draft

Commits on Jan 30, 2023

  1. Collect meta files and group by basename

    Implementing collect_meta(). Let's process per variable, so the first
    step is to collect all meta and group per variable.
    castelao committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    9ca1582 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2023

  1. Renaming to demo

    I'll collect everything here until I understand where it fits in the
    library.
    castelao committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    0b96244 View commit details
    Browse the repository at this point in the history
  2. A hardcoded DataFile

    Understanding and validating the connections between zarr and MITgcm's
    binaries. Once I validated a working reader, I can start to generalize
    it.
    castelao committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    962cacc View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Prototype of VarZ (hardcoded)

    Test driven development. Let's start with a hardcoded behavior and later
    generalize it as I understand what is required.
    castelao committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    3415948 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    72b816f View commit details
    Browse the repository at this point in the history
  3. Retrieving 1D values

    Using lat as an easy case to start.
    castelao committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    6b42c35 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2023

  1. Identifying requirements for VarZ

    Still using a hardcoded case to understand the requirements for VarZ.
    castelao committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    5935809 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2023

  1. Prototype of a Chunk

    castelao committed Oct 15, 2023
    Configuration menu
    Copy the full SHA
    38fbbc5 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Configuration menu
    Copy the full SHA
    1445cda View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. Refactoring Chunk

    Trying a different concept and adding a few resources.
    castelao committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    958eb6c View commit details
    Browse the repository at this point in the history
  2. Trying the concept of VarZ()

    Chunk() is an auxiliary class to organize and collect information from
    meta, while VarZ keep track of all chunks for one variable.
    castelao committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    e276db1 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Configuration menu
    Copy the full SHA
    7cc139f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4d5b28d View commit details
    Browse the repository at this point in the history
  3. Missing len()

    castelao committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    dff6bd1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    2eb5629 View commit details
    Browse the repository at this point in the history
  5. Cleaning DataFile()

    I was testing with @rabernat 's proof of concept.
    castelao committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    dd0d419 View commit details
    Browse the repository at this point in the history