{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":326453719,"defaultBranch":"main","name":"xpartition","ownerLogin":"spencerkclark","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2021-01-03T16:43:15.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/6628425?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1722166871.0","currentOid":""},"activityList":{"items":[{"before":"4e636359d64448c429f63921a9d38207b5c94203","after":"b8bfefd474340ab2f4de4a0dd2ca72b34db9759c","ref":"refs/heads/main","pushedAt":"2024-07-28T11:40:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Bump version: 0.2.1 → 0.2.2","shortMessageHtmlLink":"Bump version: 0.2.1 → 0.2.2"}},{"before":"4e636359d64448c429f63921a9d38207b5c94203","after":null,"ref":"refs/tags/v0.2.2","pushedAt":"2024-07-28T11:39:24.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"}},{"before":"5736acd9ffd477c05fd50dfb4948d487f2a21b41","after":"4e636359d64448c429f63921a9d38207b5c94203","ref":"refs/heads/main","pushedAt":"2024-07-26T14:48:09.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Replace deprecated `np.product` with `np.prod` (#24)","shortMessageHtmlLink":"Replace deprecated <code>np.product</code> with <code>np.prod</code> (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2432352160\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spencerkclark/xpartition/issues/24\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spencerkclark/xpartition/pull/24/hovercard\" href=\"https://github.com/spencerkclark/xpartition/pull/24\">#24</a>)"}},{"before":"511ced2319b6d24e2542b6c7a8420e8645117a41","after":"5736acd9ffd477c05fd50dfb4948d487f2a21b41","ref":"refs/heads/main","pushedAt":"2023-11-05T17:04:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"895bc5e2a9b7f4b148a04ec457bc115682724c1d","after":"511ced2319b6d24e2542b6c7a8420e8645117a41","ref":"refs/heads/main","pushedAt":"2023-11-05T15:35:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"0aa9b74a555d9774fb93d88eec8c568f54f8e4b0","after":null,"ref":"refs/heads/simple-readme-example","pushedAt":"2023-11-05T15:32:46.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"}},{"before":"1a3a4fa243249262aa17a245ae31486c5745250c","after":"895bc5e2a9b7f4b148a04ec457bc115682724c1d","ref":"refs/heads/main","pushedAt":"2023-11-05T15:32:43.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Add more basic examples to the README.md (#23)\n\n* Add more basic examples to the README.md\r\n\r\n* Bump flake8","shortMessageHtmlLink":"Add more basic examples to the README.md (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1977821073\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spencerkclark/xpartition/issues/23\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spencerkclark/xpartition/pull/23/hovercard\" href=\"https://github.com/spencerkclark/xpartition/pull/23\">#23</a>)"}},{"before":"e8af0cc43713249cb2bdad9e582cba1c7b1ae6f3","after":"0aa9b74a555d9774fb93d88eec8c568f54f8e4b0","ref":"refs/heads/simple-readme-example","pushedAt":"2023-11-05T14:59:31.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Bump flake8","shortMessageHtmlLink":"Bump flake8"}},{"before":"37c60107afb998b3607b49c65961c7fa6c49a479","after":"e8af0cc43713249cb2bdad9e582cba1c7b1ae6f3","ref":"refs/heads/simple-readme-example","pushedAt":"2023-11-05T14:54:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Bump flake8","shortMessageHtmlLink":"Bump flake8"}},{"before":"30a2a0e07d48ee4b48e10057a1471246a835a9a3","after":"37c60107afb998b3607b49c65961c7fa6c49a479","ref":"refs/heads/simple-readme-example","pushedAt":"2023-11-05T14:50:04.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Add more basic examples to the README.md","shortMessageHtmlLink":"Add more basic examples to the README.md"}},{"before":"0bb05150ac81b33b3b60847f28dd2909b27b176b","after":"30a2a0e07d48ee4b48e10057a1471246a835a9a3","ref":"refs/heads/simple-readme-example","pushedAt":"2023-11-05T14:49:05.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Add more basic examples to the README.md","shortMessageHtmlLink":"Add more basic examples to the README.md"}},{"before":null,"after":"0bb05150ac81b33b3b60847f28dd2909b27b176b","ref":"refs/heads/simple-readme-example","pushedAt":"2023-11-05T14:37:55.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Add more basic examples to the README.md","shortMessageHtmlLink":"Add more basic examples to the README.md"}},{"before":"2d7d6fc37c571599b74f788188b055a71e1cb6cf","after":null,"ref":"refs/heads/xarray-beam-mention","pushedAt":"2023-07-13T00:09:08.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"}},{"before":"e0b0db390c108dd71d49543547c2e88d8b1195c9","after":"1a3a4fa243249262aa17a245ae31486c5745250c","ref":"refs/heads/main","pushedAt":"2023-07-13T00:09:04.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Add overdue mention of xarray-beam to README.md (#22)","shortMessageHtmlLink":"Add overdue mention of xarray-beam to README.md (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1801885890\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spencerkclark/xpartition/issues/22\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spencerkclark/xpartition/pull/22/hovercard\" href=\"https://github.com/spencerkclark/xpartition/pull/22\">#22</a>)"}},{"before":null,"after":"2d7d6fc37c571599b74f788188b055a71e1cb6cf","ref":"refs/heads/xarray-beam-mention","pushedAt":"2023-07-12T23:10:30.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Add overdue mention of xarray-beam to README.md","shortMessageHtmlLink":"Add overdue mention of xarray-beam to README.md"}},{"before":"33333b3f1aad05ce152453eca804c04afd2ee194","after":null,"ref":"refs/heads/fix-partition-mapper","pushedAt":"2023-05-25T16:52:06.056Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"}},{"before":"9e319e72cef7a5f488846057b932c2bbd10a277f","after":"e0b0db390c108dd71d49543547c2e88d8b1195c9","ref":"refs/heads/main","pushedAt":"2023-05-25T16:52:02.955Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Address coordinate safety issue in PartitionMapper as well (#20)\n\nThis PR also adds an informative error message when a dataset that one attempts to write with the PartitionMapper contains unchunked non-dimension coordinates or data variables.  These types of datasets should be written with the traditional xpartition approach.","shortMessageHtmlLink":"Address coordinate safety issue in PartitionMapper as well (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1706036800\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spencerkclark/xpartition/issues/20\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spencerkclark/xpartition/pull/20/hovercard\" href=\"https://github.com/spencerkclark/xpartition/pull/20\">#20</a>)"}},{"before":"9a7d9c8231d8db06eb261303def5194bbdf5b79c","after":"33333b3f1aad05ce152453eca804c04afd2ee194","ref":"refs/heads/fix-partition-mapper","pushedAt":"2023-05-25T15:06:14.800Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Raise informative error if PartitionMapper encounters unsupported dataset\n\nThe PartitionMapper cannot be reliably used to write Datasets that\ncontain unchunked non-dimension coordinates or data variables.  This\nchange ensures an informative error is raised if this situation comes up.","shortMessageHtmlLink":"Raise informative error if PartitionMapper encounters unsupported dat…"}},{"before":"311c1e4482cbaa1e0fe04f3375f5b4ddb22c9d54","after":"9a7d9c8231d8db06eb261303def5194bbdf5b79c","ref":"refs/heads/fix-partition-mapper","pushedAt":"2023-05-23T19:24:16.703Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Clean up formatting of test","shortMessageHtmlLink":"Clean up formatting of test"}},{"before":"838bd0b54383ab43cdff3378666c30060f0937da","after":"311c1e4482cbaa1e0fe04f3375f5b4ddb22c9d54","ref":"refs/heads/fix-partition-mapper","pushedAt":"2023-05-23T19:21:49.824Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Add test for get_unchunked_variable_names","shortMessageHtmlLink":"Add test for get_unchunked_variable_names"}},{"before":"255725358bcb3d086e8fdf86c290ffdfc80a6651","after":"838bd0b54383ab43cdff3378666c30060f0937da","ref":"refs/heads/fix-partition-mapper","pushedAt":"2023-05-23T14:10:53.304Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Refactor to reuse common code","shortMessageHtmlLink":"Refactor to reuse common code"}},{"before":"3f01f70c9d4f4fc5618a61e39670d49e536edac9","after":"255725358bcb3d086e8fdf86c290ffdfc80a6651","ref":"refs/heads/fix-partition-mapper","pushedAt":"2023-05-23T14:06:41.243Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Add support for chunked coordinates","shortMessageHtmlLink":"Add support for chunked coordinates"}},{"before":null,"after":"3f01f70c9d4f4fc5618a61e39670d49e536edac9","ref":"refs/heads/fix-partition-mapper","pushedAt":"2023-05-11T15:17:31.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Address coordinate safety issue in PartitionMapper as well","shortMessageHtmlLink":"Address coordinate safety issue in PartitionMapper as well"}},{"before":"21c4cc7facd05886a9c49a184d5bcc68babe9654","after":null,"ref":"refs/heads/release/0.2.1","pushedAt":"2023-05-10T21:12:37.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"}},{"before":"1edae46e21072c9da6ce5040e1e7d0ea3ef88bab","after":"9e319e72cef7a5f488846057b932c2bbd10a277f","ref":"refs/heads/main","pushedAt":"2023-05-10T21:12:34.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Bump version: 0.2.0 → 0.2.1 (#18)\n\nThis bumps the version of xpartition for a new release to include the fix in #17.","shortMessageHtmlLink":"Bump version: 0.2.0 → 0.2.1 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1704611445\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spencerkclark/xpartition/issues/18\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spencerkclark/xpartition/pull/18/hovercard\" href=\"https://github.com/spencerkclark/xpartition/pull/18\">#18</a>)"}},{"before":null,"after":"21c4cc7facd05886a9c49a184d5bcc68babe9654","ref":"refs/heads/release/0.2.1","pushedAt":"2023-05-10T20:47:22.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Bump version: 0.2.0 → 0.2.1","shortMessageHtmlLink":"Bump version: 0.2.0 → 0.2.1"}},{"before":"77e8e3e87f21394be0f1a2c26172ebf4669b4ba0","after":null,"ref":"refs/heads/coordinate-bug","pushedAt":"2023-05-10T20:40:34.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"}},{"before":"85ff3aeed14b4b67edc6feb407c280dd2dea3fc1","after":"1edae46e21072c9da6ce5040e1e7d0ea3ef88bab","ref":"refs/heads/main","pushedAt":"2023-05-10T20:40:31.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Prevent unsafe concurrent coordinate writes (#17)\n\nWhen concurrently writing partitions of DataArrays in a Dataset, any coordinates carried along by those DataArrays are also written concurrently. These attached coordinates do not necessarily adhere to the same chunk structure as the DataArray itself. This is an issue, since frequently they are completely unchunked, meaning that concurrent jobs attempt to write coordinates to the same blob files on disk, opening the possibility for data corruption. In practice data corruption of coordinates has been rare, but we recently encountered a situation where it occurred.\r\n\r\nThis PR fixes this issue by dropping all coordinates when doing low-level partitioned writes. As expected, now any unchunked coordinates or data variables are written once (and only once) during the store initialization step. This PR also addresses the subtle issue of writing chunked coordinates by treating them as though they were independent data variables (previously we did not have test coverage for this case, though it is admittedly rare to encounter in practice).","shortMessageHtmlLink":"Prevent unsafe concurrent coordinate writes (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1700744425\" data-permission-text=\"Title is private\" data-url=\"https://github.com/spencerkclark/xpartition/issues/17\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/spencerkclark/xpartition/pull/17/hovercard\" href=\"https://github.com/spencerkclark/xpartition/pull/17\">#17</a>)"}},{"before":"bebefa3fad8cb42b37e93828a11bceadc2995620","after":"77e8e3e87f21394be0f1a2c26172ebf4669b4ba0","ref":"refs/heads/coordinate-bug","pushedAt":"2023-05-10T19:01:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Fix missing word in comment","shortMessageHtmlLink":"Fix missing word in comment"}},{"before":"d2955e9b9a9347e751513546d8817ce2d337c534","after":"bebefa3fad8cb42b37e93828a11bceadc2995620","ref":"refs/heads/coordinate-bug","pushedAt":"2023-05-10T16:47:16.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"spencerkclark","name":"Spencer Clark","path":"/spencerkclark","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6628425?s=80&v=4"},"commit":{"message":"Generalize test logic a little more","shortMessageHtmlLink":"Generalize test logic a little more"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEix5WAAA","startCursor":null,"endCursor":null}},"title":"Activity · spencerkclark/xpartition"}