Catalyst Cooperative
PUDL v2024.5.0: 2024Q2 updates & new data for energy modelers #3651
zaneselvans
announced in
Announcements
Replies: 1 comment
-
|
The release is live! Zenodo: https://zenodo.org/records/11292273 ReadTheDocs: https://catalystcoop-pudl.readthedocs.io/en/v2024.5.0/release_notes.html |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
We've just completed our quarterly integration of EIA data sources for 2024Q2 (in support of RMI's Utility Transition Hub) and have also added a bunch of new tables over the last few months in an effort to better support energy system modelers (with support from GridLab).
See the PUDL documentation for instructions on accessing all the data
Here's an overview of what's new:
2024Q2 Quarterly Update
Note that the data provided by EIA-860M is only a small subset of what's available in the EIA-860 (just data about generators), and EIA still hasn't published the EIA-860 early release data for 2023, there are many gaps in the output tables for 2023 and 2024, since some of them depend on EIA-860 data that's not available in the EIA-860M. The early release data for 2023 is expected out in June, 2024.
New Data for Energy System Modeling
EIA-860 Wind, Solar, and Storage Attributes
We've added tables detailing generator attributes specific to wind, solar, and energy storage facilities which have been published in the EIA-860 in recent years. For now we aren't merging these additional attributes into the already very wide generic generator attributes table, since it would result in many columns which were almost entirely null. If you need all the attributes for a given wind, solar, or storage facility you'll want to merge them together.
(Links go to the PUDL data dictionary)
EIA-923 Storage Operations
Similarly, EIA has recently started publishing data describing monthly energy storage facility operations, which can be found in:
EIA-930
We've integrated bulk hourly data from the EIA Electric Grid Monitor (aka EIA-930).
Note that this data is relatively unprocessed and has mostly just been reshaped and normalized. Depending on your use case, there's lots of additional cleaning and reconciliation of this data that might make sense. See e.g. gridemissions from @jdechalendar. If you have thoughts about what kinds of additional processing would be appropriate here for what use cases, we'd love to hear them in the comments.
Because these hourly tables are quite long, they are being distributed as Parquet files rather than in the SQLite database.
Additional documentation can be found in our EIA-930 data source docs. Examples of how to work with this data and some graphical sanity checks can be found in this Jupyter notebook on Kaggle
EIA AEO
We've integrated a handful of tables from EIA's Annual Energy Outlook. Additional tables are relatively easy to integrate, so if there's something you'd like to have available, let us know in the comments.
NREL ATB
We've also pulled in NREL's Annual Technology Baseline. We have a few lingering questions about some of these tables, which can be found in this comment. If you find anything odd please let us know.
GridPath RA Toolkit
We've integrated a small subset of the data that went into the GridPath Resource Adequacy Toolkit, namely hourly available capacity factors for wind and solar generators, spatially aggregated to the balancing area. There's much more data that could be integrated here, including hourly estimates of weather-dependent generator availability for thermal generators as well as renewables.
More details can be found in our GridPath RA Toolkit data source documentation
Beta Was this translation helpful? Give feedback.
All reactions