Updating ECCC files (#6)
Browse files- update ECCC example files (75e29c06a94711c45caa27350647dd7ede417791)
- Track .nc files with Git LFS and re-add large files (24b875ab09393295af5ccee1ff710b92f4beff1d)
- Update Documentation (8bb1ff08f56c3d757f9a5c85f68ae5ebb1fdb33f)
.gitattributes
CHANGED
@@ -38,3 +38,5 @@ ECCC/data_sample/gdps_regridded/2022072900_000.nc filter=lfs diff=lfs merge=lfs
|
|
38 |
ECCC/data_sample/gdps_regridded/static_regridded_gdps.nc filter=lfs diff=lfs merge=lfs -text
|
39 |
ECCC/data_sample/hrdps/2022072900_000.nc filter=lfs diff=lfs merge=lfs -text
|
40 |
ECCC/data_sample/hrdps/static_hrdps.nc filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
38 |
ECCC/data_sample/gdps_regridded/static_regridded_gdps.nc filter=lfs diff=lfs merge=lfs -text
|
39 |
ECCC/data_sample/hrdps/2022072900_000.nc filter=lfs diff=lfs merge=lfs -text
|
40 |
ECCC/data_sample/hrdps/static_hrdps.nc filter=lfs diff=lfs merge=lfs -text
|
41 |
+
*.nc filter=lfs diff=lfs merge=lfs -text
|
42 |
+
*.png filter=lfs diff=lfs merge=lfs -text
|
ECCC/data_sample/gdps_regridded/{2022072900_000.nc → 2022073100_020.nc}
RENAMED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:26c9c49eef11688732ac36a0d90defdd180cdca8c1812dce35ca7b208464504e
|
3 |
+
size 773383411
|
ECCC/data_sample/hrdps/{2022072900_000.nc → 2022073100_020.nc}
RENAMED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b9e4a81ca5ff36863271e6c1e11f5c5d9f9b4f28ddba290584b89ebbada3f383
|
3 |
+
size 773466185
|
ECCC/indices/index_example.json
CHANGED
@@ -1 +1 @@
|
|
1 |
-
{"0": ["./granite-geospatial-wxc-downscaling/ECCC/data_sample/gdps_regridded/
|
|
|
1 |
+
{"0": ["./granite-geospatial-wxc-downscaling/ECCC/data_sample/gdps_regridded/2022073100_020.nc", "./granite-geospatial-wxc-downscaling/ECCC/data_sample/hrdps/2022073100_020.nc"]}
|
README.md
CHANGED
@@ -3,13 +3,19 @@ license: cdla-permissive-2.0
|
|
3 |
---
|
4 |
# Model card for granite-geospatial-wxc-downscaling
|
5 |
|
6 |
-
[<b><i>>>Try it on Colab<<</i></b> (Please select the T4 GPU runtime)](https://colab.research.google.com/github/IBM/granite-wxc/blob/main/examples/granitewxc_downscaling/notebooks/granitewxc_downscaling_inference.ipynb)
|
7 |
-
|
|
|
8 |
|
9 |
<b>6x downscaling of MERRA-2 2m temperature</b>
|
10 |
|
11 |
<center><img src="downscaling_T2M_coolwarm_animated.gif" alt="Downscaling of MERRA-2 T2M" width=462></center>
|
12 |
|
|
|
|
|
|
|
|
|
|
|
13 |
More information: [Code](https://github.com/IBM/granite-wxc), [base model](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-weather-and-climate-6740a9252d5278b1c75b3418), paper (to appear).
|
14 |
|
15 |
## Architecture
|
@@ -20,6 +26,10 @@ From an architecture point of view, we embed Prithvi WxC's transformer layers in
|
|
20 |
|
21 |
As a reference and baseline how to use Prithvi WxC as well as the downscaling architecture, we have used `granite-geospatial-downscaling` for 6x downscaling of MERRA-2 2m temperature data. That is, we take MERRA-2 data of 0.5 x 0.625 degrees resolution, coarsen it by a factor of six along each axis and then apply an additional smoothing filter via a 3x3 convolution. Subsequently we fine-tune the above architecture to recover the high resolution data. The weights for this are included here.
|
22 |
|
|
|
|
|
|
|
|
|
23 |
## Further applications - EURO-CORDEX
|
24 |
|
25 |
In addition, we have used the same architecture with different hyperparameter choices for a 12x downscaling of a subset of EURO-CORDEX climate simulation.
|
|
|
3 |
---
|
4 |
# Model card for granite-geospatial-wxc-downscaling
|
5 |
|
6 |
+
<!-- [<b><i>>>Try it on Colab<<</i></b> (Please select the T4 GPU runtime)](https://colab.research.google.com/github/IBM/granite-wxc/blob/main/examples/granitewxc_downscaling/notebooks/granitewxc_downscaling_inference.ipynb) -->
|
7 |
+
|
8 |
+
`granite-geospatial-wxc-downscaling` is a fine-tuned foundation model for the downscaling of weather and climate data. It is based on the [Prithvi WxC foundation model](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-weather-and-climate-6740a9252d5278b1c75b3418). `granite-geospatial-downscaling` has been used to downscale both MERRA-2 data, ECCC data as well as EURO-CORDEX climate simulations. The weights for the former are included here.
|
9 |
|
10 |
<b>6x downscaling of MERRA-2 2m temperature</b>
|
11 |
|
12 |
<center><img src="downscaling_T2M_coolwarm_animated.gif" alt="Downscaling of MERRA-2 T2M" width=462></center>
|
13 |
|
14 |
+
<b>8x downscaling of ECCC's u10 wind component</b>
|
15 |
+
|
16 |
+
<center><img src="downscaling_eccc_u10.png" alt="Downscaling of ECCC's u10 Wind Component" width=462></center>
|
17 |
+
|
18 |
+
|
19 |
More information: [Code](https://github.com/IBM/granite-wxc), [base model](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-weather-and-climate-6740a9252d5278b1c75b3418), paper (to appear).
|
20 |
|
21 |
## Architecture
|
|
|
26 |
|
27 |
As a reference and baseline how to use Prithvi WxC as well as the downscaling architecture, we have used `granite-geospatial-downscaling` for 6x downscaling of MERRA-2 2m temperature data. That is, we take MERRA-2 data of 0.5 x 0.625 degrees resolution, coarsen it by a factor of six along each axis and then apply an additional smoothing filter via a 3x3 convolution. Subsequently we fine-tune the above architecture to recover the high resolution data. The weights for this are included here.
|
28 |
|
29 |
+
## Data - ECCC (Environment and Climate Change Canada)
|
30 |
+
|
31 |
+
We use Prithvi WxC for the downscaling task on Canada’s operational Numerical Weather Prediction (NWP) systems. Specifically, the goal is to downscale forecasts from the Global Deterministic Prediction System (GDPS)—which provides 10-day forecasts at ~15 km resolution—to the High-Resolution Deterministic Prediction System (HRDPS), which produces 48-hour forecasts at ~2.5 km resolution. The weights for this are included here.
|
32 |
+
|
33 |
## Further applications - EURO-CORDEX
|
34 |
|
35 |
In addition, we have used the same architecture with different hyperparameter choices for a 12x downscaling of a subset of EURO-CORDEX climate simulation.
|
downscaling_eccc_u10.png
ADDED
![]() |
Git LFS Details
|