romeokienzler commited on
Commit
9c44f31
·
verified ·
1 Parent(s): 2166dbe

Updating ECCC files (#6)

Browse files

- update ECCC example files (75e29c06a94711c45caa27350647dd7ede417791)
- Track .nc files with Git LFS and re-add large files (24b875ab09393295af5ccee1ff710b92f4beff1d)
- Update Documentation (8bb1ff08f56c3d757f9a5c85f68ae5ebb1fdb33f)

.gitattributes CHANGED
@@ -38,3 +38,5 @@ ECCC/data_sample/gdps_regridded/2022072900_000.nc filter=lfs diff=lfs merge=lfs
38
  ECCC/data_sample/gdps_regridded/static_regridded_gdps.nc filter=lfs diff=lfs merge=lfs -text
39
  ECCC/data_sample/hrdps/2022072900_000.nc filter=lfs diff=lfs merge=lfs -text
40
  ECCC/data_sample/hrdps/static_hrdps.nc filter=lfs diff=lfs merge=lfs -text
 
 
 
38
  ECCC/data_sample/gdps_regridded/static_regridded_gdps.nc filter=lfs diff=lfs merge=lfs -text
39
  ECCC/data_sample/hrdps/2022072900_000.nc filter=lfs diff=lfs merge=lfs -text
40
  ECCC/data_sample/hrdps/static_hrdps.nc filter=lfs diff=lfs merge=lfs -text
41
+ *.nc filter=lfs diff=lfs merge=lfs -text
42
+ *.png filter=lfs diff=lfs merge=lfs -text
ECCC/data_sample/gdps_regridded/{2022072900_000.nc → 2022073100_020.nc} RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7df784cca2d99b6456446867b7a42f67ff6b8081279058a96c02e0d2d6300bf5
3
- size 773380610
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26c9c49eef11688732ac36a0d90defdd180cdca8c1812dce35ca7b208464504e
3
+ size 773383411
ECCC/data_sample/hrdps/{2022072900_000.nc → 2022073100_020.nc} RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7df03f27004f51f0d1eab152dc294357b52c245887c2957ab3abe2f0754e6e03
3
- size 773466168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9e4a81ca5ff36863271e6c1e11f5c5d9f9b4f28ddba290584b89ebbada3f383
3
+ size 773466185
ECCC/indices/index_example.json CHANGED
@@ -1 +1 @@
1
- {"0": ["./granite-geospatial-wxc-downscaling/ECCC/data_sample/gdps_regridded/2022072900_000.nc", "./granite-geospatial-wxc-downscaling/ECCC/data_sample/hrdps/2022072900_000.nc"]}
 
1
+ {"0": ["./granite-geospatial-wxc-downscaling/ECCC/data_sample/gdps_regridded/2022073100_020.nc", "./granite-geospatial-wxc-downscaling/ECCC/data_sample/hrdps/2022073100_020.nc"]}
README.md CHANGED
@@ -3,13 +3,19 @@ license: cdla-permissive-2.0
3
  ---
4
  # Model card for granite-geospatial-wxc-downscaling
5
 
6
- [<b><i>>>Try it on Colab<<</i></b> (Please select the T4 GPU runtime)](https://colab.research.google.com/github/IBM/granite-wxc/blob/main/examples/granitewxc_downscaling/notebooks/granitewxc_downscaling_inference.ipynb)
7
- `granite-geospatial-wxc-downscaling` is a fine-tuned foundation model for the downscaling of weather and climate data. It is based on the [Prithvi WxC foundation model](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-weather-and-climate-6740a9252d5278b1c75b3418). `granite-geospatial-downscaling` has been used to downscale both MERRA-2 data as well as EURO-CORDEX climate simulations. The weights for the former are included here.
 
8
 
9
  <b>6x downscaling of MERRA-2 2m temperature</b>
10
 
11
  <center><img src="downscaling_T2M_coolwarm_animated.gif" alt="Downscaling of MERRA-2 T2M" width=462></center>
12
 
 
 
 
 
 
13
  More information: [Code](https://github.com/IBM/granite-wxc), [base model](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-weather-and-climate-6740a9252d5278b1c75b3418), paper (to appear).
14
 
15
  ## Architecture
@@ -20,6 +26,10 @@ From an architecture point of view, we embed Prithvi WxC's transformer layers in
20
 
21
  As a reference and baseline how to use Prithvi WxC as well as the downscaling architecture, we have used `granite-geospatial-downscaling` for 6x downscaling of MERRA-2 2m temperature data. That is, we take MERRA-2 data of 0.5 x 0.625 degrees resolution, coarsen it by a factor of six along each axis and then apply an additional smoothing filter via a 3x3 convolution. Subsequently we fine-tune the above architecture to recover the high resolution data. The weights for this are included here.
22
 
 
 
 
 
23
  ## Further applications - EURO-CORDEX
24
 
25
  In addition, we have used the same architecture with different hyperparameter choices for a 12x downscaling of a subset of EURO-CORDEX climate simulation.
 
3
  ---
4
  # Model card for granite-geospatial-wxc-downscaling
5
 
6
+ <!-- [<b><i>>>Try it on Colab<<</i></b> (Please select the T4 GPU runtime)](https://colab.research.google.com/github/IBM/granite-wxc/blob/main/examples/granitewxc_downscaling/notebooks/granitewxc_downscaling_inference.ipynb) -->
7
+
8
+ `granite-geospatial-wxc-downscaling` is a fine-tuned foundation model for the downscaling of weather and climate data. It is based on the [Prithvi WxC foundation model](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-weather-and-climate-6740a9252d5278b1c75b3418). `granite-geospatial-downscaling` has been used to downscale both MERRA-2 data, ECCC data as well as EURO-CORDEX climate simulations. The weights for the former are included here.
9
 
10
  <b>6x downscaling of MERRA-2 2m temperature</b>
11
 
12
  <center><img src="downscaling_T2M_coolwarm_animated.gif" alt="Downscaling of MERRA-2 T2M" width=462></center>
13
 
14
+ <b>8x downscaling of ECCC's u10 wind component</b>
15
+
16
+ <center><img src="downscaling_eccc_u10.png" alt="Downscaling of ECCC's u10 Wind Component" width=462></center>
17
+
18
+
19
  More information: [Code](https://github.com/IBM/granite-wxc), [base model](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-weather-and-climate-6740a9252d5278b1c75b3418), paper (to appear).
20
 
21
  ## Architecture
 
26
 
27
  As a reference and baseline how to use Prithvi WxC as well as the downscaling architecture, we have used `granite-geospatial-downscaling` for 6x downscaling of MERRA-2 2m temperature data. That is, we take MERRA-2 data of 0.5 x 0.625 degrees resolution, coarsen it by a factor of six along each axis and then apply an additional smoothing filter via a 3x3 convolution. Subsequently we fine-tune the above architecture to recover the high resolution data. The weights for this are included here.
28
 
29
+ ## Data - ECCC (Environment and Climate Change Canada)
30
+
31
+ We use Prithvi WxC for the downscaling task on Canada’s operational Numerical Weather Prediction (NWP) systems. Specifically, the goal is to downscale forecasts from the Global Deterministic Prediction System (GDPS)—which provides 10-day forecasts at ~15 km resolution—to the High-Resolution Deterministic Prediction System (HRDPS), which produces 48-hour forecasts at ~2.5 km resolution. The weights for this are included here.
32
+
33
  ## Further applications - EURO-CORDEX
34
 
35
  In addition, we have used the same architecture with different hyperparameter choices for a 12x downscaling of a subset of EURO-CORDEX climate simulation.
downscaling_eccc_u10.png ADDED

Git LFS Details

  • SHA256: 295bed421e8c908e91747e55a356c896d65e2ab7b2796600b0ad6f7e9c118339
  • Pointer size: 132 Bytes
  • Size of remote file: 2.01 MB