OceanBench logo. OceanBench
  • Scores
  • Challengers
  • News
  • About
  • Documentation
    • Evaluation methods
    • Technical documentation
    • FAQ
    • Paper
  • Source code
  • Powered by EDITO logo and EU flag EDITO logo and EU flag

Open challenger datasets

import oceanbench

oceanbench.__version__
'0.6.1'

Insert here the code that opens the challenger dataset as challenger_dataset: xarray.Dataset

# SPDX-FileCopyrightText: 2025 Mercator Ocean International <https://www.mercator-ocean.eu/>
#
# SPDX-License-Identifier: EUPL-1.2

# Open HClimRep (WeatherGenerator) forecasts with xarray
import xarray
import oceanbench

challenger_dataset: xarray.Dataset = oceanbench.datasets.challenger.hclimrep()

challenger_dataset
<xarray.Dataset> Size: 74GB
Dimensions:             (first_day_datetime: 52, lead_day_index: 10, depth: 9,
                         latitude: 672, longitude: 1440)
Coordinates:
  * depth               (depth) float64 72B 0.494 47.37 92.33 ... 453.9 541.1
  * latitude            (latitude) float64 5kB -78.0 -77.75 -77.5 ... 89.5 89.75
  * longitude           (longitude) float64 12kB -180.0 -179.8 ... 179.5 179.8
  * lead_day_index      (lead_day_index) int64 80B 0 1 2 3 4 5 6 7 8 9
  * first_day_datetime  (first_day_datetime) datetime64[us] 416B 2024-01-03 ....
Data variables:
    so                  (first_day_datetime, lead_day_index, depth, latitude, longitude) float32 18GB dask.array<chunksize=(1, 1, 1, 672, 1440), meta=np.ndarray>
    thetao              (first_day_datetime, lead_day_index, depth, latitude, longitude) float32 18GB dask.array<chunksize=(1, 1, 1, 672, 1440), meta=np.ndarray>
    uo                  (first_day_datetime, lead_day_index, depth, latitude, longitude) float32 18GB dask.array<chunksize=(1, 1, 1, 672, 1440), meta=np.ndarray>
    vo                  (first_day_datetime, lead_day_index, depth, latitude, longitude) float32 18GB dask.array<chunksize=(1, 1, 1, 672, 1440), meta=np.ndarray>
    zos                 (first_day_datetime, lead_day_index, latitude, longitude) float32 2GB dask.array<chunksize=(1, 1, 672, 1440), meta=np.ndarray>
Attributes:
    oceanbench_reference_depth_grid_rounding_decimals:  3
    oceanbench_reference_target_depths_m:               [0.494, 47.374, 92.32...
    source:                                             WeatherGenerator infe...
    title:                                              WeatherGenerator GLOR...
xarray.Dataset
    • first_day_datetime: 52
    • lead_day_index: 10
    • depth: 9
    • latitude: 672
    • longitude: 1440
    • depth
      (depth)
      float64
      0.494 47.37 92.33 ... 453.9 541.1
      positive :
      down
      standard_name :
      depth
      units :
      m
      array([4.94025e-01, 4.73737e+01, 9.23261e+01, 1.55851e+02, 2.22475e+02,
             3.18127e+02, 3.80213e+02, 4.53938e+02, 5.41089e+02])
    • latitude
      (latitude)
      float64
      -78.0 -77.75 -77.5 ... 89.5 89.75
      standard_name :
      latitude
      units :
      degrees_north
      array([-78.  , -77.75, -77.5 , ...,  89.25,  89.5 ,  89.75], shape=(672,))
    • longitude
      (longitude)
      float64
      -180.0 -179.8 ... 179.5 179.8
      standard_name :
      longitude
      units :
      degrees_east
      array([-180.  , -179.75, -179.5 , ...,  179.25,  179.5 ,  179.75],
            shape=(1440,))
    • lead_day_index
      (lead_day_index)
      int64
      0 1 2 3 4 5 6 7 8 9
      array([0, 1, 2, 3, 4, 5, 6, 7, 8, 9])
    • first_day_datetime
      (first_day_datetime)
      datetime64[us]
      2024-01-03 ... 2024-12-25
      array(['2024-01-03T00:00:00.000000', '2024-01-10T00:00:00.000000',
             '2024-01-17T00:00:00.000000', '2024-01-24T00:00:00.000000',
             '2024-01-31T00:00:00.000000', '2024-02-07T00:00:00.000000',
             '2024-02-14T00:00:00.000000', '2024-02-21T00:00:00.000000',
             '2024-02-28T00:00:00.000000', '2024-03-06T00:00:00.000000',
             '2024-03-13T00:00:00.000000', '2024-03-20T00:00:00.000000',
             '2024-03-27T00:00:00.000000', '2024-04-03T00:00:00.000000',
             '2024-04-10T00:00:00.000000', '2024-04-17T00:00:00.000000',
             '2024-04-24T00:00:00.000000', '2024-05-01T00:00:00.000000',
             '2024-05-08T00:00:00.000000', '2024-05-15T00:00:00.000000',
             '2024-05-22T00:00:00.000000', '2024-05-29T00:00:00.000000',
             '2024-06-05T00:00:00.000000', '2024-06-12T00:00:00.000000',
             '2024-06-19T00:00:00.000000', '2024-06-26T00:00:00.000000',
             '2024-07-03T00:00:00.000000', '2024-07-10T00:00:00.000000',
             '2024-07-17T00:00:00.000000', '2024-07-24T00:00:00.000000',
             '2024-07-31T00:00:00.000000', '2024-08-07T00:00:00.000000',
             '2024-08-14T00:00:00.000000', '2024-08-21T00:00:00.000000',
             '2024-08-28T00:00:00.000000', '2024-09-04T00:00:00.000000',
             '2024-09-11T00:00:00.000000', '2024-09-18T00:00:00.000000',
             '2024-09-25T00:00:00.000000', '2024-10-02T00:00:00.000000',
             '2024-10-09T00:00:00.000000', '2024-10-16T00:00:00.000000',
             '2024-10-23T00:00:00.000000', '2024-10-30T00:00:00.000000',
             '2024-11-06T00:00:00.000000', '2024-11-13T00:00:00.000000',
             '2024-11-20T00:00:00.000000', '2024-11-27T00:00:00.000000',
             '2024-12-04T00:00:00.000000', '2024-12-11T00:00:00.000000',
             '2024-12-18T00:00:00.000000', '2024-12-25T00:00:00.000000'],
            dtype='datetime64[us]')
    • so
      (first_day_datetime, lead_day_index, depth, latitude, longitude)
      float32
      dask.array<chunksize=(1, 1, 1, 672, 1440), meta=np.ndarray>
      standard_name :
      sea_water_salinity
      units :
      1e-3
      Array Chunk
      Bytes 16.87 GiB 3.69 MiB
      Shape (52, 10, 9, 672, 1440) (1, 1, 1, 672, 1440)
      Dask graph 4680 chunks in 157 graph layers
      Data type float32 numpy.ndarray
      10 52 1440 672 9
    • thetao
      (first_day_datetime, lead_day_index, depth, latitude, longitude)
      float32
      dask.array<chunksize=(1, 1, 1, 672, 1440), meta=np.ndarray>
      standard_name :
      sea_water_potential_temperature
      units :
      degrees_C
      Array Chunk
      Bytes 16.87 GiB 3.69 MiB
      Shape (52, 10, 9, 672, 1440) (1, 1, 1, 672, 1440)
      Dask graph 4680 chunks in 157 graph layers
      Data type float32 numpy.ndarray
      10 52 1440 672 9
    • uo
      (first_day_datetime, lead_day_index, depth, latitude, longitude)
      float32
      dask.array<chunksize=(1, 1, 1, 672, 1440), meta=np.ndarray>
      standard_name :
      eastward_sea_water_velocity
      units :
      m s-1
      Array Chunk
      Bytes 16.87 GiB 3.69 MiB
      Shape (52, 10, 9, 672, 1440) (1, 1, 1, 672, 1440)
      Dask graph 4680 chunks in 157 graph layers
      Data type float32 numpy.ndarray
      10 52 1440 672 9
    • vo
      (first_day_datetime, lead_day_index, depth, latitude, longitude)
      float32
      dask.array<chunksize=(1, 1, 1, 672, 1440), meta=np.ndarray>
      standard_name :
      northward_sea_water_velocity
      units :
      m s-1
      Array Chunk
      Bytes 16.87 GiB 3.69 MiB
      Shape (52, 10, 9, 672, 1440) (1, 1, 1, 672, 1440)
      Dask graph 4680 chunks in 157 graph layers
      Data type float32 numpy.ndarray
      10 52 1440 672 9
    • zos
      (first_day_datetime, lead_day_index, latitude, longitude)
      float32
      dask.array<chunksize=(1, 1, 672, 1440), meta=np.ndarray>
      standard_name :
      sea_surface_height_above_geoid
      units :
      m
      Array Chunk
      Bytes 1.87 GiB 3.69 MiB
      Shape (52, 10, 672, 1440) (1, 1, 672, 1440)
      Dask graph 520 chunks in 157 graph layers
      Data type float32 numpy.ndarray
      52 1 1440 672 10
    • depth
      PandasIndex
      PandasIndex(Index([0.494025,  47.3737,  92.3261,  155.851,  222.475,  318.127,  380.213,
              453.938,  541.089],
            dtype='float64', name='depth'))
    • latitude
      PandasIndex
      PandasIndex(Index([ -78.0, -77.75,  -77.5, -77.25,  -77.0, -76.75,  -76.5, -76.25,  -76.0,
             -75.75,
             ...
               87.5,  87.75,   88.0,  88.25,   88.5,  88.75,   89.0,  89.25,   89.5,
              89.75],
            dtype='float64', name='latitude', length=672))
    • longitude
      PandasIndex
      PandasIndex(Index([ -180.0, -179.75,  -179.5, -179.25,  -179.0, -178.75,  -178.5, -178.25,
              -178.0, -177.75,
             ...
               177.5,  177.75,   178.0,  178.25,   178.5,  178.75,   179.0,  179.25,
               179.5,  179.75],
            dtype='float64', name='longitude', length=1440))
    • lead_day_index
      PandasIndex
      PandasIndex(Index([0, 1, 2, 3, 4, 5, 6, 7, 8, 9], dtype='int64', name='lead_day_index'))
    • first_day_datetime
      PandasIndex
      PandasIndex(DatetimeIndex(['2024-01-03', '2024-01-10', '2024-01-17', '2024-01-24',
                     '2024-01-31', '2024-02-07', '2024-02-14', '2024-02-21',
                     '2024-02-28', '2024-03-06', '2024-03-13', '2024-03-20',
                     '2024-03-27', '2024-04-03', '2024-04-10', '2024-04-17',
                     '2024-04-24', '2024-05-01', '2024-05-08', '2024-05-15',
                     '2024-05-22', '2024-05-29', '2024-06-05', '2024-06-12',
                     '2024-06-19', '2024-06-26', '2024-07-03', '2024-07-10',
                     '2024-07-17', '2024-07-24', '2024-07-31', '2024-08-07',
                     '2024-08-14', '2024-08-21', '2024-08-28', '2024-09-04',
                     '2024-09-11', '2024-09-18', '2024-09-25', '2024-10-02',
                     '2024-10-09', '2024-10-16', '2024-10-23', '2024-10-30',
                     '2024-11-06', '2024-11-13', '2024-11-20', '2024-11-27',
                     '2024-12-04', '2024-12-11', '2024-12-18', '2024-12-25'],
                    dtype='datetime64[us]', name='first_day_datetime', freq=None))
  • oceanbench_reference_depth_grid_rounding_decimals :
    3
    oceanbench_reference_target_depths_m :
    [0.494, 47.374, 92.326, 155.851, 222.475, 318.127, 380.213, 453.938, 541.089]
    source :
    WeatherGenerator inference, stream GLORYS
    title :
    WeatherGenerator GLORYS forecast (OceanBench challenger)

Evaluation configuration

region = 'global'

Evaluation of challenger dataset using OceanBench

Root Mean Square Deviation (RMSD) of variables compared to GLORYS reanalysis

oceanbench.metrics.rmsd_of_variables_compared_to_glorys_reanalysis(
    challenger_dataset,
    region=region,
)
Lead day 1 Lead day 2 Lead day 3 Lead day 4 Lead day 5 Lead day 6 Lead day 7 Lead day 8 Lead day 9 Lead day 10 Missing fraction
Sea surface height (m) [sea_surface_height_above_geoid]{surface} 0.057425 0.056209 0.055680 0.056279 0.056931 0.057972 0.058809 0.060121 0.060564 0.061341 0.0
Temperature (°C) [sea_water_potential_temperature]{surface} 0.569414 0.571436 0.571552 0.576926 0.583609 0.593100 0.606922 0.620153 0.630151 0.641157 0.0
Salinity (PSU) [sea_water_salinity]{surface} 0.407033 0.400458 0.396139 0.393590 0.391436 0.389414 0.388869 0.388221 0.387414 0.387337 0.0
Meridional current (m/s) [northward_sea_water_velocity]{surface} 0.113408 0.115208 0.117278 0.118897 0.120235 0.121488 0.123148 0.124611 0.125088 0.125690 0.0
Zonal current (m/s) [eastward_sea_water_velocity]{surface} 0.113757 0.116036 0.118370 0.120398 0.122246 0.123920 0.125722 0.127399 0.128221 0.128817 0.0
Temperature (°C) [sea_water_potential_temperature]{50m} 0.803433 0.794158 0.784475 0.780042 0.776525 0.778050 0.783837 0.792288 0.795297 0.801792 0.0
Salinity (PSU) [sea_water_salinity]{50m} 0.204695 0.202783 0.201230 0.200326 0.199648 0.199184 0.199132 0.199077 0.198684 0.198727 0.0
Meridional current (m/s) [northward_sea_water_velocity]{50m} 0.106350 0.106388 0.106701 0.107132 0.107666 0.108483 0.109621 0.110762 0.111144 0.111594 0.0
Zonal current (m/s) [eastward_sea_water_velocity]{50m} 0.106619 0.106460 0.106713 0.107199 0.107805 0.108639 0.109899 0.111128 0.111650 0.112298 0.0
Temperature (°C) [sea_water_potential_temperature]{100m} 0.949164 0.938250 0.931652 0.928391 0.923857 0.923478 0.926230 0.930069 0.929552 0.933853 0.0
Salinity (PSU) [sea_water_salinity]{100m} 0.166980 0.165561 0.164567 0.164004 0.163624 0.163175 0.163072 0.162901 0.162383 0.162129 0.0
Meridional current (m/s) [northward_sea_water_velocity]{100m} 0.102589 0.102181 0.102105 0.102156 0.102348 0.102782 0.103553 0.104354 0.104542 0.104800 0.0
Zonal current (m/s) [eastward_sea_water_velocity]{100m} 0.107215 0.106605 0.106261 0.106135 0.106177 0.106388 0.107070 0.107894 0.108181 0.108539 0.0
Temperature (°C) [sea_water_potential_temperature]{200m} 0.770964 0.766588 0.762911 0.760439 0.758454 0.757421 0.757777 0.758857 0.756374 0.757353 0.0
Salinity (PSU) [sea_water_salinity]{200m} 0.137408 0.136349 0.135598 0.134949 0.134389 0.133729 0.133312 0.132821 0.131957 0.131395 0.0
Meridional current (m/s) [northward_sea_water_velocity]{200m} 0.097627 0.096950 0.096653 0.096386 0.096139 0.095989 0.096095 0.096144 0.095901 0.095767 0.0
Zonal current (m/s) [eastward_sea_water_velocity]{200m} 0.104562 0.103491 0.102984 0.102527 0.102173 0.101915 0.101861 0.101820 0.101489 0.101288 0.0
Temperature (°C) [sea_water_potential_temperature]{300m} 0.642526 0.634240 0.629658 0.627636 0.626056 0.625461 0.626753 0.628582 0.626986 0.627493 0.0
Salinity (PSU) [sea_water_salinity]{300m} 0.112880 0.111972 0.111206 0.110580 0.109992 0.109273 0.108801 0.108290 0.107406 0.106892 0.0
Meridional current (m/s) [northward_sea_water_velocity]{300m} 0.093592 0.093008 0.092685 0.092305 0.091961 0.091692 0.091631 0.091470 0.091113 0.090890 0.0
Zonal current (m/s) [eastward_sea_water_velocity]{300m} 0.098848 0.098142 0.097820 0.097504 0.097212 0.096956 0.096874 0.096767 0.096481 0.096309 0.0
Temperature (°C) [sea_water_potential_temperature]{500m} 0.494777 0.488987 0.486393 0.485735 0.484865 0.484114 0.485314 0.486786 0.486130 0.487184 0.0
Salinity (PSU) [sea_water_salinity]{500m} 0.084581 0.083940 0.083384 0.083004 0.082636 0.082138 0.081786 0.081397 0.080726 0.080362 0.0
Meridional current (m/s) [northward_sea_water_velocity]{500m} 0.082761 0.082226 0.081856 0.081402 0.080994 0.080618 0.080389 0.080084 0.079683 0.079425 0.0
Zonal current (m/s) [eastward_sea_water_velocity]{500m} 0.087651 0.087015 0.086647 0.086292 0.085970 0.085660 0.085470 0.085239 0.084899 0.084699 0.0

Root Mean Square Deviation (RMSD) of Mixed Layer Depth (MLD) compared to GLORYS reanalysis

oceanbench.metrics.rmsd_of_mixed_layer_depth_compared_to_glorys_reanalysis(
    challenger_dataset,
    region=region,
)
Lead day 1 Lead day 2 Lead day 3 Lead day 4 Lead day 5 Lead day 6 Lead day 7 Lead day 8 Lead day 9 Lead day 10 Missing fraction
Mixed layer depth (m) [ocean_mixed_layer_thickness]{surface} 49.173928 48.783014 48.831201 49.229463 49.503646 50.0044 50.073611 50.275309 50.031265 50.686494 0.0

Root Mean Square Deviation (RMSD) of geostrophic currents compared to GLORYS reanalysis

oceanbench.metrics.rmsd_of_geostrophic_currents_compared_to_glorys_reanalysis(
    challenger_dataset,
    region=region,
)
Lead day 1 Lead day 2 Lead day 3 Lead day 4 Lead day 5 Lead day 6 Lead day 7 Lead day 8 Lead day 9 Lead day 10 Missing fraction
Meridional geostrophic current (m/s) [geostrophic_northward_sea_water_velocity]{surface} 0.112435 0.111052 0.110687 0.110510 0.110585 0.110971 0.11183 0.112745 0.112896 0.113183 0.0
Zonal geostrophic current (m/s) [geostrophic_eastward_sea_water_velocity]{surface} 0.106933 0.105500 0.105118 0.104978 0.105109 0.105472 0.10642 0.107432 0.107737 0.108242 0.0

Root Mean Square Deviation (RMSD) of variables compared to observations

oceanbench.metrics.rmsd_of_variables_compared_to_observations(
    challenger_dataset,
    region=region,
)

Deviation of Lagrangian trajectories compared to GLORYS reanalysis

oceanbench.metrics.deviation_of_lagrangian_trajectories_compared_to_glorys_reanalysis(
    challenger_dataset,
    region=region,
)

Root Mean Square Deviation (RMSD) of variables compared to GLO12 analysis

oceanbench.metrics.rmsd_of_variables_compared_to_glo12_analysis(
    challenger_dataset,
    region=region,
)

Root Mean Square Deviation (RMSD) of Mixed Layer Depth (MLD) compared to GLO12 analysis

oceanbench.metrics.rmsd_of_mixed_layer_depth_compared_to_glo12_analysis(
    challenger_dataset,
    region=region,
)

Root Mean Square Deviation (RMSD) of geostrophic currents compared to GLO12 analysis

oceanbench.metrics.rmsd_of_geostrophic_currents_compared_to_glo12_analysis(
    challenger_dataset,
    region=region,
)

Deviation of Lagrangian trajectories compared to GLO12 analysis

oceanbench.metrics.deviation_of_lagrangian_trajectories_compared_to_glo12_analysis(
    challenger_dataset,
    region=region,
)
 

EDITO, the European Digital Twin Ocean EDITO, the European Digital Twin Ocean