Carbon dioxide satellite observations completeness assessment for greenhouse gas monitoring

1.2.1. Carbon dioxide satellite observations completeness assessment for greenhouse gas monitoring#

🌍 Use case: Using satellite observations for quantifying global trends in greenhouse gas concentrations#

❓ Quality assessment question#

How the variability of spatial and temporal data coverage can affect the quantification of the long-term atmospheric carbon dioxide trends by satellite measurements (XCO2 Level 3 gridded product)?

Carbon dioxide (CO2) is the most important anthropogenic greenhouse gas, representing about 64% of the total radiative forcing by long living greenhouse gases [1]: in 2022, atmospheric CO2 represented the 150% of the pre-industrial level. In this assessment, atmospheric CO2 spatial seasonal means and trends are analysed using the XCO2 v4.4 Level 3 gridded product (OBS4MIPS)[2], by adopting an approach similar to [3].

Code is included for transparency but also learning purposes and gives users the chance to adapt the code used for the assesment as they wish. Since this assessment is an experimental product, users are referred to official sources for accurate reporting (e.g., [4], [5]).

📢 Quality assessment statement#

The dataset “Carbon dioxide data from 2002 to present derived from satellite observations” can be used to evaluate CO2 mean values, climatology and growth rate over the globe, hemispheres or large regions.

Caution should be exercised in certain regions (high latitudes, regions with frequent cloud cover, oceans) where data availability varies along the temporal coverage of the data set: this must be carefully considered when evaluating global or hemispheric information.

For data in high latitude regions or in regions with frequent cloud cover, users should consult uncertainty and quality flags as appropriate for their applications. In addition, for the years 2003-2008 only values over land are available, which has to be taken into account for possible applications of this dataset.

📋 Methodology#

Spatial seasonal means and trends are presented and assessed using the new XCO2 v4.4 Level 3 gridded product (OBS4MIPS), which has been generated using the Level 2 EMMA products [2] as input. No data sub-setting or selection has been performed, neither as a function of the number of individual Level 2 observations leading to the reported Level 3 values (“co2_nobs”), nor as a function of the standard error (“xco2_stderr”) provided in the data files.

To show how data coverage varies between years and seasons, we have calculated and plotted the average XCO2 values for singular seasons and years.

Spatial trends are calculated using a linear model (i.e. Theil-Sen slope estimator) over monthly anomalies (i.e. actual monthly values minus climatological monthly means). This should be treated with caution as the long-term trend of atmospheric CO2 is not strictly linear. The statistical significance of the trends is assessed using the Mann-Kendall test. Similar to [3], only land pixels are considered to avoid artefacts related to different data availability over oceans (the data product is land only for 2003-2008).

The analysis and results are organised in the following steps, which are detailed in the sections below:

1. Choose the data to use and set-up the code:

Import all the relevant packages
Choose the temporal and spatial coverage, land mask
Cache needed functions

2. Retrieve XCO2 data (OBS4MIPS)

In this section, we define the data request to CDS. Please note that users have to accept the GHG-CCI Licence for getting the dataset (see [4]).

3. Compute and plot the global variability of seasonal XCO2

To show how data coverage varies between years and seasons, we have plotted spatial average XCO2 values for seasons and years. Seasons are defined as December - February (DJF), March - May (MAM), June - August (JJA) and September – November (SON).

4. Compute global and spatial trends

Trends are calculated using a linear model (i.e. Theil-Sen slope estimator) over monthly anomalies (i.e. actual monthly values minus climatological monthly means). The statistical significance of the trends is assessed using the Mann-Kendall test.

📈 Analysis and results#

1. Choose the data to use and set-up the code#

Import all the relevant packages#

In this section, we import all the relevant packages needed for running the notebook.

Choose temporal and spatial coverage, land mask#

In this section, we define the parameters to be ingested by the code (users can change the temporal periods of analyses, the region of interest and activate/deactivate the land masking). With the aim to compare our results with existing licterature [4], the analysis is limited to time period from 2012 to 2021. However, specific data subsetting can be set by the users, so that data can be also retrived for other specific periods or regions.

Chache needed functions#

In this section, we cached a list of functions used in the analyses.

The function get_da (get_da_nomask) is used to subset the data for the defined time period and spatial region by applying (not appliyng) land mask (as a function of min_land_fraction).
The function convert_units rescale xco2 mole fraction to part per millions (ppm).
The seasonal_weighted_mean function extracts the regional means over the selected domains. It uses spatial weighting to account for the latitudinal dependence of the grid size in the lon-lat grids used for the reanalysis and for the forecast models. It is used by the function compute_seasonal_timeseries_nomask to provide the seasonal xco2 averaged value for each single year (Figure 1).
The function compute_anomaly_trends is used to calculate the trend and the related statistical significance.
The compute_monthly_anomalies function is used to derive the monthly xco2 anomalies before calculating the trends.

Show code cell source Hide code cell source

transform_func_kwargs = {
    "min_land_fraction": min_land_fraction,
    "variable": variable,
    "year_start": year_start,
    "year_stop": year_stop,
    "lon_slice": lon_slice,
    "lat_slice": lat_slice,
}

transform_func_kwargs_nommask = {
    "year_start": year_start,
    "year_stop": year_stop,
}

def get_da(
    ds, min_land_fraction, variable, year_start, year_stop, lon_slice, lat_slice
):
    da = ds[variable].sel(time=slice(str(year_start), str(year_stop)))
    da = utils.regionalise(da, lon_slice=lon_slice, lat_slice=lat_slice)
    if min_land_fraction is not None:
        return da.where(ds["land_fraction"] >= min_land_fraction)
    return da

def get_da_nomask(ds, year_start, year_stop):
    mask = (ds["time"].dt.year >= year_start) & (ds["time"].dt.year <= year_stop)
    ds = ds.where(mask.compute(), drop=True)
    (varname,) = set(ds.data_vars) & {"xco2"}
    da = ds[varname]
    return da

def convert_units(da):
    if da.name.endswith("_nobs"):
        return da

    with xr.set_options(keep_attrs=True):
        if da.name.startswith("xch4") and da.attrs["units"] != "ppb":
            da *= 1.0e9
            da.attrs["units"] = "ppb"
        elif da.name.startswith("xco2") and da.attrs["units"] != "ppm":
            da *= 1.0e6
            da.attrs["units"] = "ppm"
    return da


def compute_seasonal_timeseries_nomask(ds, year_start, year_stop):
    # Shift years (shift -1 to get D(year-1)J(year)F(year))
    da = get_da_nomask(ds, year_start, year_stop)
    da = da.assign_coords(year=ds["time"].dt.year.shift(time=-1).astype(int))
    # Get rid of 1st JF and last D, so it become [MAM, JJA, SON, DJF, ..., SON]
    da = da.isel(time=slice(2, -1))
    da = da.groupby("year").map(diagnostics.seasonal_weighted_mean)
    return convert_units(da).to_dataset()


def compute_statistics(ds, **get_da_kwargs):
    da = get_da(ds, **get_da_kwargs)
    da = diagnostics.spatial_weighted_statistics(da)
    return convert_units(da).to_dataset()


def compute_monthly_anomalies(ds, **get_da_kwargs):
    da = get_da(ds, **get_da_kwargs)
    with xr.set_options(keep_attrs=True):
        da = da.groupby("time.month") - da.groupby("time.month").mean()
    return convert_units(da)


def compute_mann_kendall_trend(da, **mann_kendall_kwargs):
    coords_name = {"time": "time", "x": "longitude", "y": "latitude"}
    ds_trend = Mann_Kendall_test(
        da, coords_name=coords_name, **mann_kendall_kwargs
    ).compute()
    return ds_trend.rename({k: v for k, v in coords_name.items() if k != "time"})


def compute_seasonal_detrended_anomaly(da, **polyfit_kwargs):
    da_trend = xr.polyval(
        da["time"], da.polyfit("time", **polyfit_kwargs).polyfit_coefficients
    )
    da_detrended = da - da_trend
    return da_detrended.groupby("time.year").map(diagnostics.seasonal_weighted_mean)


def compute_anomaly_trends(ds, **get_da_kwargs):
    da_anomaly = compute_monthly_anomalies(ds, **get_da_kwargs)

    # Mann-Kendall
    ds_mann_kendall = compute_mann_kendall_trend(
        da_anomaly, alpha=0.05, method="theilslopes"
    ).where(da_anomaly.notnull().any("time"))
    ds_mann_kendall["trend"].attrs = {
        "long_name": f"Trend of anomalies of {da_anomaly.attrs.get('long_name', da_anomaly.name)}",
        "units": f"{da_anomaly.attrs['units']}/month",
    }

    # Detrended anomalies
    da_detrended = compute_seasonal_detrended_anomaly(da_anomaly, deg=1)
    da_detrended.attrs = {
        "long_name": f"Detrended of anomalies of {da_anomaly.attrs.get('long_name', da_anomaly.name)}",
        "units": f"{da_anomaly.attrs['units']}",
    }

    ds_mann_kendall["detrended_anomaly"] = da_detrended
    return ds_mann_kendall

2. Retrieve XCO2 data (OBS4MIPS)#

In this section, we define the data request to CDS (data product OBS4MIPS, Level 3, version 4.4, XCO2).

3. Compute and plot the global variability of seasonal XCO2#

Results#

The seasonality of the availability of measurements is evident, with values available in the Southern Hemisphere (SH) mid and high latitudes from September to March, whereas values for the Northern Hemisphere (NH) mid and high latitudes are mostly available from April to August (Figure 1).

  0%|          | 0/1 [00:00<?, ?it/s]/data/common/miniforge3/envs/wp5/lib/python3.11/site-packages/xarray/core/duck_array_ops.py:215: RuntimeWarning: invalid value encountered in cast
  return data.astype(dtype, **kwargs)
100%|██████████| 1/1 [00:02<00:00,  2.48s/it]

../../_images/2720c7543c19369b4870bed659828c1b5340d54f5911826dc0242591cb681868.png

/data/common/miniforge3/envs/wp5/lib/python3.11/site-packages/scipy/stats/_mstats_basic.py:1158: RuntimeWarning: All `x` coordinates are identical.
  return stats_theilslopes(y, x, alpha=alpha, method=method)
/data/common/miniforge3/envs/wp5/lib/python3.11/site-packages/numpy/core/fromnumeric.py:3504: RuntimeWarning: Mean of empty slice.
  return _methods._mean(a, axis=axis, dtype=dtype,
/data/common/miniforge3/envs/wp5/lib/python3.11/site-packages/numpy/core/_methods.py:129: RuntimeWarning: invalid value encountered in scalar divide
  ret = ret.dtype.type(ret / rcount)
/data/common/miniforge3/envs/wp5/lib/python3.11/site-packages/xarray/core/nputils.py:248: RankWarning: Polyfit may be poorly conditioned
  warn_on_deficient_rank(rank, x.shape[1])
/data/common/miniforge3/envs/wp5/lib/python3.11/site-packages/xarray/core/nputils.py:248: RankWarning: Polyfit may be poorly conditioned
  warn_on_deficient_rank(rank, x.shape[1])

Figure 1. Global annual variability of seasonal XCO2. Different panels represent the individual seasons (column) and years (rows). Seasons are defined as December - February (DJF), March - May (MAM), June - August (JJA) and September - November (SON).

4. Compute global and spatial trends#

Results#

For 2012-2021, the mean global XCO2 growth rate is 2.28 ppm/yr. Taking into account the associated uncertainties and the different calculation methods, this value is in good agreement with the value of 2.46 ppm/yr provided by the WMO global in-situ observations [4]. The tropics and the middle and high latitudes are the regions that are not covered by measurements throughout the year or are characterised by higher uncertainty (see also [3]), and therefore the trend values are more variable and in some cases not statistically significant.

100%|██████████| 1/1 [00:04<00:00,  4.95s/it]

../../_images/ba6d58443cc3fd29929a2cb1235a324db0e26072ae34e50b60929a2ceb591082.png

Figure 2. Trends of XCO2 given in ppm/month calculated by using linear model (Theil-Sen) and Mann-Kendall test for statistical significance. Over each pixel, trends are calculated for monthly anomalies over land (“land_fraction > 0.5”). The shaded areas indicate pixels that did not pass the Mann-Kendall significance test. Global statistics for individual pixels are shown on the left.

ℹ️ If you want to know more#

Key resources#

The CDS catalogue entries for the data used were:

Carbon dioxide data from 2002 to present derived from satellite observations: https://cds.climate.copernicus.eu/datasets/satellite-carbon-dioxide?tab=overview

Code libraries used:

C3S EQC custom functions, c3s_eqc_automatic_quality_control, prepared by BOpen

Example of application#

Copernicus Climate Change Service (C3S). (2024). European State of the Climate 2023, Full report.

References#

[1] World Meteorological Organization. (2023). WMO Greenhouse Gas Bullettin, 19, ISSN 2078-0796.

[2] Buchwitz, M. (2023). Product User Guide and Specification (PUGS) – Main document for Greenhouse Gas (GHG: CO2 & CH4) data set CDR 6 (01.2003-12.2021), C3S project 2021/C3S2_312b_Lot2_DLR/SC1, v6.3.

[3] Reuter, M., Buchwitz, M., Schneising, O., Noël, S., Bovensmann, H., Burrows, J. P., Boesch, H., Di Noia, A., Anand, J., Parker, R. J., Somkuti, P., Wu, L., Hasekamp, O. P., Aben, I., Kuze, A., Suto, H., Shiomi, K., Yoshida, Y., Morino, I., Crisp, D., O’Dell, C. W., Notholt, J., Petri, C., Warneke, T., Velazco, V. A., Deutscher, N. M., Griffith, D. W. T., Kivi, R., Pollard, D. F., Hase, F., Sussmann, R., Té, Y. V., Strong, K., Roche, S., Sha, M. K., De Mazière, M., Feist, D. G., Iraci, L. T., Roehl, C. M., Retscher, C., and Schepers, D. (2020). Ensemble-based satellite-derived carbon dioxide and methane column-averaged dry-air mole fraction data sets (2003–2018) for carbon and climate applications. Atmospheric Measurement Techniques, 13, 789–819.

[4] World Meteorological Organization. (2022). WMO Greenhouse Gas Bullettin, 18, ISSN 2078-0796.

Carbon dioxide satellite observations completeness assessment for greenhouse gas monitoring

Contents

1.2.1. Carbon dioxide satellite observations completeness assessment for greenhouse gas monitoring#

🌍 Use case: Using satellite observations for quantifying global trends in greenhouse gas concentrations#

❓ Quality assessment question#

📢 Quality assessment statement#

📋 Methodology#

📈 Analysis and results#

1. Choose the data to use and set-up the code#

Import all the relevant packages#

Choose temporal and spatial coverage, land mask#

Chache needed functions#

2. Retrieve XCO2 data (OBS4MIPS)#

3. Compute and plot the global variability of seasonal XCO2#

Results#

4. Compute global and spatial trends#

Results#

ℹ️ If you want to know more#

Key resources#

Example of application#

References#