Methane retrievals from Greenhouse Gases Observing Satellite (GOSAT) shortwave infrared measurements: Performance comparison of proxy and physics retrieval algorithms


Corresponding author: D. Schepers, Netherlands Institute for Space Research, Sorbonnelaan 2, NL-3584 Utrecht CA, Netherlands. (


[1] We compare two conceptually different methods for determining methane column-averaged mixing ratios image from Greenhouse Gases Observing Satellite (GOSAT) shortwave infrared (SWIR) measurements. These methods account differently for light scattering by aerosol and cirrus. The proxy method retrieves a CO2 column which, in conjunction with prior knowledge on CO2acts as a proxy for scattering effects. The physics-based method accounts for scattering by retrieving three effective parameters of a scattering layer. Both retrievals are validated on a 19-month data set using ground-based image at 12 stations of the Total Carbon Column Observing Network (TCCON), showing comparable performance: for the proxy retrieval we find station-dependent retrieval biases from −0.312% to 0.421% of image a standard deviation of 0.22% and a typical precision of 17 ppb. The physics method shows biases between −0.836% and −0.081% with a standard deviation of 0.24% and a precision similar to the proxy method. Complementing this validation we compared both retrievals with simulated methane fields from a global chemistry-transport model. This identified shortcomings of both retrievals causing biases of up to 1ings and provide a satisfying validation of any methane retrieval from space-borne SWIR measurements, in our opinion it is essential to further expand the network of TCCON stations.

1. Introduction

[2] Methane (CH4) is an important contributor to the anthropogenically enhanced greenhouse effect [Intergovernmental Panel on Climate Change, 2007]. Monitoring its abundances in the Earth's atmosphere is one of the goals of the Greenhouse Gases Observing Satellite (GOSAT) [Yokota et al., 2004; Kuze et al., 2009]. The Fourier transform spectrometer on-board GOSAT (TANSO-FTS) operates in the shortwave infrared (SWIR) and thermal infrared (TIR) regions of the electromagnetic spectrum. The measurements in the shortwave infrared allow for the retrieval of CH4 column concentrations with high sensitivity at the Earth surface. Coupled with good spatial and temporal resolution, it can facilitate inverse modeling of methane sources and sinks.

[3] The use of space-based SWIR measurements for inverse modeling has been demonstrated with the SCIAMACHY instrument on-board ENVISAT [Bovensmann et al., 1999; Frankenberg et al., 2005, 2008; Bergamaschi et al., 2007; Schneising et al., 2009]. However, its usefulness strongly depends on the precision and accuracy that can be achieved. Even systematic biases of less than 1% can compromise the usefulness of such measurements for inverse modeling if they are correlated on regional or seasonal scales [Bergamaschi et al., 2007, 2009]. An important source of such errors are scattering events that take place along the light path through the Earth's atmosphere [O'Brien and Rayner, 2002; Mao and Kawa, 2004; Houweling et al., 2005; Frankenberg et al., 2005; Aben et al., 2007]. Such scattering leads to a light path that differs from the straight line from sun to satellite observer through reflection at the Earth surface. The amount to which the light path is modified strongly depends on the micro-physical properties, height distribution and number density of the scattering particles as well as on the ground scene albedo. This makes properly accounting for light path modification when processing satellite measurements a major challenge.

[4] Currently, two conceptually different methods for retrieving CH4 total column volume mixing ratio (VMR) are employed, differing in the way light path modification is treated. On the one hand the proxy retrieval aims to account for light path modification by simultaneously retrieving the total column of a proxy species, i.e. an atmospheric trace gas whose abundance in the atmosphere is assumed to be accurately known a priori. For CH4 retrievals from SWIR measurements, CO2 is the most suitable candidate [Frankenberg et al., 2005]. The retrieved CO2 column serves as a light path proxy by comparing it to the prior knowledge. Differences between the two are assumed to be the result of light path modification, which is subsequently corrected for in the target gas retrieval. This method has been extensively used for methane retrievals from SCIAMACHY [Frankenberg et al., 2005, 2008; Bergamaschi et al., 2007; Schneising et al., 2009] and more recently it has been applied to methane retrievals from GOSAT [Parker et al., 2011]. On the other hand, so-called physics-based algorithms have been developed that aim to account for light path modification by modeling the scattering processes that underlie it. These algorithms retrieve information about atmospheric aerosols and (thin) clouds simultaneously with the methane column. Physics-based retrieval algorithms for CH4 have recently been applied to synthetic and real GOSAT soundings [Butz et al., 2009, 2010; Bril et al., 2009; Butz et al., 2011].

[5] Butz et al. [2010]performed a comparison between proxy and physics-based methane retrievals using simulated GOSAT measurements for a realistic ensemble of atmospheric conditions. They concluded that overall the two methods perform comparably in accounting for the effect of atmospheric scattering, with slightly better performance by the proxy method. Proxy errors related to errors in the a priori CO2 columns, a potentially important error source, were not investigated in the study of Butz et al. [2010]. In this paper, we compare both retrieval methods using true GOSAT measurements. Here, we perform validation of the two methods with ground based measurements of the Total Carbon Column Observing Network (TCCON). Additionally, we describe the results of two case studies that represent challenging scenarios concerning the atmospheric scattering properties and the a priori CO2 fields. GOSAT measurements are discussed in section 2. For the proxy as well as the physics method we use a regularized least squares minimization. The retrieval concepts and specific setup of both retrievals algorithms are described in section 3. The two algorithms are verified by comparing corresponding GOSAT retrievals with collocated ground-based measurements and methane model fields as presented insection 4. Conclusions are presented in section 5.

2. GOSAT Measurements

[6] GOSAT, launched on 23 January 2009, is the world's first dedicated satellite for measuring atmospheric concentrations of carbon dioxide and methane. It was placed in a Sun-synchronous orbit at an altitude of 666 km and crosses the equator around 1 p.m. local time with a three day revisit time. The instruments on-board GOSAT are a Fourier Transform Spectrometer (TANSO-FTS) and the Cloud and Aerosol Imager (TANSO-CAI) [Kuze et al., 2009].

[7] TANSO-FTS employs a Michelson interferometer to observe sunlight that is back-scattered or emitted by the Earth's surface and atmosphere in the SWIR and TIR spectral regions. The SWIR spectra are recorded in three separate bands between 0.758 and 2.08μm with a typical spectral resolution of about 0.3 cm−1 [Kuze et al., 2009]. The TIR channel ranges from 5.56 to 14.3 μm. TANSO-FTS has an instantaneous field of view of 15.8 mrad creating a footprint with approximately 5 km radius at sea level at the sub-satellite point. The instrument is capable of pointing ±35° cross-track allowing it to take multiple cross-track soundings [Hamazaki et al., 2005]. During the time period covered by this research, TANSO-FTS was operated in 5 point mode (5 soundings cross-track) before 1 August 2010 and in three point mode after that date.

[8] The Cloud and Aerosol Imager (TANSO-CAI) consists of a radiometer with continuous spatial coverage with 1 km spatial resolution. It is used to retrieve cloud and aerosol properties, which allows for cloud filtering of TANSO-FTS soundings [Kuze et al., 2009].

[9] For this research the SWIR bands of TANSO-FTS are used to retrieve methane columns. In these bands, the back-scattered sunlight is recorded in two orthogonal polarization directions, from which the total back-scattered radiance signal is derived [Yoshida et al., 2011].

[10] For cloud screening, we implement a filter based on the TANSO-CAI L2 cloud flag data product. This product provides clear-sky confidence levels (from level 0, clear sky confidence less than 0.1, to level 15, clear sky confidence not less than 0.94) at ∼1 km spatial resolution at the sub-satellite point. We filter for clouded scenes by calculating the fraction of confidently clear-sky (level 15) TANSO-CAI pixels within a square box, centered at the TANSO-FTS footprint, with sides measuring approximately twice the TANSO-FTS footprint diameter. Considering a region considerably larger than the TANSO-FTS footprint minimizes the effect of spatial stray light which is scattered into the field of view by nearby clouds. A TANSO-FTS sounding is rejected if the fraction of confidently clear-sky TANSO-CAI pixels in the cloud screening box falls below 99% [Butz et al., 2011].

3. Retrieval Algorithm

3.1. Inversion

[11] The inversion algorithm aims to infer the state vector x from a spectral observation y. In this case the observation y is defined as the observed spectrum of back-scattered SWIR radiation measured by TANSO-FTS and the state vector x contains the parameters to be retrieved. The observation y and the state vector x are related through a forward model F:

display math

Here, vector b contains forward model parameters that are not retrieved, but must be known a priori. Furthermore, ϵ denotes the combined contribution of measurement noise and forward model errors.

[12] The forward model F is highly non linear in the state vector x, so the problem of inverting equation (1) with respect to x is solved in an iterative manner. For this, we propose the Gauss-Newton iteration scheme with reduced step size [Butz et al., 2010], meaning that for iteration k, the forward model F is linearized around the solution xk−1 of the previous iteration,

display math

where Δx = x − xk−1 and K denotes the Jacobian matrix with elements defined as

display math

For each iteration step, equation (1) is inverted with respect to xby minimizing a regularized least squares cost function, using the Phillips-Tikhonov regularization method [Phillips, 1962; Tikhonov, 1963]:

display math

with inline image and inline image. Here inline image denotes the observation covariance matrix.

[13] The regularization is based on adding an extra term to the minimization that is sensitive to the propagation of measurement noise. The use of x is appropriate in this case because methane is well mixed in the atmosphere and its vertical profile is smooth. Noise contributions on the retrieved state vector will increase the solution norm, thus making x sensitive to noise propagation. Such regularization is introduced because a TANSO-FTS observation y does not contain enough information to independently infer all retrieval parameters rendering the inverse problem ill-posed. Using an unregularized least squares approach would result in a solution that is overwhelmed by measurement noise that is associated with small singular values of the Jacobian inline image. In equation (4) the regularization parameter γ is introduced to filter the contributions of these singular components from the solution inline image. To illustrate this, inline image can be written in terms of the singular value decomposition of inline image:

display math

where N is the dimension of state vector x, U and V are orthogonal matrices containing the left and right singular vectors inline image and inline image and Σ is a diagonal matrix containing the singular values σi. The strictness of this filtering is governed by the regularization parameter γ through the filter factors

display math

To determine the optimal value of γfor each individual retrieval we use the L-curve method suggested by Hansen [1992]. The L-curve method enables us to regularize the retrieval based on the information content of the measurement, instead of regularizing based on prior knowledge as is done in the optimal estimation and related statistical regularization schemes.The regularized state vector can be written in terms of the true state vector inline image:

display math

Here, ϵx denotes measurement noise and forward model errors that propagated onto the state vector. The averaging kernel matrix A filters out those components of inline image to which the measurement is insensitive. The formal definition of A can be obtained by writing equation (5) in matrix from and substituting inline image:

display math

with Φ = diag(ϕi).

[14] The components of inline image to which the measurement is not sensitive are added to the solution state vector inline image from a prior estimate inline image:

display math

3.2. Proxy Retrieval

[15] The proxy retrieval aims to account for light path modification by retrieving the total column of an atmospheric trace gas whose abundance in the atmosphere is assumed to be accurately known from prior sources [Frankenberg et al., 2005]. The retrieved column serves as a light path proxy by comparing it to the prior knowledge. Differences between the two are assumed to be the result of light path modification, which is subsequently corrected for in the target gas retrieval. The assumptions underlying this retrieval method are that the light path modification in the spectral windows of the target and the proxy species is the same, as well as the relative vertical distribution of both species in the atmosphere. As proposed by Frankenberg et al. [2005] we use CO2 as the light path proxy. Its atmospheric abundance is available from, for instance, the Carbon Tracker data assimilation system [Peters et al., 2007] that is used in this research. For the retrieval, we use the R branch of the 2ν3 methane band around 1.65 μm and the weakly absorbing CO2 lines around 1.61 μm (windows 2 and 3 in Table 1). Figure 1 shows typical TANSO-FTS observations in these spectral windows. From the retrieved CH4 and CO2 profiles, the total column number densities [CH4] and [CO2] are readily calculated.

Table 1. Spectral Range and Considered Absorbers for the Spectral Windows That are Used in the Proxy and Physics Retrieval Methodsa
 Window Identification
  • a

    An ‘x’ indicates the windows that are used in the particular retrieval methods.

Spectral range (μm)0.758–0.7741.591–1.6221.629–1.6542.042–2.081
AbsorbersO2CO2CH4H2O, CO2
  H2OH2O, CO2 
Figure 1.

Typical TANSO-FTS reflectance measurements in the spectral windows that are used in the proxy and the physics retrieval: (top left) the O2 A band, (top right) the weakly absorbing CO2 lines around 1.6 μm, (bottom left) the R-branch of the 2ν3 CH4 band and (bottom right) the strongly absorbing CO2 band around 2.0 μm.

[16] Subsequently the column-averaged dry mole fraction of methane image is calculated through the following relation [Frankenberg et al., 2005]:

display math

Here, image is the total column dry mole mixing ratio of CO2 from the CarbonTracker model. The use of [CO2] as the light path proxy in equation (10) implicitly assumes that neglect of scattering linearly scales the retrieved total columns of CH4 and CO2 to the same extend, such that it cancels out in the ratio [CH4]/[CO2]. Moreover, the accuracy of the CH4 proxy retrieval is directly dependent on the accuracy to which the CO2 concentrations can be modeled.

[17] For the proxy retrieval, the CO2 and CH4column number densities are retrieved under the assumption of a non-scattering atmosphere, thus assuming a direct light path from the Sun to the observing instrument in Earth orbit, via reflection at the Earth's surface. The state vector is formed by complementing the partial column number densities for CO2 and CH4 in 12 atmospheric layers, with the partial column number densities of interfering absorbers (see Table 1), the albedo of the ground scene and its spectral slope. The forward model parameter vector b contains pressure and temperature profiles and spectroscopic parameters which includes line-mixing for CO2 and Oxygen [Tran and Hartmann, 2008]. Profiles of atmospheric pressure, temperature and humidity that are used for our retrievals are provided by the ECMWF (European Center for Medium-Range Weather Forecast) ERA-interim analysis [Berrisford et al., 2009]. These data are provided 6-hourly on a 1.5 by 1.5 degree latitude/longitude grid and are interpolated onto the time and location of the TANSO-FTS observation. Surface elevation is extracted from the GTOPO30 digital elevation model. Initial guess profiles for methane are provided by a TM4 global transport model run for 2007 [Meirink et al., 2006]. The initial carbon dioxide profiles come from Carbon Tracker 2010 simulations [Peters et al., 2007] for the year 2009. Since CarbonTracker 2010 only provides CO2 priors for 2009, we extrapolate the CO2 model field to year 2010 which are required by our proxy retrieval. This extrapolation is done based on CO2background surface concentration measurements at three ground stations (Alert, Mauna-Loa and South Pole). For each month in 2010, an increase with respect to the same month in 2009 was determined and subsequently added to the global CarbonTracker CO2 field.

[18] The proxy method has been extensively used for methane retrievals from SCIAMACHY near infrared soundings, for instance in Frankenberg et al. [2005, 2008]; Bergamaschi et al. [2007] and Schneising et al. [2009]. The main difference with our implementation is the inversion technique and the spectral windows that are used. Parker et al. [2011] employed a proxy retrieval method, using CO2 as the proxy species, to retrieve methane total columns from TANSO-FTS SWIR measurements. In their setup a constant, fixed aerosol load was assumed in the forward model instead of the non-scattering atmosphere assumed in our setup. This disregards one advantage of the proxy method, namely the gain in computational speed that is realized by assuming a non-scattering atmosphere. Furthermore, where their inversion utilizes the optimal estimation method, we use Phillips-Tikhonov regularization to stabilize the retrieval.

3.3. Physics-Based Retrieval

[19] In contrast to the proxy method, the physics-based retrieval aims to deal with light path modification by explicitly modeling the atmospheric scattering processes that underlie it. The retrieval scheme utilizes the same Phillips-Tikhonov regularized inversion as the proxy method, but the retrieval setup is conceptually different. For the physics-based retrieval, the partial dry column number densities of methane are retrieved simultaneously with scattering properties of the model atmosphere. Subsequently, these number densities are converted to dry air total column mixing ratios using surface pressure data provided through the ECMWF's ERA-interim analysis [Berrisford et al., 2009]. The surface pressure is corrected to represent the dry air column using the humidity profile from the same ERA-interim analysis. This approach has been extensively discussed and applied to CO2 and CH4 retrievals from simulated measurements [Butz et al., 2009, 2010] and TANSO-FTS measurements [Butz et al., 2011]. The radiative transfer model developed by Hasekamp and Butz [2008] is employed in its scalar approximation mode, accounting for multiple scattering but neglecting polarization effects.

[20] Atmospheric scattering is described using a single aerosol layer parameterized by a Gaussian height distribution and a power law size distribution. This parametrization is incorporated in the retrieval by adding three extra fit parameters to the state vector: the mean height of the aerosol layer, the size parameter of the power law distribution and an aerosol number density. The width of the aerosol layer is fixed to 2 km. The real and imaginary refractive indices are assumed wavelength independent and fixed to 1.4 and −0.003 respectively. Butz et al. [2010]discuss the parametrization and the assumed characteristics of the modeled aerosol in a comprehensive manner. Note that by assuming a relatively simple aerosol model the retrieved aerosol parameters are effective scattering parameters that reproduce appropriate light path modification and thus might not be representative of the true properties of the aerosols within the TANSO-FTS field of view.

[21] The spectral observations used for the physics algorithm cover the methane and weak CO2 absorption bands around 1.6 μm that are also used in the proxy approach. To retrieve the effective scattering parameters, these bands are complemented with the strong CO2 band around 2.0 μm as well as with the oxygen A band at 760 nm (see Table 1). The additional two bands are modeled using a spectroscopy which includes line-mixing and collision-induced absorption in the oxygen A band. Typical observations in the spectral windows are shown inFigure 1.

4. Algorithm Verification

4.1. Validation With Ground-Based Measurements

[22] To validate our retrievals, we use methane and carbon dioxide column mixing ratio measurements provided through the Total Carbon Column Observing Network (TCCON) [Wunch et al., 2011]. The network uses ground-based sun-viewing Fourier Transform Spectrometer to obtain SWIR spectra, from which CH4 and CO2column-average dry-air mole fractions can be retrieved. Based on aircraft overflights a global calibration factor is applied to the TCCON total column mixing ratios [Wunch et al., 2010].

[23] We selected 12 TCCON sites based on data coverage (both TCCON and GOSAT) and geographical location, such that they cover the largest possible latitudinal range. The selected TCCON sites are listed in Table 2 and their geographical locations are plotted in Figure 6. The TCCON site at Izana is excluded because all GOSAT soundings within the collocation criteria are located over the African mainland, where the surface elevation is ∼2 km lower than at Izana. This makes direct comparison of total columns difficult. For the remaining TCCON sites we consider 19 months of TANSO-FTS soundings between June 2009 and December 2010. Only GOSAT soundings within a 5° radius around the TCCON site are considered. After filtering for GOSAT error flags, soundings with a large solar zenith angle (>70°) or a large viewing angle (>30°) are discarded to prevent significant errors introduced both by the plane-parallel model atmosphere assumed in the forward model and by pointing instability associated with the TANSO-FTS instrument. Furthermore, soundings with highly variable surface elevation (>300 m peak-to-peak) within the TANSO-FTS footprint and those with less than 99% confidently cloud free TANSO-CAI pixels in the cloud screening box (seesection 2) are not considered to prevent errors through topography or (partial) cloud cover.

Table 2. Latitude, Total Number of TCCON-GOSAT Retrieval Pairs (N), Average Albedo, the Average Retrieval Bias (b) (TCCON - GOSAT) and the Single-Sounding Precision (σ) of the GOSAT image Retrievals at the Selected TCCON Stations Using the Physics and Proxy Retrieval Methodsa
Station NumberStationLatitude (deg)NAlbedo at 1.6 μmPhysicsProxy
σ (ppb)b (%)σ (ppb)b (%)
  • a

    At the bottom of the table the mean bias inline image, the mean single sounding precision inline image and the standard deviation of the station biases (σbias) is given for each retrieval method.

7Park Falls45.953380.18816−0.42916−0.104
 All stations 2628  inline image inline image inline image inline image
     σbias = 0.24 σbias = 0.22 

[24] The resulting set of soundings was processed with both the physics and proxy algorithms. Subsequently the results were filtered based on the spectral fit, discarding soundings with a χ2 > 4. In addition, scenes with significant cirrus contamination are filtered out using a filter based on the radiance level in the strongly absorbing water bands in the 2 μm region. The possibility of applying an a posteriori filter based on the retrieved effective scattering parameters is unique to the physics retrieval method. Such filter was proposed by Butz et al. [2010], discarding all cases for which ωs ≡ τs × 1/αs × zs is larger than a threshold value ωmax that governs the strictness of the filter. Here τs, αs and zs denote the aerosol optical thickness, the power law size parameter and height of the aerosol layer that are fitted in the physics retrieval. In other words, a sounding is most likely discarded in case of optically thick aerosol and cirrus with large scattering particles high in the atmosphere. Butz et al. [2010] applied a threshold of ωmax = 300 m, which has been empirically determined. Unless stated otherwise, this filter has been applied to the physics retrieval results presented here.

[25] To compare similar data sets, the proxy results are also filtered such that only soundings are considered that passed the posterior aerosol filter in the physics retrieval. Figures 2 and 3 show resulting image time series over the selected TCCON sites. In the same panel, all TCCON image values retrieved within ±2 hours of the GOSAT overpass time are plotted.

Figure 2.

Time series of image selected TCCON stations. Ground-based-FTS retrievals from TCCON (gray) are overplotted with our TANSO-FTS retrievals using the physics algorithm (green dots) and the proxy algorithm (red crosses). The lines represent smoothed time series using a 10-day boxcar running mean. All TCCON retrievals within ±2 hours of a GOSAT overpass are plotted.

Figure 3.

Same as Figure 2, for additional locations.

[26] At first glance, both the physics and the proxy algorithms reproduce the (seasonal) variation of image is present in the ground-based data equally well, while the proxy retrievals show consistently higher mixing ratios than the physics retrievals. Also, it shows that GOSAT data coverage over the TCCON sites has a strong seasonal dependence resulting, for instance, in a data gap in winter for most of the northern hemisphere stations.

[27] For a quantitative comparison of our retrievals we define the mean of the difference between collocated GOSAT-TCCON retrieval pairs as the retrieval bias b. The standard deviation σof the differences is used to estimate the single-sounding precision of our retrievals. We use the standard deviation of the station biases σbias to estimate the inter station bias variability. Furthermore we define the mean retrieval bias inline image by averaging all station biases weighted by the number of soundings per station. Similarly, the mean single sounding precision inline image is obtained by taking the weighted average of the estimated single sounding precisions for each station.

[28] Table 2 shows the bias band the estimated single-sounding precisionσ for each of the TCCON sites as well as the number of data points Nused for the analysis. For the physics retrieval method the bias ranges from −0.836% at Sodankyla to −0.081% at Garmisch with a standard deviation of 0.24% and a single sounding precision typically between 13 and 20 ppb. For the proxy retrievals we find station-dependent biases that range from −0.312% at Sodankyla to 0.421 at Garmisch, with a 0.22% standard deviation and a single sounding precisions between 9 ppb and 21 ppb. Based on the presented comparison at the 12 TCCON validation sites, both retrievals shows very similar performance in terms of station to station bias variabilityσbias.

[29] The difference in terms of bias with respect to TCCON between the physics retrievals ( inline image) and the proxy retrievals ( inline image) could be caused by the fact that the physics retrieval employs two spectral bands that are not used in the proxy approach, which might introduce a bias through spectroscopy. In the proxy retrievals, radiometric calibration inaccuracies are likely to cancel out as it takes the ratio of retrieved [CH4] and [CO2] columns, however spectroscopic errors might introduce inconsistency between retrieved CO2 column and the prior CO2 column, potentially leading to a bias in image (see equation (10)).

[30] For an overall evaluation of the different retrieval approaches based on the presented results, one should keep in mind several aspects. The difference, in terms of inter station bias variability σbias , between the proxy and the physics retrievals is small which makes it difficult to judge the significance of these results. Second, the present TCCON sites are limited for validation purposes for several reasons. Apart from a limited spatial coverage, the TCCON sites used in this study show a very limited range in ground scene albedo (average albedo in Table 2 varies between 0.144 and 0.270 where the full range around 1.6 μm covers ∼0.05–0.75 (P. Tol, personal communication, 2010) [Butz et al., 2010]) and most of the stations suffer from seasonal data gaps in both TCCON and GOSAT data, mostly caused by the presence of clouds or instrument issues. Thirdly, in order to create two comparable sets of soundings, the proxy data have been filtered strictly by only considering those soundings that passed posterior filtering based on the physics retrieval. This may hide any advantage or disadvantage of the proxy method. Overall, these aspects make it hard to draw conclusions on the overall performance of both retrieval approaches. To gain more insight into this we investigate the effect of seasonal data coverage and the posterior scattering filter more in-depth.

[31] The posterior scattering filter is unique to the physics approach. Applying it to the proxy results was only necessary to create equal data sets. We investigate how such filtering influences the retrieved image for both retrieval methods. Figure 4 shows the residual methane total columns from individual GOSAT retrievals with respect to collocated TCCON measurements, as a function of the scattering filter quantity ωs. As expected, the physics retrieval residuals show a clear dependence on ωs, underestimating image by more than 4% for ωs > 300 m. This indicates that the physics approach has limited effectiveness when dealing with many scattering particles located high up in the atmosphere and also represents the main motivation for introducing the filter with ωmax = 300 m. The proxy retrievals also show a clear dependence on atmospheric scattering properties. Although this dependence is smaller than for the physics retrieval it leads to a maximum underestimation of image by >1% for high values of ωs forthe proxy method. This dependence on atmospheric scattering can be traced back to the ratio term [CH4]/[CO2]. We did not expect this behavior since the effects of scattering in the atmosphere are assumed to cancel out by taking the ratio. Thus, in order to achieve an overall accuracy of <1%, the proxy retrieval also needs some a posteriori filtering, although it can be significantly relaxed with respect to the a posteriori filtering applied in this study. It is however important to note that the filter we have applied is based on retrieval parameters that are only available when using the physics retrieval approach.

Figure 4.

Retrieval residuals (GOSAT-TCCON) over all considered TCCON sites for proxy and physics retrievals as function of the scattering parameterωs. Linear regression lines are drawn through both point clouds.

[32] Continuous data coverage throughout the year at the TCCON site at Lamont enables us to compare the seasonal cycles that are retrieved by both retrievals methods. Figure 5 shows the residuals in percent of the total column mixing ratio for individual proxy and physics retrievals with respect to collocated TCCON measurements. Here, the annual mean difference has been subtracted for both retrievals. The proxy retrievals clearly show a temporal variation of the residuals with an amplitude of ∼0.75% of the total column mixing ratio. Between September 2009 and May 2010, the proxy retrieval overestimates the TCCON methane columns, while it underestimates TCCON methane columns from June to December 2010. The proxy residuals can subsequently be split into contributions of the ratio term [CH4]/[CO2], and the CarbonTracker prior CO2 column (see equation (10)) by comparing these quantities to ground based measurements independently. In the same panel, the residuals of the ratio term and the a priori CO2 column with respect to TCCON measurements are also plotted. Clearly, the proxy retrieval residuals over the Lamont site predominantly stem from the residuals in the ratio term, indicating that uncertainties in the CH4and CO2 column density retrievals do not always cancel out to the same extent by taking their ratio. The temporal variation of the residuals on the ratio term seems to indicate some seasonal dependence, however the short data record and significant differences between behavior in 2009 and 2010 make it hard to conclude on that with certainty at this point. Note that due to the seasonal data gaps at the majority of the TCCON sites, the values in Table 2 are biased towards the summer season.

Figure 5.

Residual seasonal cycles at Lamont (GOSAT - TCCON) for proxy and physics retrievals. Also the residuals of the proxy ratio [CH4]/[CO2] and CarbonTracker prior CO2with respect to TCCON ground-based measurements are plotted. The time series is smoothed using a 10-day boxcar running mean, and the annual mean difference has been subtracted.

[33] Butz et al. [2010] discuss the following three potential error sources in the proxy ratio as a result of atmospheric scattering: (1) differences in the optical properties of the scattering particles and molecules in the CH4 and CO2 retrieval ranges, (2) difference in surface albedo between the CH4 and the CO2 retrieval windows and (3) differing height sensitivities of the CH4 and CO2 retrievals. For synthetic measurements, the second and third error source were found to be both in the 0.5% range with opposite sign leading to a cancelation of errors in many cases. Therefore, a likely explanation for the time dependent bias of the proxy retrievals could be found in variation of these two error sources: Assuming two error sources of similar magnitude and opposing sign show different variations in time, the net result would be a retrieval bias that varies in time.

4.2. Scenarios Not Covered by Ground-Based Measurements

[34] In this section we compare our retrievals with model calculations using a global multiyear model assimilation of methane abundances considering two regions of the globe that show considerable differences between proxy and physics retrievals and are not covered by the validation with TCCON ground-based measurements. Both regions are indicated inFigure 6. The methane model fields are assimilated for the period 2009–2010 using in situ measurements provided through the Earth System Research Laboratory (ESRL) global air sampling network [e.g., Dlugokencky et al., 2009]. The assimilation scheme [Meirink et al., 2008a, 2008b] is driven by the atmospheric transport model TM5 [Krol et al., 2005] on a 4° × 6° (latitude × longitude) grid. For each GOSAT sounding, processed with both our retrieval algorithms, that passed filtering with ωmax = 300 m, a collocated image is extracted from the TM5-NOAA optimized fields and integrated to a methane total column mixing ratio. In this way, three data sets are created that can be directly compared.

Figure 6.

Regions of the globe that we selected to compare our retrievals against TM5-NOAA methane fields: the Sahara and Arabian peninsula and the Indian subcontinent. The locations of the TCCON stations used in this research are indicated and numbered according toTable 2.

[35] We observe prominent differences between our proxy and physics retrievals over the Sahara. Time series of retrieved image over this region are shown in Figure 7. In the same figure, the time series of collocated image results are plotted. The latter are off-set by the global average difference between the physics retrievals and TM5-NOAA. We find that the physics method consistently retrieves higher image the proxy method during spring and summer, while in winter both methods agree. Overall, the seasonal cycle of the proxy retrieval agrees better with TM5-NOAA than the physics retrievals. The difference in spring and summer coincides with increased dust storms in the Sahara region, resulting in high scattering optical thickness. This is illustrated inFigure 8 where the residuals image between the retrieved and modeled CH4 column densities are plotted as a function of collocated aerosol optical depth at 0.66 μm as seen by MODIS Terra [Remer et al., 2005] for the Sahara region. Here, aerosol optical depth is correlated with an overestimation of methane total column by the physics method, even when the a posteriori scattering filter has been applied. This behavior is comparable, although smaller in magnitude, to the behavior of non-scattering retrievals in the presence of aerosol [Aben et al., 2007], which indicates that the physics retrieval does not sufficiently account for scattering in high optical depth scenes over bright surfaces. Also the proxy retrieval shows this behavior but to a lesser extent, once more indicating that not all uncertainties introduced by scattering cancel out by taking the ratio [CH4]/[CO2].

Figure 7.

(top) Time series of image retrieved with the proxy method and the physics method as well as image the TM5-NOAA inversion over the Sahara region. (bottom) Time series image (GOSAT - TM5-NOAA) over the Sahara region. Both time series are smoothed with a 10 day boxcar running averaging function.

Figure 8.

Retrieval residuals (GOSAT - TM5-NOAA) as function of collocated MODIS optical depth at 0.66μm over the Sahara region [Remer et al., 2005]. The data points were obtained using a 10 day box-car average. Linear regression lines are drawn through both point clouds.

[36] To indicate the significance of this dependence on MODIS optical thickness, we estimated the uncertainty on the slope of the linear regression using the spread of the data around their regression as an overall estimate for data uncertainty. In both cases, the one sigma uncertainty is similar in value to the slope of the regression line, leading us to conclude that the dependence can be detected with a one sigma confidence.

[37] Analogous to the discussion of performance over desert areas, we investigate the retrieval performance over the Indian subcontinent. Time series of retrieved and modeled image over this region are plotted in Figure 9(top) which shows that the proxy retrieval gives a seasonal cycle with a larger amplitude than the physics retrieval and the TM5-NOAA inversion. This effect is most prominent in spring, when the proxy retrieval shows a continuous decrease in image the physics retrievals and TM5-NOAA show a virtually constant methane column mixing ratio. We identified the source of this feature by comparing the proxy ratio and the CarbonTracker prior CO2 against image and image from the physics retrieval. Figure 9 (middle and bottom) show that the underestimation of methane by the proxy method in spring coincides with a period in which the CarbonTracker CO2 fields underestimate the physics CO2 retrievals. The fact that image the physics retrieval follows the seasonality of TM5-NOAA combined with agreement between [CH4]/[CO2] and the image ratio from the physics retrieval gives us confidence in the latter. To rule out the possibility that this feature is a consequence of the extrapolation of CarbonTracker 2009 fields to 2010, Figure 10 shows the same data sets but without the posterior scattering filter applied. By dropping the filter we gain enough data in June 2009 to see the same feature as we see in spring 2010; i.e. the proxy method retrieves lower values of image than the physics retrieval, while Carbontracker shows lower total column CO2 mixing ratios than the physics retrieval. This leads us to conclude that an erroneous seasonal cycle (amplitude) in CarbonTracker introduces significant errors in methane column mixing ratios retrieved by the proxy method over the Indian subcontinent where CarbonTracker is poorly constrained [Patra et al., 2011].

Figure 9.

(top) Time series of image retrieved with the proxy method and the physics method as well as image the TM5-NOAA inversion over the Indian subcontinent. (middle) Time series of image retrieved with the physics method and the prior image from CarbonTracker that is used for the proxy retrievals. (bottom) The ratio [CH4]/[CO2] used in the proxy retrieval compared to image by the physics method. All time series are smoothed using a 10-day boxcar running mean.

Figure 10.

Same as Figure 9 but without the posterior aerosol filter applied to retain more data in summer 2009.

[38] In summary, the results of our study agree with results from the study by Butz et al. [2010] based on synthetic GOSAT measurements. Butz et al. [2010] concluded that both the physics as well as the proxy retrievals are capable of retrieving image in aerosol loaded scenes with retrieval errors less than 1%, which agrees with our findings. In accordance with that same study, we also find that the proxy retrieval shows a more narrow distribution of errors than the physics retrievals, where the latter benefits from filtering scenes containing elevated layers of coarse aerosol. Furthermore, using real GOSAT measurements, we confirmed the statement made by Butz et al. [2010] that the proxy retrieval errors are likely to be dominated by errors in the prior image

5. Conclusions

[39] We presented a performance analysis comparing two algorithms for retrieving methane total column mixing ratios from GOSAT measurements of back-scattered shortwave infrared solar radiation. The algorithms differ in the way they treat the effect of scattering by aerosols and cirrus particles on the retrieved methane column density. On the one hand, the proxy method relies on retrieving CO2 as a proxy for light path. On the other hand, the physics algorithm aims to model any light path modification using three effective retrieval parameters that govern the model atmosphere's scattering properties.

[40] A comparison of these algorithms with ground-based measurements of CH4total column was carried out at 12 TCCON stations around the globe. Using a 19 month data set, ranging from June 2009 to December 2010, we find that both retrievals perform very similarly in terms of inter-station bias and precision. For the proxy retrieval we find a station averaged retrieval bias with respect to ground-based measurements that varies from −0.312% to 0.421% with a standard deviation of 0.22% and a typical precision of 17 ppb. For the physics retrieval we find biases between −0.836% and −0.081% with a standard deviation of 0.24% and a typical precision of 17 ppb. At the TCCON site at Lamont, where there is data coverage throughout the year, we find that residuals of the proxy retrieval show a temporal dependence of ∼1% peak-to-peak. For the physics retrievals this peak-to-peak variation amounts to ∼0.5%. For both retrievals we find that the residuals with respect to TCCON measurements show a dependence on the amount of scattering. For the physics algorithm this amounts to a maximum underestimation of ∼4 % when no filter is applied to reject highly scattering scenes. Surprisingly, the proxy retrievals also show a clear dependence on atmospheric scattering, amounting to >1% of the total column. This behavior is unexpected because scattering effects are assumed to cancel out in the proxy method. Thus, in order to achieve an overall retrieval accuracy of <1% both retrievals need some form of a posteriori filtering. This analysis, based on comparison with ground-based measurements, cannot be considered to be fully representative for global retrievals because of the limited spatial coverage, the small albedo range and the seasonal data gaps at many TCCON stations. To complement the validation with ground-based measurements, we compared both retrievals with simulated methane fields from a global multiyear inverse data scheme, assimilating in situ ground-based measurements of methane.

[41] We found a pronounced difference between the different retrievals over the desert regions of North Africa and the Middle East, where the physics retrieval overestimated total column CH4 by ∼1% in the high aerosol optical depth atmosphere. This indicates that scattering over bright surfaces is not treated properly by the physics method.

[42] Over the Indian subcontinent the proxy retrieval overestimates the amplitude of the seasonal cycle, especially overestimating CH4 mixing ratios by up to 1% in spring. This feature was traced back to an erroneous seasonal cycle amplitude in the prior CO2 fields used to determine light path modification.

[43] Overall, the results of our study agree with results from the study by Butz et al. [2010] based on synthetic GOSAT measurements. Using real GOSAT measurements, we confirmed that both the proxy and the physics method are capable of retrieving image in aerosol loaded scenes with retrieval errors less than 1%, where the physics method strongly benefits from filtering scenes containing elevated layers of coarse aerosol. Furthermore we confirmed that the retrieval errors of the proxy method are likely to be dominated by errors in the prior image

[44] Although the relevance of these findings for an overall analysis of retrieval performance is hard to estimate, we did identify some typical weaknesses in both retrieval approaches. Furthermore, our results indicate that the limited spatial and albedo coverage of the present sites within the TCCON limits its suitability for validation of methane retrievals from satellite measurements. We believe that extending the network of validation stations is essential for gaining more insight in the performance of methane total column retrieval from space-borne shortwave infrared measurements.


[45] A.B. is supported by Deutsche Forschungsgemeinschaft (DFG) through the Emmy-Noether programme, grant BU2599/1–1 (RemoteC). Access to GOSAT data was granted through the 2nd GOSAT research announcement jointly issued by JAXA, NIES, and MOE. TCCON data were obtained from the TCCON Data Archive, operated by the California Institute of Technology from the Web site at GTOPO30 is available from the U.S. Geological Survey through the Earth Resources Observation and Science (EROS) Center ( MODIS Atmosphere data are distributed through CarbonTracker results are provided by NOAA-ESRL, Boulder, Colorado, USA through