ERA-Interim

Report of the 4th World Climate Research Programme International Conference on Reanalyses Discussion Page

Created by gilbert.p.comp… on - Updated on 08/09/2016 11:45
Michael G. Bosilovich NASA/GSFC/GMAO
Michel Rixen, WCRP
Peter van Oevelen, IGPO
Ghassem Asrar, WCRP
Gilbert Compo, NOAA/ESRL
Kazutoshi Onogi, JMA
Adrian Simmons, ECMWF
Kevin Trenberth, NCAR
Dave Behringer, NOAA/NCEP/EMC
Tanvir Hossain Bhuiyan, University of Louisville
Shannon Capps, Georgia Institute of Technology
Ayan Chaudhuri, Atmospheric and Environmental Research, Inc.
Junye Chen, ESSIC NASA/GMAO U. Maryland
Linling Chen, Nansen Environmental and Remote Sensing Center, Norway
Nicole Colasacco-Thumm, University of Wisconsin-Madison
Ma.Gabriela Escobar, Escuela Superior Politécnica del Litoral
Craig R. Ferguson, University of Tokyo
Toshiyuki Ishibashi, JMA IRI
Margarida L. R. Liberato, University of Lisbon
Jesse Meng, NOAA/NCEP/EMC
Andrea Molod, NASA/GMAO/USRA
Paul Poli, ECMWF
Joshua Roundy, Princeton University
Kate Willett, Met Office Hadley Centre
Jack Woollen, IMSG/NOAA/NCEP
Rongqian Yang, NOAA/NCEP/EMC

1. Executive Summary

Reanalyses have become an integral part of Earth system science research across many disciplines. While originating in the atmospheric sciences and Numerical Weather Prediction (NWP), the essential methodology has been adopted in the fields of oceanography and terrestrial ecosystems and hydrology, with emerging research in atmospheric composition, cryosphere and carbon cycle disciplines. Major challenges lie ahead as the disparate nature of each discipline become joined in Earth system analyses. Clearly, substantial progress has been made since the last reanalysis conference (Jan 2008, Tokyo Japan). Newer atmospheric reanalyses (MERRA, CFSR and ERA-Interim) have been evaluated in depth, and many strengths and weaknesses identified. Early results from JRA-55 are becoming available. There is tremendous potential in the NOAA/ESRL 20CR surface data only reanalysis, and in the uncertainty provided from the ensemble. Ensembles of multiple reanalysis systems can provide valuable information. Although there are several reanalyses efforts worldwide at present, the community consensus is that the diversity among them will enable deeper understanding of the reanalyses systems, their strengths and weaknesses and their representation of the underlying earth system processes/phenomena. This is then reflected in the producers’ plans (notably those of JMA and ECMWF) leaning toward “families” of reanalyses (each system producing various configurations of reanalysis). There is much to be learned about the observations, data assimilation, modelling, and coupling the Earth system but new data systems, efficient computing and processing of the multitude of reanalyses products are urgently needed. The integrating nature of reanalyses across components of the Earth system (land, ocean atmosphere) is a key benefit, but to date very few reanalyses systems include all relevant data and assimilate all Earth system components. Observations are the fundamental resource for reanalysis. The need for long-term records of continuous measurements cannot be overstated. Data recovery efforts for in situ and remotely sensed observations are essential to extend the records as far back in time as possible to support long historical reanalyses, while concerted efforts to maintain and develop the observing system forward in time to ensure continuity for the future. Documenting the observations and their uses in past reanalyses can be beneficial both to use in future reanalyses and to understanding of the observations. Expertise for all the observations exists around the world, and so, international coordination of observations for reanalysis should be an imperative for international observations and research coordination programs such as GCOS, GEOSS, CEOS and WCRP. Confronting models with observations continues to be important but also confronting models (e.g. ocean and atmospheric models) and observations (e.g. discrepancies between micro-wave satellite records and radiosonde measurements) among themselves are equally important research tasks for the future. Data assimilation methods continue to improve, but have more challenges ahead, such as the amelioration of shocks associated with changes to the observing system (also better characterizing and reducing model bias) and developing uncertainty estimates for reanalyses. Reanalyses have recently been getting attention from the climate monitoring community, and so, their strengths, weaknesses and uncertainty are increasingly exposed.

Reanalysis users often ask which reanalysis is best for a given topic. As newer reanalyses come along, the answer may not be widely known, if at all. In this regard, the community of users and developers must collaborate, given the diversity of applications. The web site, reanalysis.org, has been promoted as an open media for conveying the latest understanding of reanalyses data. Additionally, NCAR’s Climate Data Guide (https://climatedataguide.ucar.edu/) is a very useful go-to source for scientifically sound information and advice on the strengths, limitations and applications of climate data, including reanalyses. While fundamental information is available primarily on atmosphere and ocean reanalyses, discussions on the latest research and understanding are progressing more slowly. Ultimately, it is incumbent on the researchers to assess the multitude of reanalyses objectively. New data systems are required that allow for more efficient cross comparisons among the various reanalyses (such as those used for AMIP and CMIP studies and the Earth System Grid, ESG). The 4th WCRP International Conference on Reanalyses produced excellent discussions across all the important issues in reanalyses, but continuing the progress and improvements will require sustained efforts over the long term. While progress has been made across the major aspects of reanalyses, significant limitations persist. The conference has identified broad directions to continue the advancement of reanalysis:

1) Quantitative Uncertainty – Reanalyses are based on observations, and can include the errors of observations and the assimilating system. It is recommended to have reanalysis data available in a common framework so as to facilitate the analysis of their strengths and weaknesses. The notion of Families of reanalyses will likewise expose the impact of assimilating observations on the analyses. Ensemble methods can also provide quantitative uncertainty estimates. Lastly, passing observations and innovations into an easily accessible data format can promote deeper investigation of the use of observations in the reanalyses.

2) Qualitative Uncertainty – Often researchers inquire to the applicability of a reanalysis for a given phenomena, or even, which reanalysis is best. Often, this is not satisfactorily known, varies with application and requires significant time and research. Therefore, sharing reanalysis knowledge and research in a timely manner, among researchers and developers is a critical need to allow subsequent exploitation by the climate community. The reanalysis.org effort has provided an initial effort along these lines, but more participation is encouraged. In addition, http://climatedataguide.ucar.edu provides informed commentary on analysis and other datasets. Likely, even more lines of communications are required. 

3) Earth System Coupling – The natural course of reanalysis development is toward, longer data sets with coupled Earth system components that will ultimately contribute to improved coupled predictions. The use of more varied observations (e.g. aerosols) will reinforce the physical representation of the Earth system processes in the reanalysis systems. There is a need to develop independent and innovative modeling, coupling and data assimilation methods to represent the Earth System throughout the time span of the observational record. More interdisciplinary collaborations in the system development and observational research will begin to address this need. 

4) Reanalyses, Observations and Stewardship – While the observational records have been greatly improved since the first reanalyses through research, reprocessing and homogenizations, research and improvements continue their development. Reprocessing and intercalibrations of observed records are critical to improve the quality and consistency of reanalyses. In situ and satellite data need to be found, rescued and archived into suitable formats to extend the reanalysis record back in time. Reanalysis systems for the atmosphere, ocean, cryosphere, land, and coupled earth system are needed that maximize use of the observations as far back as each instrumental record will allow. It is important for the observational data and reanalysis developers to maintain communication, so the latest data are used in reanalyses, and also that output of reanalyses may contribute to the understanding of observations. Such an endeavor should be coordinated at an international level.

 Link to Full Report

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Evaluation of Southern African precipitation in reanalyses

Created by qiong on - Updated on 08/09/2016 11:45

Zhang, Q., H. Körnich and K. Holmgren, 2012: How well do reanalyses represent the southern African precipitation? Clim. Dyn., DOI: 10.1007/s00382-012-1423-z.

http://dx.doi.org/10.1007/s00382-012-1423-z

Monthly-mean precipitation observations over southern Africa are used to evaluate the performance of eight global reanalyses: ERA-40, ERA-interim, JRA-25, MERRA, CFSR, NCEP-R1, NCEP-R2 and 20CRv2. All eight reanalyses reproduce the regionally averaged seasonal cycle fairly well; a few spatial mismatches with the observations are found in the climate mean for the rainy season. Principal component analyses show a dipole in the leading modes of all reanalyses, however with crucial differences in its spatial position.

Possible reasons for the differences between the reanalyses are discussed on the basis of the ERA-interim and 20CRv2 results. A comparison between the moisture transports shows that ERA-interim manifests a very strong moisture convergence over the eastern equatorial Atlantic, resulting in the strong precipitation here. This excessive convergence may be due to the water–vapor assimilation and convection parameterization. Over the Indian Ocean, the ITCZ is shifted northward in ERA-interim compared to its position in 20CRv2. This discrepancy is most likely attributable to the meridional SST gradients in the Indian Ocean which are significantly larger in the ERA-interim than those in the 20CRv2, and the resulting atmospheric response prevents a southward shift of the ITCZ.

Overall, the consistent description of the dynamical circulation of the atmosphere and the hydrological cycle appears as a crucial benchmark for reanalysis data. Based on our evaluation, the preferential reanalysis for investigating the climate variability over southern Africa is 20CRv2 that furthermore spans the longest time period, hence permitting the most precise investigations of interannual to decadal variability.

 

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Decadal-to-Interdecadal Variability and Trend in Reanalyses

Created by hpaek on - Updated on 08/09/2016 11:45

An intercomparison of the global relative angular momentum MR in five reanalysis datasets, including the Twentieth Century Reanalysis (20CR), is performed for the second half of the twentieth century. The intercomparison forms a stringent test for 20CR because the variability of MR is known to be strongly influenced by the variability of upper-tropospheric zonal wind whereas 20CR assimilated only surface observations. The analysis reveals good agreement for decadal-to-multidecadal variability among all of the datasets, including 20CR, for the second half of the twentieth century. The discrepancies among different datasets are mainly in the slowest component, the long-term trend, of MR. Once the data are detrended, the resulting decadal-to-multidecadal variability shows even better agreement among all of the datasets. This result indicates that 20CR can be reliably used for the analysis of decadal-to-interdecadal variability in the pre-1950 era, provided that the data are properly detrended. As a quick application, it is found that the increase in MRduring the 1976/77 climate-shift event remains the sharpest over the entire period from 1871 to 2008 covered by 20CR. The nontrivial difference in the long-term trend between 20CR and the other reanalysis datasets found in this study provides a caution against using 20CR to determine the trend on the centennial time scale that is relevant to climate change. These conclusions are restricted to the quantities that depend strongly on the upper-tropospheric zonal wind, but the approach adopted in this work will be useful for future intercomparisons of the low-frequency behavior of other climate indices in the reanalysis datasets. Paek and Huang 2012.

   (a) The 5-year running averaged monthly anomalies of global relative angular momentum, ΔMR, for the 5 reanalysis datasets. (b) Same as (a) but for ΔM200, the angular momentum (per unit pressure thickness) calculated at only 200 hPa level.

   (a) The least-square quadratic fit (dashed curve) to ΔMR for NCEP Reanalysis I, ERA-40, and 20CR for 1949-1978. (b) the “detrended” time series for the same period, with the quadratic curve removed from the time series. (c) Same as (a) but for 1979-2008 and with the addition of NCEP Reanalysis II and ERA-Interim.  (d) Same as (b) but for 1979-2008 and with the addition of NCEP Reanalysis II and ERA-Interim.

  (a) The global relative angular momentum, MR, with the long-term mean retained, for the five reanalysis datasets. (b) Same as (a) but for M200.  (c) Same as (a) but with the integration carried out only from 150-10hPa and 10°S-10°N to show the contribution from tropical upper atmosphere.

  (a) The summer (JJA)  climatology of zonal mean zonal wind from 1979-2008 for 20CR. (b) Same as (a) but for ERA-Interim. (c) The difference between 20CR and ERA-Interim, i.e., (b) minus (a). (d) is similar to (c) but for the difference between NCEP Reanalysis II and ERA-Interim.  (e)-(h) are similar to (a)-(d) but for winter (DJF). (i)-(l) are similar to (a)-(d) but for the annual mean.  (m) and (n) are the 1979-2008 linear trends for 20CR and ERA-Interim.  Contour intervals are 4 m s-1 for (a), (b), (e), (f), (i), and (j);  1 m s-1 for (c), (d), (g), (h), (k), (l), (m) and (n).

The extended intercomparison to CFSR and MERRA can be found at http://icr4.org/posters/Paek_AT-43.pdf.

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

An Intercomparison of Temperature Trends in the U.S. Historical Climatology Network and Recent Atmospheric Reanalyses

Created by Russell.Vose on - Updated on 07/18/2016 10:13

From: Vose, R. S., S. Applequist, M. J. Menne, C. N. Williams Jr., and P. Thorne. 2012: An intercomparison of temperature trends in the U.S. Historical Climatology Network and recent atmospheric reanalyses. Geophys. Res. Lett., 39, L10703, doi:10.1029/2012GL051387.

Temperature trends over 1979-2008 in the U.S. Historical Climatology Network (HCN) are compared with those in six recent atmospheric reanalyses.  For the conterminous United States, the trend in the adjusted HCN (0.327 °C dec-1) is generally comparable to the ensemble mean of the reanalyses (0.342 °C dec-1).  It is also well within the range of the reanalysis trend estimates (0.280 to 0.437 °C dec-1). The bias adjustments play a critical role, as the raw HCN dataset displays substantially less warming than all of the reanalyses.  HCN has slightly lower maximum and minimum temperature trends than those reanalyses with hourly temporal resolution, suggesting the HCN adjustments may not fully compensate for recent non-climatic artifacts at some stations.  Spatially, both the adjusted HCN and all of the reanalyses indicate widespread warming across the nation during the study period.  Overall, the adjusted HCN is in broad agreement with the suite of reanalyses.

Least-squares trends (°C dec-1) in mean annual temperature over the conterminous United States during the period 1979-2008.

 

Categorical depiction of grid-box trends in mean annual temperature during the period1979-2008.

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Atmospheric Reanalyses – Recent Progress and Prospects for the Future

Created by gilbert.p.comp… on - Updated on 08/09/2016 11:46

Atmospheric Reanalyses – Recent Progress and Prospects for the Future.

A Report from a Technical Workshop, April 2010

 

Michele M. Rienecker, Dick Dee, Jack Woollen, Gilbert P. Compo, Kazutoshi Onogi, Ron Gelaro, Michael G. Bosilovich, Arlindo da Silva, Steven Pawson, Siegfried Schubert, Max Suarez, Dale Barker, Hirotaka Kamahori, Robert Kistler, and Suranjana Saha

Abstract

In April 2010, developers representing each of the major reanalysis centers met at Goddard Space Flight Center to discuss technical issues – system advances and lessons learned – associated with recent and ongoing atmospheric reanalyses and plans for the future. The meeting included overviews of each center’s development efforts, a discussion of the issues in observations, models and data assimilation, and, finally, identification of priorities for future directions and potential areas of collaboration. This report summarizes the deliberations and recommendations from the meeting as well as some advances since the workshop.

 

Summary of Recommendations

From Rienecker et al. (2012)

Target areas for improvements for the next generation of atmospheric reanalyses include:

• The hydrological cycle

• The quality of the reanalyses in the stratosphere

• The quality of the reanalyses over the polar regions

• Representation of surface fluxes

• Observational bias corrections and/or cross-calibration across platforms

• Estimates of uncertainty in the analyses, and

• Reductions of spurious trends and jumps associated with the changing observing system.

 

Several recommendations were made regarding areas for coordination between reanalysis centers in order to prepare for the next reanalyses:

• Preparation and sharing of lists of anomalous behavior or features to help identify how common anomalies are across the various reanalyses.

• Examination of data utilization, including QC decisions, innovation statistics, bias corrections, outcomes of data selection algorithms, cloud detection outcomes, etc.

• Identification of joint experiments to be conducted to elucidate issues found to be in common in different reanalyses.

• Sharing of results from jointly designed sensitivity experiments.

• Coordination of input observations and ancillary data and centralization of the serving of these observations where possible.

• Expansion of ACRE’s efforts for contributing surface observations to 20CR to contributing to all future reanalysis efforts, possibly acting as a data coordinator and provider of surface data for all future reanalyses in collaboration with working groups of GCOS and WCRP.

• Development of innovative diagnostics and metrics to help quantify observational issues, the quality and also agreement of the reanalyses.

The workshop recommended that a mechanism be established for the timely exchange of information about the quality of the reanalyses, results of experiments, and plans for future developments. This idea was quickly embraced with the establishment of Reanalysis.org. However, further progress is needed in the utilization of such a capability to enhance communications between reanalysis groups.

Finally, consistent with the Arkin et al. (2003) workshop report, the workshop participants recommended extending the reanalysis record for as long as possible, to include the 1970s for reanalyses focused on the satellite era, and to go back at least to 1850 with those reanalyses using sparse observations.

 
References

Arkin, P., E. Kalnay, J. Laver, S. Schubert, and K. Trenberth, 2003: Ongoing analysis of the climate system: A workshop report. NASA, NOAA, and NSF, 48 pp.  Link to Full Report.

Rienecker, M.M., D. Dee, J. Woollen, G.P. Compo, K. Onogi, R. Gelaro, M.G. Bosilovich, A. da Silva, S. Pawson, S. Schubert, M. Suarez, D. Barker, H. Kamahori, R. Kistler, and S. Saha, 2012: Atmospheric Reanalyses—Recent Progress and Prospects for the Future. A Report from a Technical Workshop, April 2010. NASA Technical Report Series on Global Modeling and Data Assimilation, NASA TM–2012-104606, Vol. 29, 56 pp. Link to Full Report
 
 

Dick Dee (not verified)

Tue, 07/30/2013 - 03:50

Hello again.. The 6-hourly temperature and wind analyses from ERA-Interim are 'snapshots' i.e. instantaneous values. You are probably aware however that they are consistent with the relatively coarse time-space resolution of the global model. Winds in particular represent model grid-cell averages and thus do not account for local small-scale variability. Near the surface the winds are consistent with the model's representation of topography which of course is much smoother than the real topography.

Please excuse me if this is posted to the incorrect area and please point me to a different location, if necessary.

I have a question about the ERA-Interim temporal resolution of the temperature and wind reanalyses. What do the 6-hourly values represent? For example, is the 00Z temperature a reanalysis of the instantaneous temperature at 00Z, or is it a 6-hour average? If it is a 6-hour average, is the average from 21Z to 03Z or 06Z-12Z or 00Z-06Z? I think it represents an instantaneous temperature, but I cannot find literature to support this assumption. Also, please comment on the wind parameters. Does the reanalysis represent instantaneous wind components or averages over 6 hours?

I'm sure this is published somewhere, but I have read many documents on the ECMWF website and a few papers, but I have been unable to ascertain the answer. Thanks kindly.

Dear icystorm, From the data FAQ: http://www.ecmwf.int/products/data/archive/data_faq.html 8. What is the difference between analyses, forecasts and accumulated forecasts? ECMWF data can be split into 3 main categories: analyses, instantaneous forecasts and accumulated forecasts. Analyses are produced by combining short-range forecast data with observations to produce the best fit to both. The data are available a few times per day. Instantaneous forecast data are produced by the forecast model, starting from an analysis, and are available at various forecast steps (hours) from the analysis date/time. (Note, forecasts are not initiated from all analyses.) These data are relevant to a particular verifying date/time (analysis date/time plus step). Accumulated forecast parameters are accumulated from the beginning of the forecast. You can divide values by the length of the forecast step to calculate averages over the accumulation period. Some parameters are only analysed (eg. model bathymetry), some are only forecast (e.g. radiative fluxes) and some are both analysed and forecast (e.g. temperature, winds and pressure). If you look at the GRIB records, the internal metadata should also answer your question directly. best wishes, gil compo (University of Colorado/CIRES and NOAA/Earth System Research Laboratory/Physical Sciences Division)

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Reports

Created by Chris.Kreutzer on - Updated on 07/13/2017 10:13

Many white papers, published papers, and other reports have been issued relating to reanalyses, their current status, and recommendations for improvements.  Please include such reports below in reverse chronological order, with links to a Discussion reanalyses.org page which summarizes the report and a link to the Full Report itself. 

 

Fujiwara, M., J. S. Wright, G. L. Manney, L. J. Gray, J. Anstey, T. Birner, S. Davis, E. P. Gerber, V. L. Harvey, M. I. Hegglin, C. R. Homeyer, J. A. Knox, K. Krüger, A. Lambert, C. S. Long, P. Martineau, A. Molod, B. M. Monge-Sanz, M. L. Santee, S. Tegtmeier, S. Chabrillat, D. G. H. Tan, D. R. Jackson, S. Polavarapu, G. P. Compo, R. Dragani, W. Ebisuzaki, Y. Harada, C. Kobayashi, W. McCarty, K. Onogi, S. Pawson, A. Simmons, K. Wargan, J. S. Whitaker, and C.-Z. Zou: Introduction to the SPARC Reanalysis Intercomparison Project (S-RIP) and overview of the reanalysis systemsAtmos. Chem. Phys., 17, 1417-1452, doi:10.5194/acp-17-1417-2017, 2017. Link to Paper. 

Compo, G., J. Carton, X. Dong, A. Kumar, S. Saha, J. S. Woollen, L. Yu, and H. M. Archambault, 2016: Report from the NOAA Climate Reanalysis Task Force Technical Workshop. NOAA Technical Report OAR CPO-4, Silver Spring, MD. doi: 10.7289/V53J39ZZ. Full Report.

Bosilovich, M.G, J.-N.Thépaut, O. Kazutoshi, A. Kumar, D. Dee and Otis Brown, 2015: WCRP Task Team for Intercomparison of ReAnalyses (TIRA). White Paper. Full Report.

CORE CLIMAX, 2014: Procedure for comparing reanalyses, and comparing reanalyses to assimilated observations and CDRs. COordinating Earth observation data validation for RE-analysis for CLIMAte ServiceS, Grant agreement No: 313085, Deliverable D5.53, pp 45. Full report

Bosilovich, M. G., J. Kennedy, D. Dee, R. Allan and A. O’Neill, 2013: On the Reprocessing and Reanalysis of Observations for Climate, Climate Science for Serving Society: Research, Modelling and Prediction Priorities. G. R. Asrar and J. W. Hurrell, Eds. Springer, in press. Full Report. Discussion Page

Bosilovich, M.G., M. Rixen, P. van Oevelen, G. Asrar, G. Compo, K. Onogi, A. Simmons, K. Trenberth, D. Behringer, T. H. Bhuiyan, S. Capps, A. Chaudhuri, J. Chen, L. Chen, N. Colasacco-Thumm, M. G. Escobar, C.R. Ferguson, T. Ishibashi, M.L.R. Liberato, J. Meng, A. Molod, P. Poli, J. Roundy, K. Willett, J. Woollen,R. Yang, 2012: Report of the 4th World Climate Research Programme International Conference on Reanalyses, Silver Spring, Maryland, USA, 7-11 May 2012. WCRP Report 12/2012. Full Report. Discussion Page.

Rienecker, M.M., D. Dee, J. Woollen, G.P. Compo, K. Onogi, R. Gelaro, M.G. Bosilovich, A. da Silva, S. Pawson, S. Schubert, M. Suarez, D. Barker, H. Kamahori, R. Kistler, and S. Saha, 2012: Atmospheric Reanalyses—Recent Progress and Prospects for the Future. A Report from a Technical Workshop, April 2010. NASA Technical Report Series on Global Modeling and Data Assimilation, NASA TM–2012-104606, Vol. 29, 56 pp. Full Report. Discussion Page.

Climate Change Science Program, 2008: Weather and Climate Extremes in a Changing Climate. Regions of Focus: North America, Hawaii, Caribbean, and U.S. Pacific Islands. A Report by the U.S. Climate Change Science Program and the Subcommittee on Global Change Research. [Thomas R. Karl, Gerald A. Meehl, Christopher D. Miller, Susan J. Hassol, Anne M. Waple, and William L. Murray (eds.)]. Department of Commerce, NOAA's National Climatic Data Center, Washington, D.C., USA, 164 pp. Full Report.

Climate Change Science Program, 2008: Reanalysis of Historical Climate Data for Key Atmospheric Features: Implications for Attribution of Causes of Observed Change. A Report by the U.S. Climate Change Science Program and the Subcommittee on Global Change Research [Randall Dole, Martin Hoerling, and Siegfried Schubert (eds.)]. National Oceanic and Atmospheric Administration, National Climatic Data Center, Asheville, NC, 156 pp. Full Report.

Lermusiaux, P.F.J.,  P. Malanotte-Rizzoli, D. Stammer, J. Carton, J. Cummings, and A.M. Moore, 2006: Progress and Prospects in U.S. Data Assimilation in Ocean Research. Oceanography, 19, 172-183. Full Report.

Arkin, P., E. Kalnay, J. Laver, S. Schubert, and K. Trenberth, 2003: Ongoing analysis of the climate system: A workshop report. NASA, NOAA, and NSF, 48 pp.  Full Report.

 

Zeng-Zhen.HU

Thu, 08/02/2012 - 12:54

Two recent publications:

Kumar, A. and Z.-Z. Hu, 2012: Uncertainty in the ocean-atmosphere feedbacks associated with ENSO in the reanalysis products. Clim. Dyn., 39 (3-4), 575-588. DOI: 10.1007/s00382-011-1104-3.

Xue, Y., B. Huang, Z.-Z. Hu, A. Kumar, C. Wen, D. Behringer, and S. Nadiga, 2011: An assessment of oceanic variability in the NCEP Climate Forecast System Reanalysis. Clim. Dyn., 37 (11-12), 2511-2539, DOI: 10.1007/s00382-010-0954-4.

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

RAOBCORE/RICH Visualization

Created by lorenzo.ramell… on - Updated on 03/29/2021 09:27

RAOBCORE and RICH

online Viewers now available!

 

RAOBCORE => RAdiosone OBservation COrrection using REanalyses

RICH              => Radiosonde Innovation Composite Homogenization

 

New visualization utility for RAOBCORE and RICH adjusted global radiosonde dataset now available:

RAOBCORE/RICH

Version 1.5.1

RAOBCORE corrections 

http://srvx7.img.univie.ac.at/~leo/richvis/newindex.html 

New visualization utility for RAOBCORE 2.0 global radiosonde dataset now available.

Adjustments are not yet provided.

RAOBCORE v2.0 Viewer 

http://srvx7.img.univie.ac.at/~lorenzo/DEVL_rrvis_2.0/html/

Notes: Viewer RAOBCORE 2.0

  • Station : WMO radiosonde station number (not all the stations ara available for all the archives)
  • Varibale;
  • Pressure level [hPa];
  • Type: observation, biascorrection (if available), FirstGuess departures (if available) and Analysis departures ( if available); 
  • Smooth: running mean over the time serie;
  • Experiment: only Control is available;
  • Data from: in this menu are shown all the possible soure of data we are using:
    • Stations_ERA_INTERIM: data from ERA_INTERIM (observations and departures);
    • Stations_ERA_40: data from ERA_40 (obseravtiona and departures);
    • Stations_CHUAN_montly: monthly data from the CHUAN archive (observations from CHUAN);
    • Stations_CHUAN_daily: daily data from the CHUAN archive (observation from CHUAN, Analysis departures from 20CR);
    • 20CR: recoverd (only in presence of observation) time series from the 20CR interpolated at the station latitude and longitude;
    • ERA_40: recoverd (only in presence of observation) time series from ERA_40 interpolated at the station latitude and longitude;
    • long_20CR: recoverd time series (covers all the 20CR length) from the 20CR interpolated at the station latitude and longitude;
    • MERGED_archive: it contains merged obseravtions data from ERA_INTERIM, ERA_40 and CHUAN; the analysis departures are from 20CR.
  • Adjustment_Method: only Unadjusted is now available;
  • Version: only v2.0 is available;
  • Long_Time: 
    • 00h: data at Midnight;
    • 12h: data at Noon;
    • 00h - 12h: difference between Midnight  and Noon;
  • PlotSetting:
    • Jump_Missing: if there is a missind value, nothing is plotted;
    • Linear_Connection: if there is a missing value, a linear connection between the last available and the new available will be plotted;
  • Metadata: shows (if available) the metadata for the selected station; 
  • Overplot: allows plotting many time series on the same frame;
  • Tooltip: gives hints about the different menus;
  • Autorefresh: at each selection it tries to plot the current setting;
  • Range: scaled for the time axis;
  • Delete Last: deletes the last plot form the frame;
  • Delete All : deletes all the plots from the frame;

In order to zoom in: select with a mouse and drag the area that you would like to inspect. It will be magnified in the main frame. 

 

Suggested stations for a easy start :

  • Temperature:

Station: 010393, Merged archive, pressure 1000 or 850 hPa -> long time series back to 1905

Station: 004018, Merged archive, pressure 850 hPa -> continue time serie back to 1946;

 

  • U and V Wind component:

Station: 016716, Merged archive, pressure 200 hPa, Type: Observations and Analysis depertures -> big shift (better visible with smooth bigger than 100);

  •  Wind Speed:

Station: 016716, Merged archive, pressure 200 hPa, Type: Observations and Analysis depertures -> big shift (better visible with smooth bigger than 100)  

 

 

 

 

 

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

An intercomparison of different cloud climatologies in the Arctic

Created by chernav on - Updated on 08/09/2016 11:45

A recent publication on different Arctic cloud climatologies intercomparison shows a wide spread among observations and reanalyses. Reanalyses generally are not in a close agreement with satellite and surface observations of cloudiness in the Arctic. Several reanalyses show the highest values of total cloud fraction over the central part of the Arctic Ocean but not over the Norwegian Sea and the Barents Sea as observations do. The maximum and minimum of total cloud fraction in the annual cycle are shifted by 1-2 months compared to observations.



December-January-February and June-July-August mean of TCF over the Arctic (north of 60◦N) from different data.



The annual cycle of TCF.



Normalized pattern statistics showing differences among different observational and reanalyses TCF spatial distribution (Taylor diagrams).


Alexander Chernokulsky and Igor I. Mokhov, “Climatology of Total Cloudiness in the Arctic: An Intercomparison of Observations and Reanalyses,” Advances in Meteorology, vol. 2012, Article ID 542093, 15 pages, 2012. doi:10.1155/2012/542093

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Web-based Reanalysis Intercomparison Tools (WRIT)

Created by Cathy.Smith@noaa.gov on - Updated on 10/28/2021 12:14

Web-based Reanalysis Intercomparison Tools  (WRIT) BAMS article: 

  http://journals.ametsoc.org/doi/abs/10.1175/BAMS-D-13-00192.1

A set of web-based reanalysis intercomparison tools (WRIT) is available from the NOAA Physical Sciences Laboratory and University of Colorado CIRES.

 

WRIT Maps WRIT Time-series WRIT Correlations WRIT Trajectories WRIT Distributions

The "WRIT" Maps tool allows users to examine 20CR, ERA-Interim, ERA-20C, JRA-55, MERRA, MERRA-2, NCEP R1, NCEP R2, and NCEP CFSR reanalyses datasets. Pressure level data are available for most reanalyses, as well as 5 single level variables including sea level pressure, 2 m air temperature, 10 m winds, precipitation. Maps and pressure-level by longitude and pressure-level by latitude can be generated for monthly means, anomalies, and climatologies. Observational datasets have been made available that can be compared to 2m air temperature and precipitation. These quantities can be differenced between datasets.

Future enhancements include different time scales.

is also available from WRIT. It allows users to examine 20CR, ERA-Interim, ERA-20C, JRA-55, MERRAMERRA-2, NCEP R1,  NCEP R2, and NCEP-CFSR as well as some observational dataset. Users can compare timeseries from different datasets, regions, variables and levels. Distributions, scatter plots, and auto-correlation are also available. Statistics for each timeseries including means, standaed deviations, slope and correlations are provided.

The "WRIT" Trajectory Tool is a new tool available from WRIT. It allows users to plot forward and backward trajectories from different reanalyses (currently NCEP R1, NCEP R2, and 20CR with more planned). Users can plot  the trajectories of one or more levels on a single plot. The output is plotted and is available as netCDF and as KMZ files suitable for Google Earth.

Other analysis products are planned.

Feedback and suggestions are welcome. Please give comments/issues/suggestions in the Post a comment or question below.

 


Acknowledgments

The Twentieth Century Reanalysis Project (20CR) used resources of the National Energy Research Scientific Computing Center managed by Lawrence Berkeley National Laboratory and of the Oak Ridge Leadership Computing Facility at Oak Ridge National Laboratory, which are supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231 and Contract No. DE-AC05-00OR22725, respectively. Support is provided by the U.S. Department of Energy, Office of Science Innovative and Novel Computational Impact on Theory and Experiment (DOE INCITE) program, and Office of Biological and Environmental Research (BER), and by the National Oceanic and Atmospheric Administration Climate Program Office. Data are freely available from NOAA, NCAR, the IRI, KNMI, and DOE NERSC.

NASA's Modern Era Retrospective analysis for Research and Applications (MERRA) was developed by the Global Modeling and Assimilation Office (GMAO) and produced through NASA's Modeling, Analysis and Prediction (MAP) program, and is freely available from the Goddard Earth Sciences (GES) Data Information Services center (DISC).

NCEP's Climate Forecast System Reanalysis (CFSR) was developed by the Environmental Modeling Center (EMC) and was partially funded through the NOAA Climate Program Office. It is available free to the public from both NCDC and NCAR.

The ERA-Interim reanalysis is being produced by the European Centre for Medium-Range Weather Forecasts (ECMWF) in Reading, UK. ERA-Interim data with near-real time updates are freely available from the ECMWF data server and from the CISL Data Archive at NCAR. 

WRIT contributes to the Atmospheric Circulation Reconstructions over the Earth (ACRE) Initiative.

WRIT is supported in part by NOAA and by the US Department of Energy Office of Science (BER).

Annonimous (not verified)

Sun, 07/14/2024 - 02:40

Hi,

Would you mind referring me where I can find daily temperature data from the period 2012-2022 for the the entire world?

Best wishes,

Kris

Yaren Duygu Atalay (not verified)

Wed, 01/24/2024 - 12:40

Hello, For my master's thesis, I need the wind speed, solar radiation and sunshine hours of the city of Stuttgart in 10-minute periods for the last 5 years. Coould you direct me to access this data please?

 

Hi

Is there any source for multiyear WRIT reanalysis for water equivalence of snow depth for the Mediterranean region. I have tried your interface for ERA5, JRA55, MERRA databses and the option appears to be frozen and not allowed. I am testing a statistical ANN and Cluster analysis model that I utilized to identify possible approximate seasons for snowfall and severe weather events, it worked well for flood risk and severe weather , however i wish to trry it for snowfall/depth using multiyear analogous months or seasons . Any suggestions/solutions for analogous re-analysis for snowfall risk and depth?

 

Thank you B y all results and outcomes. 

Warmest Regards

Mohammed Alkhateeb

Anonymous (not verified)

Thu, 03/20/2014 - 16:24

Why only 2 time series maximum? Do you plan to increase that number? Since this tool is for INTER-comparison (not just comparison), I would expect this function to be useful. It would be particularly good to allow users to choose a group of the reanalyses to plot.Whereas this is more difficult to do for 2d plots, time series should allow such intercomparison to be performed easily.

While comparing more than one timeseries would be ideal, in the current implementation of the tool, it would not be possible as the entire timeseries at all gridpoints is read in and that is very large. We would need to process the data one timestep at a time instead to have it work on the server. It is still possible this is too resource intensive for a web tool but but if we are able to get more programming resources, it would be a very nice feature and a higher priority than other new features for time series plots.--Cathy

Cathy.Smith@noaa.gov

Mon, 05/06/2013 - 14:06

When a user selects MERRA pressure level data for time series as one or both of the variables, we now print "Note: MERRA does not interpolate pressure level variables below the surface. Your MERRA timeseries may average "missing" grids. Please check the MERRA maps of the variable to see where this may occur." MERRA maps points to the mapping WRIT page. Is this sufficient? How should we handle pressure level data below the surface? A user could pick a box that has some values below the surface and some not. We could alternatively not allow any comparisons below the surface. We may be able to report average percent of grids in each month available or something like that. Any other ideas?

MERRA 3D atmospheric data were produced without extrapolation to pressure surfaces where the pressure level would be greater than the surface pressure (in other words, under ground). The impact that this has on averaging is discussed here:

http://gmao.gsfc.nasa.gov/research/merra/pressure_surface.php

A third party routine is available to extrapolate continuous pressure levels.

https://reanalyses.org/atmosphere/extrapolation-merra-reanalyses-obtain…

This would be best applied to 3 or 6 hourly fields.

Gintautas (not verified)

Fri, 11/30/2012 - 12:50

It is a "cool" tool for my students analysing anomalies and compositions, drawing timeseries and trajectories. And all is available without any knowledge in programming, data format or additional data visualisation software. Thanks. Gintas

Anonymous (not verified)

Thu, 08/16/2012 - 15:12

What we could add or change to page: Ability to composite on a set of dates. Allow users to use own dates More variables (what?) Standardized anomalies. We can consider these though they may require too much time to compute. What we hope to improve. Speed! We know where some of the slowness is and hope to find ways around it. Labeling... Please list other suggestions.

Hi,

I am just starting to work with WRIT. It's proving excellent for all sorts of analyses we're doing but one aspect that I'm struggling to undertake is to extract data for specific seasons or a selected run of months. The option to chose a range of months is there on the page but I'm not having any luck getting it to work. Profuse apologies if I'm missing something obvious.

 

Thanks for providing such great software!

 

Best wishes, Chris 

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

How to obtain/plot/analyze data

Created by Cathy.Smith@noaa.gov on - Updated on 08/26/2024 13:09

Data Extraction

  1. NCEI NOMADS and NCMP:  reanalysis (CFSR,NARR,R1,R2); NWP (NAM, GFS, RUC); GENS ensembles, SST
  2. NOAA PSL Search and Plot. (R1,R2,20CR, NARR)
  3. NOAA IRI (CFSR,20CR,R1,R2)
  4. ECMWF
    1. ERA5: access via the Climate Data Store https://cds.climate.copernicus.eu/#!/home and https://cds-beta.climate.copernicus.eu/ 
    2. Alternative: https://www.ecmwf.int/en/forecasts/datasets/search 
  5. NASA 
    1. MERRA: GES DISC Data Collections: MERRA
    2. MERRA-2: GES DISC Data Collections: MERRA-2
    3. MERRA and MERRA2 Data Subsetter  (variable list for MERRA-2)
  6. NCAR, Highest-resolution files for all reanalyses, except MERRA. GRIB parameter field extraction using cURL, and some conversion to netCDF as noted. 
    1. JRA-25: Data Access > Web File Listing > Create Your Own File List (e.g. anl_p), use cURL or wget (for files).
    2. JRA-55
    3. ERA5, ERA-Interim
    4. CFSR - (also subset with net CDF format conversion)
    5. 20CR
    6. 20CRv2c
    7. 20CRv3
  7. OpenDAP servers
    1. NOAA PSL (20CR,R1,R2,NARR), NCEP, MERRA2D, MERRA3D
    2. MERRA Gridded Innovations and Observations (GIO)
  8. OpenGrADS.org: GrADS software with additional user functionality, including GUI for reanalyses including NCEP and MERRA
  9. Earth System Grid Federation (CFSR, MERRA, 20CR, JRA-25, ERA-Interim) Obs4MIPS: Easy access to NetCDF reanalyses data of selected variables corresponding to the CMIP5 climate model output
  10. GOAT: Geophysical Observations Analysis Tool for MATLAB

Step-by-Step Guide to obtaining data files

Post Processing Routines and Algorithms

  1. Extrapolate MERRA pressure-level data below the surface

Webtools to plot/analyze data by Function

Basic Maps

  1. NOAA IRI (CFSR,20CR,R1,R2)
  2. NOAA PSL Search and Plot (20CR,R1,R2,NARR)
  3. NASA MERRA: Uses Giovanni to produce maps or animations of some monthly fields. Can average over successive times.
  4. NOAA NOMADS (CFSR,NARR,R1,R2)
  5. ECMWF ERA-40, ERA-Interim (Plot maps)
  6. NASA MERRA Atlas
  7. NOAA/PSL Web-based Reanalysis Intercomparison Tool for maps makes user-selected reanalysis fields for monthly data. It can also difference two reanalyses or selected observational datasets with user-selected climatologies.
  8. The Climate Reanalyzer makes user-selected reanalysis fields and differences for monthly data.
  9. MeteoCentre provides pre-generated synoptic maps of SLP, 1000-500 thickness, and 500 hPa height (20CR and R1).
  10. GOAT: Geophysical Observations Analysis Tool for MATLAB

Other Basic Geographic Plots

  1. NOAA PSL:Crossections
  2. NOAA PSL: Search and Plot
  3. MERRA: Uses Giovanni to produce hovmollers of some monthly fields.
  4. The Royal Netherlands Meteorological Institute (KNMI) Climate Explorer
  5. GOAT: Management and Analysis of Geophysical-Data Made Simple for Matlab
  6. Met Data Explorer

Hovmollers

  1. NOAA/PSL: Hovmollers (R1)
  2. IRI
  3. GOAT: Geophysical Observations Analysis Tool:Management and Analysis of Geophysical-Data Made Simple for Matlab

Advanced Plots

  1. NOAA PSL: Can plot monthly, daily and sub-daily of crossections from composite plotting pages (R1). Anomalies are available.
  2. NOAA/PSL: Hovmollers of means, anomalies of daily data. Anomalies are available (R1).
  3. GOAT: Temporal and spatial subsettting is supported via a GUI or built in function. Built-in calculation of anomalies and climatology. Superimpose or show the difference between two fields. Display land-cover or topography.

Composite Maps (Average different, possibly non-contiguous dates together)

  1. NOAA PSL: Can plot composite maps and vertical crossectons from composite plotting pages on monthly, daily and sub-daily time scales for R1. Anomalies are available.
  2. NOAA PSL: Can plot composite maps from plotting pages on monthly, daily and sub-daily timescales for 20CR. Anomalies are available. For monthly, plot composite maps of the 20CR ensemble spread (uncertainty).
  3. GCOS/WGSP: Can plot composite maps of sea level pressure from plotting pages on monthly timescales. Anomalies are available.
  4. WRIT maps: Can plot composite maps of a reanalysis or the difference of composites from two reanalyses.
  5. GOAT: Can plot composites of non-contiguous dates.

Correlation Maps

  1. NOAA PSL WRIT Correlations
  2. NOAA PSL: From monthly NCEP/NCAR R1
  3. KNMI
  4. The Climate Reanalyzer (ERA-Interim, NCEP/NCAR R1, NCEP/DOE R2, 20CR, observational datasets: PRISM precipitation, ERSSTv3b)

Timeseries Plots

  1. NOAA PSL Plot simple timeseries of NCEP/NCAR R1 and 20thC Reanalysis monthly variables
  2. IRI Data Library
  3. Met Data Explorer: Unidata
  4. Web-based Reanalysis Intercomparison Tool for timeseries (WRIT) makes user-selected reanalysis timeseries, scatter plots, cross-correlation functions, and probability density functions for monthly data. It can also difference two reanalyses or selected observational datasets.
  5. The Climate Reanalyzer makes user-selected reanalysis time series with land/ocean masking.

Timeseries Analysis

  1. KNMI: Plot, compute annual cycle, filter and other tools available for time series analysis. Provides many climate/ocean time-series.
  2. NOAA/PSL: Correlate and do some other simple analysis on pregenerated or user supplied monthly time-series
  3. NOAA/PSL: Extract daily timeseries from datasets. Can supply user criteria (e.g. top 10 temperatures in January for a point). R1,20CR
  4. NOAA/PSL: Extract monthly timeseries from datasets.  R1,20CR
  5. IRI Data Library
  6. NOAA PSL: Web-based Reanalysis Intercomparison Tool for timeseries (WRIT) makes user-selected reanalysis timeseries, scatter plots, cross-correlation functions, wavelets, and probability density functions for monthly data. It can also difference two reanalyses or selected observational datasets.

Google Earth

  1. NOAA PSL: Create in KML plots (20CR, R1)

Miscellaneous

  1. NOAA/PSL Lead/Lag for Composites
  2. NOAA\/PSL Lead/Lag for Correlations (maps)
  3. KNMI Smoothed fields, EOF, SVD and other analysis
  4. NOAA/PSL WRIT Trajectory calculator (20CR, CFSR)

 

Applications that read/plot/analyze netCDF and/or grib data (non-web)

A complete list is at Unidata

  1. NCL: NCAR Command Language (no longer updated but has full functionality)
  2. GrADS: The Grid Analysis and Display System (GrADS)
  3. IDVIntegrated Data Viewer
  4. FerretData Visualization and Analysis: From NOAA/PMEL
  5. NCO: NetCDF Operators. The NCO toolkit manipulates and analyzes data stored in netCDF-accessible formats, including DAPHDF4, andHDF5. It exploits the geophysical expressivity of many CF (Climate & Forecast) metadata conventions, the flexible description of physical dimensions translated by UDUnits, the network transparency of OPeNDAP, the storage features (e.g., compression, chunking, groups) of HDF (the Hierarchical Data Format), and many powerful mathematical and statistical algorithms of GSL (the GNU Scientific Library). NCO is fastpowerful, and free.
  6. CDO: Climate Data operators.  A collection of command-line operators to manipulate and analyze climate and numerical weather prediction data; includes support for netCDF-3, netCDF-4 and GRIB1, GRIB2, and other formats.
  7. MATLAB
  8. IDL: Interactive Data Language
  9. CDAT Community Data Analysis Tools: CDAT: Note this will be replaced soon by xCDAT
  10. xCDAT: xCDAT is an extension of xarray for climate data analysis on structured grids. It serves as a spiritual successor to the Community Data Analysis Tools (CDAT) library.
  11. GOATGeophysical Observations Analysis Tool:  A MATLAB based tool that integrates with NetCDF files and OPeNDAP sources.

 

 

 

khaled Megahed (not verified)

Sun, 03/06/2022 - 12:47

Dear Sir,

I would like to open ERA5 grid data that was downloaded from ECMWF.

Could you please send me some code to open and read with a visualize such kind of data.

I wait your reply as soon as possible.

Best wishes

Khaled

solgunta@123

Mon, 10/08/2018 - 23:15

Please can anyone help me? I failed install NCL on my window platform, i fallowed the instruction but could not start to work. 

Moses Monday (not verified)

Fri, 08/04/2017 - 19:15

I really need help. 

I want to download data for 

-Incoming shortwave and outgoing shortwave radiation 

-Incoming longwave and outgoing longwave radiation 

-Albedo and net radiation. 

Location: Lagos Nigeria 

These data must be hourly with good resolution. 

Please any help? 

Thanks 

 

Moses,

A couple of points. MERRA, MERRA-2 and CSFR have 1 hourly data, others may too, you should review the characteristics of these and others to see which best suits your needs. When you say resolution must be good, do you mean spatial resolution? And if so, what is good resolution?

Keep in mind that when using reanalysis data, the radiation parameters are strongly dependent on *modeled* cloud fields.  This can lead to significant uncertainty in the values. 

Once you figure out which you want, then you can start looking to see if they have tools that permit the download of point data (MERRA/MERRA-2 both do).  Their documentation is listed here.

For there ERA5

https://www.ecmwf.int/en/newsletter/147/news/era5-reanalysis-production

For CFSR

https://www.ncdc.noaa.gov/data-access/model-data/model-datasets/climate-forecast-system-version2-cfsv2#CFS%20Reanalysis%20(CFSR)

The 20CRV2c has 3 hourly data for surface fluxes. The MERRA and ERA have higher spatial resolution. 

As the others asked, what time period?

andy (not verified)

Thu, 05/04/2017 - 07:34

Hi, 

 

Need to plot streamlines using ECMWF winds (U and V) over Asian region ...Can I have matlab code?

Cathy.Smith@noaa.gov

Fri, 05/19/2017 - 09:53

In reply to by andy (not verified)

While I don't think matlab has an email list, they do have extensive help pages. I searched and see

https://plot.ly/matlab/streamline-plots/

https://www.mathworks.com/help/matlab/ref/streamline.html

https://www.mathworks.com/help/matlab/ref/stream2.html

They also have libraries to read netCDF files.

 

Cathy S.

 

 

For GrADS, this page has an example http://www.jamstec.go.jp/frsgc/research/iprc/nona/GrADS/plot-strem-line.html You can use this plotting page http://www.esrl.noaa.gov/psd/cgi-bin/data/testdap/plot.comp.pl to plot zonal means of meridional winds (and omega) to look at the Hadley cell. NCL will also plot streamlines http://www.ncl.ucar.edu/Applications/stream.shtml Cathy Smith

I'd like to access from 20CR (ver 2c) daily rainfall for a specific lat/lon reference point. Is there a relationship between the daily pr_wtr output variable and the monthly mean prate variable? Is it valid to compare actual daily rainfall with data derived from pr_wtr?

Sebastian Krogh (not verified)

Wed, 12/02/2015 - 11:44

Hi, I trying to extract daily incoming shortwave from ERA-I, the variable is ssrd (Surface solar radiation downwards), which I downloaded from ECMWF website (http://apps.ecmwf.int/datasets/data/interim-full-daily/levtype=sfc/). The problem is that the daily values that I obtain from ERA-I are too low. ssrd comes in J/m2 and in a daily resolution (I cannot get higher temporal resolutions), and I get values up to 7 MJ/m2/d, in which values around 20+ MJ/m2/d are expected for mid-summer in this location (lat = 68N Lon 134W). Has anyone run into these problems with radiation (not able to download subdaily radiation and getting too small values). Any answer is appreciated, thanks Sebastian

These are not daily values. If you look above "Select parameter" you will see "Select step" and "Select time". Time (and date) are the start time of the forecasts (twice daily) and step is the number of hours into the forecast. Ssrd is an accumulated field, from the beginning of the forecast to the particular step. Steps are 3 hourly, out to 12 hours. However, note that further steps, out to 240 hours are available with batch access, see "Access Public Datasets" in the left hand menu. To convert Jm-2 to Wm-2, simply divide by the number of seconds in step hours ie step*60*60.

Dear Toihir, I'm not sure what a SAGE II V7 file has to do with reanalysis, but perhaps these suggestions will help. I suggest you consult the lead author of any reference you are using for the SAGE II data, or consult with the data center from which you procured the data. From a google search on SAGE II, I see that the SAGE II home page is http://sage.nasa.gov/SAGE2/ . Read software is provided at https://eosweb.larc.nasa.gov/project/sage2/sage2_v7_table . Both Fortran and IDL code are provided there, so some modification will be necessary for matlab. I suggest you consult with a local matlab expert about how to interpret either the Fortran or IDL. best wishes

Anonymous (not verified)

Mon, 03/09/2015 - 17:17

I have been puzzled about odd looking scales in some downloaded ERA-I netCDF files. However, I have found out about scale factors and add-offset. However, when I apply them to some datasets, e.g. temperature and mean SLP, the new "unpacked" values are quite obviously not right, and the original values were. I tried to check by downloading an equivalent grib file, converting to net CDF with cod then examining the new output values. They were the same as the packed version. This is confusing. Heat flux values on the other hand seem wrong in both packed and unpacked, as ocean values in the Arctic (Barents Sea) appear more negative than do those over the ice.

To assist you, anyone will probably need significantly more information. I suggest you start a page at reanalyses.org under Help (visible once authenticated) and describe precisely what you steps you followed and what values you are seeing. Including screen shots of the data access request and then the output of ncdump will be helpful.

I can offer some general advice, but as Gilbert Compo said, a precise answer would require more information. Firstly, beware that some software automatically unpacks netCDF data. Also note, that the scale factors and add-offset vary from variable to variable and file to file. ERA-Interim fluxes, defined to be positive downwards, are accumulated from the beginning of the forecast for +step hours, so you need to divide by the number of seconds in step to obtain units in "per second".

Hi subramanyam , In order to help, anyone looking at this would need to have a link to the data you are trying to open. Grads and opengrads are similar in their capacity to open files. You may prefer to search the grads forum, then ask this question if it hasn't already been discussed. I did a quick google search and found:

http://gradsusr.org/pipermail/gradsusr/2012-December/033787.html

Good Luck

Dear Subramanyam, It looks like bug reports for opengrads are entered at http://sourceforge.net/p/opengrads/bugs/ I suggest submitting a detailed bug report, including the particular CMIP5 file that is causing the problem, and any error messages. Additionally, try downloading the CMIP5 files that are causing problems, or demonstrate that some other software opens it correctly in your bug report. best wishes,

Camiel Severijns (not verified)

Tue, 03/04/2014 - 04:26

I think I have found a problem with the longitude coordinate of the data files of the 20CR under http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_grib_indi_fg_variables ncl_convert2nc fails to convert these files. CDO does convert them to NetCDF but after this the longitude coordinate values range from about -1.8 to 0 (from West to East). The latitude coordinates are correct. The CDO operator setgrid,t62 fixes this problem.

Camiel, Does your cdo returned netCDF file show grid_type = "gaussian" before you use setgrid,t62 ? When I use cdo on these files without the setgrid,t62 I see that metadata. The longitude coordinate goes from 0 to 358.125. But, we use "wgrib" to separate out each ensemble member as a separate grib file before passing to cdo. Perhaps the ensemble dimension is confusing cdo? Looks like by specifying the setgrid,t62 you have found a great workaround to a cdo problem! thanks for sharing this, best wishes, gil

Anonymous (not verified)

Fri, 02/21/2014 - 11:34

Yeah, I agree that it is better to read every single ensemble member out from TMP.2m.1871.grb type files and convert them to be nc files. It works for me in this way. But I use "cdo -f nc copy filename.grb filename.nc" to convert grb files to be nc files. Thanks.

Camiel Severijns (not verified)

Wed, 02/19/2014 - 03:07

To force an ensemble of ocean model experiments I would like to use (near) surface data from individual members of the 20CR. I downloaded a file 187501_sfcanl_mem01.tar which I assume contains the data I am looking for. However, the files in this tar-file are not in GRIB format. The first few bytes contain the string 'GFS SFC'. Can anyone tell me how this files are formatted?

Dear Camiel, For the GRIB formatted data from the NERSC Science Tape Gateway at http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_full_analysis_fields you want the surface flux grib files "sflx", rather than the binary "sfcanl" files. E.g. for the first member of the 0 to 3 hour forecast 187501_sflxgrbens_fhr03_mem01.tar and the first member of the 3 to 6 hour forecast 187501_sflxgrbens_fhr06_mem01.tar These are the file types that most other groups have used. Alternatively, you may want to obtain only your variables of interest. If a variable that you need is not at http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_grib_indi_fg_variables we can generate it if it is in the "sflx" files. Obtaining the individual variables you need, rather than the complete "sflxgrbens" file may save transfer time. Please reply if you one or the other of these solutions does not work for your purposes. best wishes, gil compo

Dear Gill, I have found the data files and tried to convert the grib files to netcdf using ncl_convert2nc (version 6.1.2). This tool stops with the following warnings (there are lots more of those preceeding) and two fatal errors: warning:./TMP.2m.1871.ens.grb->TMP_98_HTGL is missing ens: 54 it: 12/31/1871 (18:00) ft: 6 warning:./TMP.2m.1871.ens.grb->TMP_98_HTGL is missing ens: 55 it: 12/31/1870 (18:00) ft: 3 warning:./TMP.2m.1871.ens.grb->TMP_98_HTGL is missing ens: 55 it: 12/31/1871 (18:00) ft: 6 fatal:NclGRIB: Couldn't handle dimension information returned by grid decoding fatal:NclGRIB: Deleting reference to parameter because of decoding error Classic model NetCDF does not support string types, converting initial_time1 to a character array Dimension 'ncl_strlen_0' will be added Classic model NetCDF does not support string types, converting ensemble0_info to a character array Dimension 'ncl_strlen_1' will be added Do you know what might be the problem here? Thanks, Camiel

Camiel, I was able to use ncl_convert2nc 6.0.0 to convert the file sflxgrbens_fhr03_1871010100_mem01 (add .grib suffix) to netcdf. This file is contained in the tarfile accessed from http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_full_analysis_fields/1871/187101_sflxgrbens_fhr03_mem01.tar Conversely, when I tried the file TMP.2m.1871.ens.grb accessed from http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_grib_indi_fg_variables/TMP/TMP.2m.1871.ens.grb.tar I get ncl_convert2nc error messages very similar to yours. I access the TMP.2m.1871.ens.grb in python. I suspect that there is a bug in the ncl_convert2nc for very large files. You may want to use wgrib http://www.cpc.ncep.noaa.gov/products/wesley/wgrib.html to slice up the file into smaller pieces and see if that works. Alternatively, since the sflxgrb file does work with ncl_convert2nc, perhaps using those will be better? best wishes, gil

Camiel, You may want to see if you can enable the "large file support" in ncl_convert2nc. compo/test_ncl_convert2nc> ncl_convert2nc -h ncl_convert2nc inputFile(s) OPTIONS inputFile(s) name(s) of data file(s) [required] [valid types: GRIB1 GRIB2 HDF HDF-EOS netCDF shapefile] [-i input_directory] location of input file(s) [default: current directory] [-o output_directory] location of output file(s) [default: current directory] [-e extension] file type, defined by extension, to convert [example: grb] [-u time_name] name of the NCL-named time dimension to be UNLIMITED [-U new_time_name] if -u is specified: new name of UNLIMITED variable and dimension [-sed sed1[,...]] GRIB files only; set single element dimensions [default: none] choices are initial_time, forecast_time, level, ensemble, probability, all, none [-itime] GRIB files only; set initial time as a single element dimension (same as -sed initial_time) [-ftime] GRIB files only; set forecast time as a single element dimension (same as -sed forecast_time) [-tps] GRIB files only; remove suffix representing a time period (e.g. 2h) from statistically processed variables, leaving only type of processing as a suffix (e.g. _acc, _avg) [-v var1[,...]] user specified subset of variables [default: all variables] ncl_filedump can be used to determine desired variable names [-L] support for writing large (>2Gb) netCDF files [default: no largefile support] Note, though, from the ncl_convert2nc help page http://www.ncl.ucar.edu/Document/Tools/ncl_convert2nc.shtml -L Specifies that the resultant netCDF output file may exceed 2Gb in size on platforms that have "large file support" (LFS). However, no single variable may exceed 2Gb in the current implementation. You may need to slice out individual ensemble members for ncl_convert2nc to work on the TMP.2m.1871.grb type files. I hope that this helps. best wishes, gil

Hi Gil, After extracting the T2M data for one member only, ncl_convert2nc still fails with the same error (-L option makes no difference). CDO has no problems with converting the single member GRIB file to NetCDF. The variable name is wrong but this can be fixed. My guess now is that something is wrong with ncl_convert2nc. Regards, Camiel

Unfortunately, it is not straight forward to automate the download of ERA-Interim and ERA-40 fields. I do have automated routines for the conversion of ERA-40 and ERA-Interim to GOAT format but you need to download the NC files yourself. If you are interested in monthly means, some of these are available at the goat-geo.org site. I can add more upon request. GOAT does support automated download for NCEPI, NCEPII, 20CRenalysis, ORAS4, TRMM, CloudSatCalipso composite, ERSST, MERRA, and others.

Masatomo Fujiwara (not verified)

Fri, 12/27/2013 - 18:45

I think you had better look at the original satellite ozone measurements for your purpose. The Stratospheric Processes and their Role in Climate (SPARC) project has been doing ozone measurement validation and evaluation for many years. Please go to http://www.sparc-climate.org/activities/ozone-profile-ii/ and contact with the activity leaders shown there, and/or check "Website for further information" at the end of the page (i.e., http://igaco-o3.fmi.fi/VDO/index.html). Actually, there are several choices for satellite ozone measurements, but the latest version SAGE data set may be most useful for you. For ozone in the reanalyses, I think we need validation and evaluation before using it for climate studies. The SPARC Reanslysis Intercomparison Project (S-RIP, http://s-rip.ees.hokudai.ac.jp/index.html) has this component. For your information, the following is my quick survey for the 9 reanalyses. Please confirm by yourself by checking the references. NCEP/NCAR & NCEP/DOE: (Kalnay et al., 1996; Kistler et al., 2001; Kanamitsu et al., 2002): - Zonally averaged seasonal climatological ozone used in the radiation computation - (In NCEP/DOE, the latitudinal orientation was reversed north to south) ERA-40: (Uppala et al., 2005; Dethof and Holm, 2004): - TOMS and SBUV ozone retrievals (not radiance) are assimilated (1978-). Ozonesondes not assimilated. - Ozone in the ECMWF model is described by a tracer transport equation including a parametrization of photochemical sources and sinks. - The ozone climatology is used in the radiation calculations of the forecast model. ERA-Interim: (Dee et al., 2011; Dragani, 2011): - TOMS, SBUV, GOME (1996-2002), MIPAS (2003-2004), SCIAMACHY (2003-), MLS (2008-), OMI (2008-) are assimilated. SAGE, HALOE, and POAM are not assimilated. – Ozone model and radiation calculations are basically the same as ERA-40. JRA-25: (Onogi et al., 2007): – Ozone observations are not assimilated directly. – Daily ozone distribution is prepared in advance using a CTM with “nudging” to the satellite total ozone measurements and provided to the forecast model (the radiative part). JRA-55 (Ebita et al., 2011): - similar to JRA-25 for 1979-; monthly climatology for -1978 MERRA: (Rienecker et al., 2011): – SBUV2 ozone (version 8 retrievals) is assimilated for Oct 1978–present. – The MERRA AGCM uses the analyzed ozone generated by the DAS. (cf. a climatology for aerosol) NCEP-CFSR: (Saha et al., 2010) – SBUV profiles and total ozone retrievals are assimilated (but not bias-adjusted; should not be used for trend detection) – Prognostic ozone with climatological production and destruction terms computed from 2D chemistry models (for radiation parameterization) 20CR: (Compo et al., 2011): – "A prognostic ozone scheme includes parametrizations of ozone production and destruction (Saha et al., 2010)."

gilbert.p.comp…

Fri, 12/27/2013 - 13:23

Dear samudraval59, Some atmospheric reanalyses, such as NCEP/NCAR http://reanalyses.org/atmosphere/overview-current-reanalyses#NCEP1 do not provide ozone. some, such as CFSR http://reanalyses.org/atmosphere/overview-current-reanalyses#CFSR, ERA-Interim http://reanalyses.org/atmosphere/overview-current-reanalyses#ERAINT, MERRA http://reanalyses.org/atmosphere/overview-current-reanalyses#MERRA provide ozone on levels. Links to the data are provided at each overview. 20th Century Reanalysis (20CR) http://reanalyses.org/atmosphere/overview-current-reanalyses#TWENT provides only the total column ozone. Note that while ozone is prognostic in 20CR, that system assimilates only surface pressure. Please read the linked references to determine what each system is doing and what data are being assimilated, particularly related to ozone. Links to various tools are given on this page where you left this comment, i.e., http://reanalyses.org/atmosphere/how-obtainplotanalyze-data and are also http://reanalyses.org/atmosphere/tools . If those do not include ozone, you may want to leave a comment on each page or use the contact on the respective linked sites. For the Web-based Reanalysis Intercomparison Tool, you can leave comments at https://reanalyses.org/atmosphere/web-based-reanalysis-intercomparison-tools-writ best wishes, gil compo

samudralav59 (not verified)

Fri, 12/27/2013 - 11:40

My present work of study of warming regimes and the trends require me acquire and capture data and analysis tools on open domain vis-à-vis ozone profiling, the ozone mixing ration and partial pressures.I would be very grateful if I could be given a peek to get the above in the most reliable free sources. thanking you. Samudrlav59

Luigi (not verified)

Wed, 06/12/2013 - 12:59

Dear reanalyses.org I am trying to get daily weather data from CFSR to run an ecosystem model for a geographic area (say Italy) by using the NCDC OPENDAP server, e.g. http://nomads.ncdc.noaa.gov/thredds/dodsC/modeldata/cmd_flxf/2000/200005/20000504/flxf01.gdas.2000050400.grb2.html but with no luck so far. I was wondering whether there is a more direct way to get daily time series data (in ASCII) from CFSR that people uses routinely. Daily time series for surface parameters such as max/min temperature, solar radiation, precipitation, relative humidity, and wind, are standard for ecosystem models as life works on a circadian rhythm on Earth. Thanks for any hint and kind regards, Luigi

Easwar (not verified)

Thu, 05/30/2013 - 04:08

Dear sir, I need historiacl /longterm wind data for a specific site in order to obtain correlation with actual data/nearby metmast data,so how can i get it ?and where from?.Kindly guide me with a procedure to download the data with an exact link. Regards, Easwar.

Dear Easwar, Happy to help, but this area is for reanalysis data. See http://reanalyses.org/ for the definition of reanalysis data. This may be what you need but your question is not clear in this respect. If you want data from a station, you should post your question in the Observations area http://reanalyses.org/observations/surface . Is your site over the ocean or over land? How close do the data need to be to your site? What is your site location? While posting at http://reanalyses.org/observations/surface, you may want to make your question a bit clearer. What do you mean by "historical/longterm" wind data? Do you want a long-term average or do you want a long time series at some temporal resolution? What is the temporal resolution you need? What is the temporal resolution you can still use (e.g., monthly averages, daily averages, once-per-day)? What is the height of the data you need? Do you want data from satellites, such as scatterometers? By providing more information in the Observations area, someone may be able to help you better. best wishes, gil compo

gilbert.p.comp…

Wed, 01/25/2012 - 10:14

Stefan,

Adding panoply is a great idea, but Reanalyses.org is a wiki site that depends on users. You can login and add it where you feel it is appropriate. If you have any questions, please feel free to ask or add a question to the Help section.

best wishes,
gil compo

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.