ESGF

How to obtain/plot/analyze data

Created by Cathy.Smith@noaa.gov on - Updated on 08/26/2024 13:09

Data Extraction

  1. NCEI NOMADS and NCMP:  reanalysis (CFSR,NARR,R1,R2); NWP (NAM, GFS, RUC); GENS ensembles, SST
  2. NOAA PSL Search and Plot. (R1,R2,20CR, NARR)
  3. NOAA IRI (CFSR,20CR,R1,R2)
  4. ECMWF
    1. ERA5: access via the Climate Data Store https://cds.climate.copernicus.eu/#!/home and https://cds-beta.climate.copernicus.eu/ 
    2. Alternative: https://www.ecmwf.int/en/forecasts/datasets/search 
  5. NASA 
    1. MERRA: GES DISC Data Collections: MERRA
    2. MERRA-2: GES DISC Data Collections: MERRA-2
    3. MERRA and MERRA2 Data Subsetter  (variable list for MERRA-2)
  6. NCAR, Highest-resolution files for all reanalyses, except MERRA. GRIB parameter field extraction using cURL, and some conversion to netCDF as noted. 
    1. JRA-25: Data Access > Web File Listing > Create Your Own File List (e.g. anl_p), use cURL or wget (for files).
    2. JRA-55
    3. ERA5, ERA-Interim
    4. CFSR - (also subset with net CDF format conversion)
    5. 20CR
    6. 20CRv2c
    7. 20CRv3
  7. OpenDAP servers
    1. NOAA PSL (20CR,R1,R2,NARR), NCEP, MERRA2D, MERRA3D
    2. MERRA Gridded Innovations and Observations (GIO)
  8. OpenGrADS.org: GrADS software with additional user functionality, including GUI for reanalyses including NCEP and MERRA
  9. Earth System Grid Federation (CFSR, MERRA, 20CR, JRA-25, ERA-Interim) Obs4MIPS: Easy access to NetCDF reanalyses data of selected variables corresponding to the CMIP5 climate model output
  10. GOAT: Geophysical Observations Analysis Tool for MATLAB

Step-by-Step Guide to obtaining data files

Post Processing Routines and Algorithms

  1. Extrapolate MERRA pressure-level data below the surface

Webtools to plot/analyze data by Function

Basic Maps

  1. NOAA IRI (CFSR,20CR,R1,R2)
  2. NOAA PSL Search and Plot (20CR,R1,R2,NARR)
  3. NASA MERRA: Uses Giovanni to produce maps or animations of some monthly fields. Can average over successive times.
  4. NOAA NOMADS (CFSR,NARR,R1,R2)
  5. ECMWF ERA-40, ERA-Interim (Plot maps)
  6. NASA MERRA Atlas
  7. NOAA/PSL Web-based Reanalysis Intercomparison Tool for maps makes user-selected reanalysis fields for monthly data. It can also difference two reanalyses or selected observational datasets with user-selected climatologies.
  8. The Climate Reanalyzer makes user-selected reanalysis fields and differences for monthly data.
  9. MeteoCentre provides pre-generated synoptic maps of SLP, 1000-500 thickness, and 500 hPa height (20CR and R1).
  10. GOAT: Geophysical Observations Analysis Tool for MATLAB

Other Basic Geographic Plots

  1. NOAA PSL:Crossections
  2. NOAA PSL: Search and Plot
  3. MERRA: Uses Giovanni to produce hovmollers of some monthly fields.
  4. The Royal Netherlands Meteorological Institute (KNMI) Climate Explorer
  5. GOAT: Management and Analysis of Geophysical-Data Made Simple for Matlab
  6. Met Data Explorer

Hovmollers

  1. NOAA/PSL: Hovmollers (R1)
  2. IRI
  3. GOAT: Geophysical Observations Analysis Tool:Management and Analysis of Geophysical-Data Made Simple for Matlab

Advanced Plots

  1. NOAA PSL: Can plot monthly, daily and sub-daily of crossections from composite plotting pages (R1). Anomalies are available.
  2. NOAA/PSL: Hovmollers of means, anomalies of daily data. Anomalies are available (R1).
  3. GOAT: Temporal and spatial subsettting is supported via a GUI or built in function. Built-in calculation of anomalies and climatology. Superimpose or show the difference between two fields. Display land-cover or topography.

Composite Maps (Average different, possibly non-contiguous dates together)

  1. NOAA PSL: Can plot composite maps and vertical crossectons from composite plotting pages on monthly, daily and sub-daily time scales for R1. Anomalies are available.
  2. NOAA PSL: Can plot composite maps from plotting pages on monthly, daily and sub-daily timescales for 20CR. Anomalies are available. For monthly, plot composite maps of the 20CR ensemble spread (uncertainty).
  3. GCOS/WGSP: Can plot composite maps of sea level pressure from plotting pages on monthly timescales. Anomalies are available.
  4. WRIT maps: Can plot composite maps of a reanalysis or the difference of composites from two reanalyses.
  5. GOAT: Can plot composites of non-contiguous dates.

Correlation Maps

  1. NOAA PSL WRIT Correlations
  2. NOAA PSL: From monthly NCEP/NCAR R1
  3. KNMI
  4. The Climate Reanalyzer (ERA-Interim, NCEP/NCAR R1, NCEP/DOE R2, 20CR, observational datasets: PRISM precipitation, ERSSTv3b)

Timeseries Plots

  1. NOAA PSL Plot simple timeseries of NCEP/NCAR R1 and 20thC Reanalysis monthly variables
  2. IRI Data Library
  3. Met Data Explorer: Unidata
  4. Web-based Reanalysis Intercomparison Tool for timeseries (WRIT) makes user-selected reanalysis timeseries, scatter plots, cross-correlation functions, and probability density functions for monthly data. It can also difference two reanalyses or selected observational datasets.
  5. The Climate Reanalyzer makes user-selected reanalysis time series with land/ocean masking.

Timeseries Analysis

  1. KNMI: Plot, compute annual cycle, filter and other tools available for time series analysis. Provides many climate/ocean time-series.
  2. NOAA/PSL: Correlate and do some other simple analysis on pregenerated or user supplied monthly time-series
  3. NOAA/PSL: Extract daily timeseries from datasets. Can supply user criteria (e.g. top 10 temperatures in January for a point). R1,20CR
  4. NOAA/PSL: Extract monthly timeseries from datasets.  R1,20CR
  5. IRI Data Library
  6. NOAA PSL: Web-based Reanalysis Intercomparison Tool for timeseries (WRIT) makes user-selected reanalysis timeseries, scatter plots, cross-correlation functions, wavelets, and probability density functions for monthly data. It can also difference two reanalyses or selected observational datasets.

Google Earth

  1. NOAA PSL: Create in KML plots (20CR, R1)

Miscellaneous

  1. NOAA/PSL Lead/Lag for Composites
  2. NOAA\/PSL Lead/Lag for Correlations (maps)
  3. KNMI Smoothed fields, EOF, SVD and other analysis
  4. NOAA/PSL WRIT Trajectory calculator (20CR, CFSR)

 

Applications that read/plot/analyze netCDF and/or grib data (non-web)

A complete list is at Unidata

  1. NCL: NCAR Command Language (no longer updated but has full functionality)
  2. GrADS: The Grid Analysis and Display System (GrADS)
  3. IDVIntegrated Data Viewer
  4. FerretData Visualization and Analysis: From NOAA/PMEL
  5. NCO: NetCDF Operators. The NCO toolkit manipulates and analyzes data stored in netCDF-accessible formats, including DAPHDF4, andHDF5. It exploits the geophysical expressivity of many CF (Climate & Forecast) metadata conventions, the flexible description of physical dimensions translated by UDUnits, the network transparency of OPeNDAP, the storage features (e.g., compression, chunking, groups) of HDF (the Hierarchical Data Format), and many powerful mathematical and statistical algorithms of GSL (the GNU Scientific Library). NCO is fastpowerful, and free.
  6. CDO: Climate Data operators.  A collection of command-line operators to manipulate and analyze climate and numerical weather prediction data; includes support for netCDF-3, netCDF-4 and GRIB1, GRIB2, and other formats.
  7. MATLAB
  8. IDL: Interactive Data Language
  9. CDAT Community Data Analysis Tools: CDAT: Note this will be replaced soon by xCDAT
  10. xCDAT: xCDAT is an extension of xarray for climate data analysis on structured grids. It serves as a spiritual successor to the Community Data Analysis Tools (CDAT) library.
  11. GOATGeophysical Observations Analysis Tool:  A MATLAB based tool that integrates with NetCDF files and OPeNDAP sources.

 

 

 

khaled Megahed (not verified)

Sun, 03/06/2022 - 12:47

Dear Sir,

I would like to open ERA5 grid data that was downloaded from ECMWF.

Could you please send me some code to open and read with a visualize such kind of data.

I wait your reply as soon as possible.

Best wishes

Khaled

solgunta@123

Mon, 10/08/2018 - 23:15

Please can anyone help me? I failed install NCL on my window platform, i fallowed the instruction but could not start to work. 

Moses Monday (not verified)

Fri, 08/04/2017 - 19:15

I really need help. 

I want to download data for 

-Incoming shortwave and outgoing shortwave radiation 

-Incoming longwave and outgoing longwave radiation 

-Albedo and net radiation. 

Location: Lagos Nigeria 

These data must be hourly with good resolution. 

Please any help? 

Thanks 

 

Moses,

A couple of points. MERRA, MERRA-2 and CSFR have 1 hourly data, others may too, you should review the characteristics of these and others to see which best suits your needs. When you say resolution must be good, do you mean spatial resolution? And if so, what is good resolution?

Keep in mind that when using reanalysis data, the radiation parameters are strongly dependent on *modeled* cloud fields.  This can lead to significant uncertainty in the values. 

Once you figure out which you want, then you can start looking to see if they have tools that permit the download of point data (MERRA/MERRA-2 both do).  Their documentation is listed here.

For there ERA5

https://www.ecmwf.int/en/newsletter/147/news/era5-reanalysis-production

For CFSR

https://www.ncdc.noaa.gov/data-access/model-data/model-datasets/climate-forecast-system-version2-cfsv2#CFS%20Reanalysis%20(CFSR)

The 20CRV2c has 3 hourly data for surface fluxes. The MERRA and ERA have higher spatial resolution. 

As the others asked, what time period?

andy (not verified)

Thu, 05/04/2017 - 07:34

Hi, 

 

Need to plot streamlines using ECMWF winds (U and V) over Asian region ...Can I have matlab code?

Cathy.Smith@noaa.gov

Fri, 05/19/2017 - 09:53

In reply to by andy (not verified)

While I don't think matlab has an email list, they do have extensive help pages. I searched and see

https://plot.ly/matlab/streamline-plots/

https://www.mathworks.com/help/matlab/ref/streamline.html

https://www.mathworks.com/help/matlab/ref/stream2.html

They also have libraries to read netCDF files.

 

Cathy S.

 

 

For GrADS, this page has an example http://www.jamstec.go.jp/frsgc/research/iprc/nona/GrADS/plot-strem-line.html You can use this plotting page http://www.esrl.noaa.gov/psd/cgi-bin/data/testdap/plot.comp.pl to plot zonal means of meridional winds (and omega) to look at the Hadley cell. NCL will also plot streamlines http://www.ncl.ucar.edu/Applications/stream.shtml Cathy Smith

I'd like to access from 20CR (ver 2c) daily rainfall for a specific lat/lon reference point. Is there a relationship between the daily pr_wtr output variable and the monthly mean prate variable? Is it valid to compare actual daily rainfall with data derived from pr_wtr?

Sebastian Krogh (not verified)

Wed, 12/02/2015 - 11:44

Hi, I trying to extract daily incoming shortwave from ERA-I, the variable is ssrd (Surface solar radiation downwards), which I downloaded from ECMWF website (http://apps.ecmwf.int/datasets/data/interim-full-daily/levtype=sfc/). The problem is that the daily values that I obtain from ERA-I are too low. ssrd comes in J/m2 and in a daily resolution (I cannot get higher temporal resolutions), and I get values up to 7 MJ/m2/d, in which values around 20+ MJ/m2/d are expected for mid-summer in this location (lat = 68N Lon 134W). Has anyone run into these problems with radiation (not able to download subdaily radiation and getting too small values). Any answer is appreciated, thanks Sebastian

These are not daily values. If you look above "Select parameter" you will see "Select step" and "Select time". Time (and date) are the start time of the forecasts (twice daily) and step is the number of hours into the forecast. Ssrd is an accumulated field, from the beginning of the forecast to the particular step. Steps are 3 hourly, out to 12 hours. However, note that further steps, out to 240 hours are available with batch access, see "Access Public Datasets" in the left hand menu. To convert Jm-2 to Wm-2, simply divide by the number of seconds in step hours ie step*60*60.

Dear Toihir, I'm not sure what a SAGE II V7 file has to do with reanalysis, but perhaps these suggestions will help. I suggest you consult the lead author of any reference you are using for the SAGE II data, or consult with the data center from which you procured the data. From a google search on SAGE II, I see that the SAGE II home page is http://sage.nasa.gov/SAGE2/ . Read software is provided at https://eosweb.larc.nasa.gov/project/sage2/sage2_v7_table . Both Fortran and IDL code are provided there, so some modification will be necessary for matlab. I suggest you consult with a local matlab expert about how to interpret either the Fortran or IDL. best wishes

Anonymous (not verified)

Mon, 03/09/2015 - 17:17

I have been puzzled about odd looking scales in some downloaded ERA-I netCDF files. However, I have found out about scale factors and add-offset. However, when I apply them to some datasets, e.g. temperature and mean SLP, the new "unpacked" values are quite obviously not right, and the original values were. I tried to check by downloading an equivalent grib file, converting to net CDF with cod then examining the new output values. They were the same as the packed version. This is confusing. Heat flux values on the other hand seem wrong in both packed and unpacked, as ocean values in the Arctic (Barents Sea) appear more negative than do those over the ice.

To assist you, anyone will probably need significantly more information. I suggest you start a page at reanalyses.org under Help (visible once authenticated) and describe precisely what you steps you followed and what values you are seeing. Including screen shots of the data access request and then the output of ncdump will be helpful.

I can offer some general advice, but as Gilbert Compo said, a precise answer would require more information. Firstly, beware that some software automatically unpacks netCDF data. Also note, that the scale factors and add-offset vary from variable to variable and file to file. ERA-Interim fluxes, defined to be positive downwards, are accumulated from the beginning of the forecast for +step hours, so you need to divide by the number of seconds in step to obtain units in "per second".

Hi subramanyam , In order to help, anyone looking at this would need to have a link to the data you are trying to open. Grads and opengrads are similar in their capacity to open files. You may prefer to search the grads forum, then ask this question if it hasn't already been discussed. I did a quick google search and found:

http://gradsusr.org/pipermail/gradsusr/2012-December/033787.html

Good Luck

Dear Subramanyam, It looks like bug reports for opengrads are entered at http://sourceforge.net/p/opengrads/bugs/ I suggest submitting a detailed bug report, including the particular CMIP5 file that is causing the problem, and any error messages. Additionally, try downloading the CMIP5 files that are causing problems, or demonstrate that some other software opens it correctly in your bug report. best wishes,

Camiel Severijns (not verified)

Tue, 03/04/2014 - 04:26

I think I have found a problem with the longitude coordinate of the data files of the 20CR under http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_grib_indi_fg_variables ncl_convert2nc fails to convert these files. CDO does convert them to NetCDF but after this the longitude coordinate values range from about -1.8 to 0 (from West to East). The latitude coordinates are correct. The CDO operator setgrid,t62 fixes this problem.

Camiel, Does your cdo returned netCDF file show grid_type = "gaussian" before you use setgrid,t62 ? When I use cdo on these files without the setgrid,t62 I see that metadata. The longitude coordinate goes from 0 to 358.125. But, we use "wgrib" to separate out each ensemble member as a separate grib file before passing to cdo. Perhaps the ensemble dimension is confusing cdo? Looks like by specifying the setgrid,t62 you have found a great workaround to a cdo problem! thanks for sharing this, best wishes, gil

Anonymous (not verified)

Fri, 02/21/2014 - 11:34

Yeah, I agree that it is better to read every single ensemble member out from TMP.2m.1871.grb type files and convert them to be nc files. It works for me in this way. But I use "cdo -f nc copy filename.grb filename.nc" to convert grb files to be nc files. Thanks.

Camiel Severijns (not verified)

Wed, 02/19/2014 - 03:07

To force an ensemble of ocean model experiments I would like to use (near) surface data from individual members of the 20CR. I downloaded a file 187501_sfcanl_mem01.tar which I assume contains the data I am looking for. However, the files in this tar-file are not in GRIB format. The first few bytes contain the string 'GFS SFC'. Can anyone tell me how this files are formatted?

Dear Camiel, For the GRIB formatted data from the NERSC Science Tape Gateway at http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_full_analysis_fields you want the surface flux grib files "sflx", rather than the binary "sfcanl" files. E.g. for the first member of the 0 to 3 hour forecast 187501_sflxgrbens_fhr03_mem01.tar and the first member of the 3 to 6 hour forecast 187501_sflxgrbens_fhr06_mem01.tar These are the file types that most other groups have used. Alternatively, you may want to obtain only your variables of interest. If a variable that you need is not at http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_grib_indi_fg_variables we can generate it if it is in the "sflx" files. Obtaining the individual variables you need, rather than the complete "sflxgrbens" file may save transfer time. Please reply if you one or the other of these solutions does not work for your purposes. best wishes, gil compo

Dear Gill, I have found the data files and tried to convert the grib files to netcdf using ncl_convert2nc (version 6.1.2). This tool stops with the following warnings (there are lots more of those preceeding) and two fatal errors: warning:./TMP.2m.1871.ens.grb->TMP_98_HTGL is missing ens: 54 it: 12/31/1871 (18:00) ft: 6 warning:./TMP.2m.1871.ens.grb->TMP_98_HTGL is missing ens: 55 it: 12/31/1870 (18:00) ft: 3 warning:./TMP.2m.1871.ens.grb->TMP_98_HTGL is missing ens: 55 it: 12/31/1871 (18:00) ft: 6 fatal:NclGRIB: Couldn't handle dimension information returned by grid decoding fatal:NclGRIB: Deleting reference to parameter because of decoding error Classic model NetCDF does not support string types, converting initial_time1 to a character array Dimension 'ncl_strlen_0' will be added Classic model NetCDF does not support string types, converting ensemble0_info to a character array Dimension 'ncl_strlen_1' will be added Do you know what might be the problem here? Thanks, Camiel

Camiel, I was able to use ncl_convert2nc 6.0.0 to convert the file sflxgrbens_fhr03_1871010100_mem01 (add .grib suffix) to netcdf. This file is contained in the tarfile accessed from http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_full_analysis_fields/1871/187101_sflxgrbens_fhr03_mem01.tar Conversely, when I tried the file TMP.2m.1871.ens.grb accessed from http://portal.nersc.gov/archive/home/projects/incite11/www/20C_Reanalysis/everymember_grib_indi_fg_variables/TMP/TMP.2m.1871.ens.grb.tar I get ncl_convert2nc error messages very similar to yours. I access the TMP.2m.1871.ens.grb in python. I suspect that there is a bug in the ncl_convert2nc for very large files. You may want to use wgrib http://www.cpc.ncep.noaa.gov/products/wesley/wgrib.html to slice up the file into smaller pieces and see if that works. Alternatively, since the sflxgrb file does work with ncl_convert2nc, perhaps using those will be better? best wishes, gil

Camiel, You may want to see if you can enable the "large file support" in ncl_convert2nc. compo/test_ncl_convert2nc> ncl_convert2nc -h ncl_convert2nc inputFile(s) OPTIONS inputFile(s) name(s) of data file(s) [required] [valid types: GRIB1 GRIB2 HDF HDF-EOS netCDF shapefile] [-i input_directory] location of input file(s) [default: current directory] [-o output_directory] location of output file(s) [default: current directory] [-e extension] file type, defined by extension, to convert [example: grb] [-u time_name] name of the NCL-named time dimension to be UNLIMITED [-U new_time_name] if -u is specified: new name of UNLIMITED variable and dimension [-sed sed1[,...]] GRIB files only; set single element dimensions [default: none] choices are initial_time, forecast_time, level, ensemble, probability, all, none [-itime] GRIB files only; set initial time as a single element dimension (same as -sed initial_time) [-ftime] GRIB files only; set forecast time as a single element dimension (same as -sed forecast_time) [-tps] GRIB files only; remove suffix representing a time period (e.g. 2h) from statistically processed variables, leaving only type of processing as a suffix (e.g. _acc, _avg) [-v var1[,...]] user specified subset of variables [default: all variables] ncl_filedump can be used to determine desired variable names [-L] support for writing large (>2Gb) netCDF files [default: no largefile support] Note, though, from the ncl_convert2nc help page http://www.ncl.ucar.edu/Document/Tools/ncl_convert2nc.shtml -L Specifies that the resultant netCDF output file may exceed 2Gb in size on platforms that have "large file support" (LFS). However, no single variable may exceed 2Gb in the current implementation. You may need to slice out individual ensemble members for ncl_convert2nc to work on the TMP.2m.1871.grb type files. I hope that this helps. best wishes, gil

Hi Gil, After extracting the T2M data for one member only, ncl_convert2nc still fails with the same error (-L option makes no difference). CDO has no problems with converting the single member GRIB file to NetCDF. The variable name is wrong but this can be fixed. My guess now is that something is wrong with ncl_convert2nc. Regards, Camiel

Unfortunately, it is not straight forward to automate the download of ERA-Interim and ERA-40 fields. I do have automated routines for the conversion of ERA-40 and ERA-Interim to GOAT format but you need to download the NC files yourself. If you are interested in monthly means, some of these are available at the goat-geo.org site. I can add more upon request. GOAT does support automated download for NCEPI, NCEPII, 20CRenalysis, ORAS4, TRMM, CloudSatCalipso composite, ERSST, MERRA, and others.

Masatomo Fujiwara (not verified)

Fri, 12/27/2013 - 18:45

I think you had better look at the original satellite ozone measurements for your purpose. The Stratospheric Processes and their Role in Climate (SPARC) project has been doing ozone measurement validation and evaluation for many years. Please go to http://www.sparc-climate.org/activities/ozone-profile-ii/ and contact with the activity leaders shown there, and/or check "Website for further information" at the end of the page (i.e., http://igaco-o3.fmi.fi/VDO/index.html). Actually, there are several choices for satellite ozone measurements, but the latest version SAGE data set may be most useful for you. For ozone in the reanalyses, I think we need validation and evaluation before using it for climate studies. The SPARC Reanslysis Intercomparison Project (S-RIP, http://s-rip.ees.hokudai.ac.jp/index.html) has this component. For your information, the following is my quick survey for the 9 reanalyses. Please confirm by yourself by checking the references. NCEP/NCAR & NCEP/DOE: (Kalnay et al., 1996; Kistler et al., 2001; Kanamitsu et al., 2002): - Zonally averaged seasonal climatological ozone used in the radiation computation - (In NCEP/DOE, the latitudinal orientation was reversed north to south) ERA-40: (Uppala et al., 2005; Dethof and Holm, 2004): - TOMS and SBUV ozone retrievals (not radiance) are assimilated (1978-). Ozonesondes not assimilated. - Ozone in the ECMWF model is described by a tracer transport equation including a parametrization of photochemical sources and sinks. - The ozone climatology is used in the radiation calculations of the forecast model. ERA-Interim: (Dee et al., 2011; Dragani, 2011): - TOMS, SBUV, GOME (1996-2002), MIPAS (2003-2004), SCIAMACHY (2003-), MLS (2008-), OMI (2008-) are assimilated. SAGE, HALOE, and POAM are not assimilated. – Ozone model and radiation calculations are basically the same as ERA-40. JRA-25: (Onogi et al., 2007): – Ozone observations are not assimilated directly. – Daily ozone distribution is prepared in advance using a CTM with “nudging” to the satellite total ozone measurements and provided to the forecast model (the radiative part). JRA-55 (Ebita et al., 2011): - similar to JRA-25 for 1979-; monthly climatology for -1978 MERRA: (Rienecker et al., 2011): – SBUV2 ozone (version 8 retrievals) is assimilated for Oct 1978–present. – The MERRA AGCM uses the analyzed ozone generated by the DAS. (cf. a climatology for aerosol) NCEP-CFSR: (Saha et al., 2010) – SBUV profiles and total ozone retrievals are assimilated (but not bias-adjusted; should not be used for trend detection) – Prognostic ozone with climatological production and destruction terms computed from 2D chemistry models (for radiation parameterization) 20CR: (Compo et al., 2011): – "A prognostic ozone scheme includes parametrizations of ozone production and destruction (Saha et al., 2010)."

gilbert.p.comp…

Fri, 12/27/2013 - 13:23

Dear samudraval59, Some atmospheric reanalyses, such as NCEP/NCAR http://reanalyses.org/atmosphere/overview-current-reanalyses#NCEP1 do not provide ozone. some, such as CFSR http://reanalyses.org/atmosphere/overview-current-reanalyses#CFSR, ERA-Interim http://reanalyses.org/atmosphere/overview-current-reanalyses#ERAINT, MERRA http://reanalyses.org/atmosphere/overview-current-reanalyses#MERRA provide ozone on levels. Links to the data are provided at each overview. 20th Century Reanalysis (20CR) http://reanalyses.org/atmosphere/overview-current-reanalyses#TWENT provides only the total column ozone. Note that while ozone is prognostic in 20CR, that system assimilates only surface pressure. Please read the linked references to determine what each system is doing and what data are being assimilated, particularly related to ozone. Links to various tools are given on this page where you left this comment, i.e., http://reanalyses.org/atmosphere/how-obtainplotanalyze-data and are also http://reanalyses.org/atmosphere/tools . If those do not include ozone, you may want to leave a comment on each page or use the contact on the respective linked sites. For the Web-based Reanalysis Intercomparison Tool, you can leave comments at https://reanalyses.org/atmosphere/web-based-reanalysis-intercomparison-tools-writ best wishes, gil compo

samudralav59 (not verified)

Fri, 12/27/2013 - 11:40

My present work of study of warming regimes and the trends require me acquire and capture data and analysis tools on open domain vis-à-vis ozone profiling, the ozone mixing ration and partial pressures.I would be very grateful if I could be given a peek to get the above in the most reliable free sources. thanking you. Samudrlav59

Luigi (not verified)

Wed, 06/12/2013 - 12:59

Dear reanalyses.org I am trying to get daily weather data from CFSR to run an ecosystem model for a geographic area (say Italy) by using the NCDC OPENDAP server, e.g. http://nomads.ncdc.noaa.gov/thredds/dodsC/modeldata/cmd_flxf/2000/200005/20000504/flxf01.gdas.2000050400.grb2.html but with no luck so far. I was wondering whether there is a more direct way to get daily time series data (in ASCII) from CFSR that people uses routinely. Daily time series for surface parameters such as max/min temperature, solar radiation, precipitation, relative humidity, and wind, are standard for ecosystem models as life works on a circadian rhythm on Earth. Thanks for any hint and kind regards, Luigi

Easwar (not verified)

Thu, 05/30/2013 - 04:08

Dear sir, I need historiacl /longterm wind data for a specific site in order to obtain correlation with actual data/nearby metmast data,so how can i get it ?and where from?.Kindly guide me with a procedure to download the data with an exact link. Regards, Easwar.

Dear Easwar, Happy to help, but this area is for reanalysis data. See http://reanalyses.org/ for the definition of reanalysis data. This may be what you need but your question is not clear in this respect. If you want data from a station, you should post your question in the Observations area http://reanalyses.org/observations/surface . Is your site over the ocean or over land? How close do the data need to be to your site? What is your site location? While posting at http://reanalyses.org/observations/surface, you may want to make your question a bit clearer. What do you mean by "historical/longterm" wind data? Do you want a long-term average or do you want a long time series at some temporal resolution? What is the temporal resolution you need? What is the temporal resolution you can still use (e.g., monthly averages, daily averages, once-per-day)? What is the height of the data you need? Do you want data from satellites, such as scatterometers? By providing more information in the Observations area, someone may be able to help you better. best wishes, gil compo

gilbert.p.comp…

Wed, 01/25/2012 - 10:14

Stefan,

Adding panoply is a great idea, but Reanalyses.org is a wiki site that depends on users. You can login and add it where you feel it is appropriate. If you have any questions, please feel free to ask or add a question to the Help section.

best wishes,
gil compo

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Overview of current atmospheric reanalyses

Created by Cathy.Smith@noaa.gov on - Updated on 12/04/2024 11:06

 

Current / State-of-the-art: 

Global: ASR | CERA-20C | ERA5 | ERA-20CERA-20CM | JRA-3Q | JRA-55, JRA-55C, JRA-55AMIP | MERRA-2 |  NCEP CFSR | NCEP CFSv2 | NOAA-CIRES 20CRv2c |  NOAA-CIRES-DOE 20CRv3  |  OCADA  |  CORe

Regional:  BARRA (AU) | BARRA2 (AU) | COSMO-REA (Europe) | MERIDA (IT) | NZRA (NZ)

 

Possible issues: consider other datasets for use in new research projects: NCEP/DOE II  | NCEP/NCAR NCEP NARR 

Superseded / Caution use for new research projects: ERA-Interim | ERA-40 | ERA-15 | MERRA | JRA-25  

 

Frequency of updates:

Updated in real-time for public use (1+ days behind): ERA5 | MERRA-2 | NCEP/DOE II  | NCEP/NCAR NCEP NARR  | NCEP CFSv2 | JRA-3Q | JRA-55 |  
Updated in near real-time for public use (1+ months behind):  MERRA-2  
Updated irregularly for public use (years behind): CERA-20C |ERA-20C | ERA-20CM | NOAA-CIRES 20CR NOAA-CIRES 20CRv2cNOAA-CIRES-DOE 20CRv3NASA MERRA

 

Coming up:  ERA6, latest news: 2023-09 (C3S GA) | MERRA-3 | next NOAA reanalysis, latest news: 2024-06

 

Overview Comparison Table (Reanalyses.org)

Overview Comparison Table (ClimateDataGuide)

Overview Comparison Table (as of 2016, S-RIP)

Notes,questions, and discussion by dataset

Ask a Question

 

Arctic System Reanalysis (ASR): 2000-2012

The Arctic System Reanalysis (ASR), a high-resolution regional assimilation of model output, observations, and satellite data across the mid- and high latitudes of the Northern Hemisphere for the period 2000 – 2012 has been performed at 30 km (ASRv1) and 15 km (ASRv2) horizontal resolution using the polar version of the Weather Research and Forecasting (WRF) model and the WRF Data Assimilation (WRFDA) System.

Source: Polar Meteorology Group, Byrd Polar & Climate Research Center, The Ohio State University

Time Range: 2000-2012

Assimilation: WRFDA-3DVAR

Dataset Output Times and Time Averaging: 3-hourly for surface and upper air fields, Monthly means of selected variables

ASRv1 – 30 km  
Model Resolution: 30 km, 71 sigma levels  
Dataset location: https://rda.ucar.edu/datasets/ds631.0/  
ASRv2 30 km is expected early 2017

ASRv2 – 15 km (Currently updating through 2016 - available end of 2017)  
Model Resolution: 15 km, 71 sigma levels  
Dataset location: https://rda.ucar.edu/datasets/ds631.1/

Project Website: Arctic System Reanalysis

References | ClimateDataGuide

Notes/questions/discussions

 

BARRA

The Bureau of Meteorology Atmospheric high-resolution Regional Reanalysis for Australia (BARRA) is a high-resolution multi-decadal atmospheric reanalysis. The reanalysis provides information about surface conditions (such as temperature, precipitation, wind speed and direction, humidity, evaporation and soil moisture), information at pressure and model levels, and information on solar radiation and cloud cover. The reanalysis suite is based on the Australian Community Climate Earth-System Simulator (ACCESS) and extends 70 levels (up to 80 km) into the atmosphere. It is nested within the required boundary and/or initial conditions provided by ERA-Interim reanalysis, Operational SST and Sea Ice Analysis, and the Bureau offline soil moisture reanalysis. The region covered by the reanalysis is the Australian continent, and the surrounding region including parts of southeast Asia, New Zealand, and south to the ice edge of the Antarctic continent. About 100 parameters are available at hourly time steps at approximately 12-km resolution, in this dataset. For a small number of subdomains (South-West W.A., S.A., Eastern N.S.W., and Tasmania), ), dynamically downscaled analyses at a 1.5-km resolution are available separately.

Bureau's Atmospheric high-resolution Regional Reanalysis for Australia (BARRA)

 

BARRA2

BARRA2 is the new version of the regional atmospheric reanalysis over Australia and surrounding regions, spanning 1979-present day time period. When completed, it replaces the first version of BARRA (Su et al., 2019), completed in June 2019, which provided a shorter 1990-2019 February reanalysis.

Bureau's Atmospheric high-resolution Regional Reanalysis for Australia Version 2 (BARRA2)

 

COSMO Regional Reanalyses: 1995-present

Several reanalysis systems are developed to generate high-resolution regional reanalysis data sets for Europe based on the NWP model COSMO. The first available data set at a horizontal resolution of 6km covers the entire European continent for the years 1995-2015 with output of model variables being available for every hour. A subsequent second data set covers large parts of Central Europe in a convection-permitting setup with 2km horizontal resolution and is available for the period 2007-2013.  

Reanalysis consortium: Hans-Ertel-Centre - Climate Monitoring and Diagnostics, German Meteorological Service (DWD) - Climate and Environment, Meteorological Institute of the University of Bonn, Institute for Geophysics and Meteorology of the University of Cologne

Time Range: 1995-2015

Assimilation: Continuous nudging, separate DA modules for soil moisture, snow, SST and sea ice, latent heat nudging scheme

Dataset Output Times: 15 minutes for surface, hourly for upper air fields

COSMO-REA6 – 6.2 km  
Model Resolution: 6.2 km, 40 eta levels  
Period available: 1995-2018  
Domain: Europe (CORDEX-11 domain)  
Production of a second (updated) version of COSMO-REA6 is expected to start late 2020

COSMO-REA2 – 2 km  
Model Resolution: 2 km, 50 eta levels  
Period available: 2007-2013, production for 2014-2015 is currently under way, will be updated regularly  
Domain: Central Europe

COSMO-ENS-REA12 – 12 km  

Period available: 2006-2010

Data Access: COSMO reanalysis website

References

Notes/questions/discussions

 

ECMWF CERA-20C: 1901-2010

CERA-20C is a global 20th-century reanalysis which aims to reconstruct the past weather and climate of the Earth system including the atmosphere, ocean, land, waves and sea ice. CERA-20C is part of the EU-funded ERA-CLIM2 project and extends the reanalysis capability developed in ERA-20C to the ocean and sea-ice components.

A new assimilation system (CERA) has been developed to simultaneously ingest atmospheric and ocean observations in the coupled Earth system model used for ECMWF’s ensemble forecasts. It is based on a variational method with a common 24-hour assimilation window. Air-sea interactions are taken into account when observation misfits are computed and when the increments are applied to the initial condition. In this context, ocean observations can have a direct impact on the atmospheric analysis and, conversely, atmospheric observations can have an immediate impact on the analysed state of the ocean.

CERA-20C assimilates only surface pressure and marine wind observations (ISPDv3.2.6 and ICOADSv2.5.1) as well as ocean temperature and salinity profiles (EN4). The air-sea interface is relaxed towards the sea-surface temperature from the HadISST2 monthly product to avoid model drift while enabling the simulation of coupled processes. No data assimilation is performed in the land, wave and sea-ice components, but the use of the coupled model ensures some dynamical consistency.

The evolution of the global weather for the period 1901–2010 is represented by a ten-member ensemble of 3-hourly estimates for ocean, surface and upper-air parameters. The resolution of the atmospheric model is set to TL159L91 (IFS version 41r2), which corresponds to a 1.125° horizontal grid (125 km) with 91 vertical levels going up to 0.1hPa. The ocean model (NEMO version 3.4) uses the ORCA1 grid, which has approximately 1° horizontal resolution with meridional refinement at the equator. There are 42 vertical ocean levels with a first-layer thickness of 10m.

Data Access: ECMWF

References | Data documentation | ClimateDataGuide

Notes/questions/discussions

 

ECMWF ERA-20C: 1900 - 2010

ERA-20C is ECMWF's first atmospheric reanalysis of the 20th century, from 1900-2010. It is an outcome of the ERA-CLIM project.

ERA-20C was produced with the same surface and atmospheric forcings as the final version of the atmospheric model integration ERA-20CM. A coupled Atmosphere/Land-surface/Ocean-waves model is used to reanalyse the weather, by assimilating surface observations. The ERA-20C products describe the spatio-temporal evolution of the atmosphere (on 91 vertical levels, between the surface and 0.01 hPa), the land-surface (on 4 soil layers), and the ocean waves (on 25 frequencies and 12 directions). The horizontal resolution is approximately 125 km (spectral truncation T159). Note, atmospheric data are not only available on the native 91 model levels, but also on 37 pressure levels (as in ERA-Interim), 16 potential temperature levels, and the 2 PVU potential vorticity level. Monthly means, daily, and invariant data are available. The temporal resolution of the daily products is usually 3-hourly.

The assimilation methodology is 24-hour 4D-Var analysis, with variational bias correction of surface pressure observations. Analysis increments are at T95 horizontal resolution (aprox. 210 km). The analyses provide the initial conditions for subsequent forecasts that serve as backgrounds to the next analyses. A 10-member ensemble was produced initially, to estimate the spatio-temporal evolution of the background errors.

The observations assimilated in ERA-20C include surface pressures and mean sea level pressures from ISPDv3.2.6 and ICOADSv2.5.1, and surface marine winds from ICOADSv2.5.1. The observation feedback from ERA-20C is available. It includes the observations but also departures before and after assimilation and usage flags.

Data Access: ECMWF and NCAR

References | ClimateDataGuide

Notes/questions/discussion

 

ECMWF ERA-20CM Model integration (no data assimilation): 1900 - 2010

The ERA-20CM atmospheric model integrations were produced in the framework of the ERA-CLIM project.

There are two versions, ERA-20CM and ERA-20CMv0, each comprising of a 10-member ensemble. The first version is 'final', the second is 'experimental'. The 'experimental' version was an early production and should not be used to initiate new research.

The model integration is forced by radiative forcing from CMIP5 and also by sea-surface temperature (SST) and sea ice cover from HadISST2.

Access: ECMWF

References | ClimateDataGuide

 

ECMWF ERA5: 1940-present

ERA5 is the latest climate reanalysis produced by ECMWF, providing hourly data on many atmospheric, land-surface and sea-state parameters together with estimates of uncertainty. ERA5 data are available on regular latitude-longitude grids at 0.25o x 0.25o resolution, with atmospheric parameters on 37 pressure levels. Recently, 1940-1978 has been added. 

Data Access: Copernicus  | NCAR | ECMWF

References

Notes/questions/discussion

 

ECMWF Interim Reanalysis (ERA-Interim): 1979-present

Ends Aug 2019

ERA-Interim was originally planned as an 'interim' reanalysis in preparation for the next-generation extended reanalysis to replace ERA-40. It uses a December 2006 version of the ECMWF Integrated Forecast Model (IFS Cy31r2). It originally covered dates from 1 Jan 1989 but an additional decade, from 1 January 1979, was added later. ERA-Interim is being continued in real time. The spectral resolution is T255 (about 80 km) and there are 60 vertical levels, with the model top at 0.1 hPa (about 64 km). The data assimilation is based on a 12-hourly four-dimensional variational analysis (4D-Var) with adaptive estimation of biases in satellite radiance data (VarBC). With some exceptions, ERA-Interim uses input observations prepared for ERA-40 until 2002, and data from ECMWF's operational archive thereafter. See Dee et al. (2011) in the references below for a full description of the ERA-Interim system.

Data Access: ECMWF | NCAR

References | ClimateDataGuide

Notes/questions/discussion

 

ECMWF 40 Year Reanalysis (ERA-40): Sep 1957-Aug 2002

Completed in 2003, ERA-40 is a global atmospheric reanalysis of the 45-year period 1 September 1957 - 31 August 2002. It was produced using a June 2001 version of the ECMWF Integrated Forecast Model (IFS Cy28r3). The spectral resolution is T159 (about 125 km) and there are 60 vertical levels, with the model top at 0.1 hPa (about 64 km). Observations were assimilated using a 6-hourly 3D variational analysis (3D-Var). Satellite data used include Vertical Temperature Profile Radiometer radiances starting in 1972, followed by TOVS, SSM/I, ERS and ATOVS data. Cloud Motion Winds are used from 1979 onwards. Various data from past field experiments were used, such as the 1974 Atlantic Tropical Experiment of the Global Atmospheric Research Program, GATE, 1979 FGGE, 1982 Alpine Experiment, ALPEX and 1992-1993 TOGA-COARE.

Data Access: ECMWF  | NCAR

References | ClimateDataGuide

 

ECMWF 15 Year Reanalysis (ERA-15): Jan 1979-Dec 1993

Completed in 1996, ERA-15 is a global atmospheric reanalysis of the 15-year period 1 January 1979 - 31 December 1993. It was produced using an April 1995 version of the ECMWF Integrated Forecast Model (IFS Cy13r4). The spectral resolution is T106 (about 190 km) and there are 31 vertical levels, with the model top at 10 hPa (about 31 km altitude). Observations were assimilated using a 6-hourly Optimum Interpolation analysis (OI). Satellite data used were limited to cloud-cleared TOVS radiances and Cloud Motion Winds from GOES, GMS, and METEOSAT. Pseudo-observations of surface pressure (PAOBS) were also used, as well various data from past field experiments: 1979 FGGE, 1982 Alpine Experiment (ALPEX), TOGA, SUBDUCTION, and those found in the COADS dataset.

Data Access: ECMWF  | NCAR

References | ClimateDataGuide

 

Japanese 25-year Reanalysis (JRA-25): 1979-2004, JCDAS: 2005-Jan.2014

The Japanese 25-year Reanalysis (JRA-25) represents the first long-term global atmospheric reanalysis undertaken in Asia. Covering the period 1979-2004, it was completed using the Japan Meteorological Agency (JMA) numerical assimilation and forecast system and specially collected and prepared observational and satellite data from many sources including the European Center for Medium-Range Weather Forecasts (ECMWF), the National Climatic Data Center (NCDC), and the Meteorological Research Institute (MRI) of JMA. A primary goal of JRA-25 is to provide a consistent and high-quality reanalysis dataset for climate research, monitoring, and operational forecasts, especially by improving the coverage and quality of analysis in the Asian region.  JRA-25 was conducted by JMA and CRIEPI (Central Research Institute of Electric Power Industry).  It had been continued as JCDAS (JMA Climate Data Assimilation System) operated by JMA in near real time basis. The data assimilation systems of JRA-25 and JCDAS are the same.  Users can use JRA-25 and JCDAS as one continuous reanalysis dataset. JCDAS data provision was terminated in early Feburay 2014 because it was replaced with JRA-55 in operational. The available data period of JRA-25/JCDAS is for 35 years and 1 month (January 1979 to January 2014).

Data Access: NCAR

Homepage | Atlas | References | ClimateDataGuide

 

Japanese 55-year Reanalysis (JRA-55): 1958-2012,  and extended to present  
     [JRA-55C(1972-2012) and JRA-55AMIP(1958-2012)] <-- not extended to present

JMA has carried out the second reanalysis project named the Japanese 55-year Reanalysis (JRA-55) (nicknamed JRA Go! Go!) using a more sophisticated NWP system, which is based on the operational system as of December 2009, and newly prepared past observations. The analysis period is extended to 55 years starting from 1958, when the regular radiosonde observations became operational on the global basis. Many of deficiencies in JRA-25 have been diminished or reduced in JRA-55 because many improvements achieved after JRA-25 have been introduced. JRA-55 provides a consistent climate dataset over the last half century. JRA-55 has been continued in near real time basis after 2013. If you need real time basis (2 days behind) data, please access to JMA. The real time basis data are also provided to other cooperating organizations (Note: half year behind). Note that the products for extended period after 2013 are also called JRA-55. As "JRA-55 family", there are two subproducts JRA-55C and JRA-55AMIP produced by MRI/JMA. JRA-55C assimilated conventional observations only. JRA-55C covers from 1972 to 2012. Before 1971, use JRA-55 instead because no satellite data was assimilated in JRA-55 before 1971. JRA-55AMIP (AMIP type run of JRA-55, with no observations) covers 1958 to 2012. JRA-55C and JRA-55AMIP data are available from DIAS and NCAR. Note that JRA-55C and JRA-55AMIP are not extended to present. JRA-55 Atlas (climate charts) is now available.

Data Access: JMA | DIAS (JRA-55) (JRA-55C) (JRA-55AMIP) | NCAR (JRA-55: Daily 3-Hourly and 6-Hourly DataMonthly Means and Variances) (JRA-55C: Daily(3-hourly,6-hourly), Monthly) (JRA-55AMIP: Daily(3-hourly,6-hourly), Monthly) | ESGF/NASA/WCRP | ECMWF |

Homepage | References | JRA-55 Atlas |

Notes/questions/discussions

 

Japanese Reanalysis for Three Quarters of a Century (JRA-3Q): Sep.1947 to present

JMA is currently conducting the Japanese Reanalysis for Three Quarters of a Century (JRA-3Q), which covers the period from September 1947 onward to extend the current period of data coverage and improve the quality of long-term reanalysis. The project involves a sophisticated data assimilation system (based on the operational set-up as of December 2018) incorporating development results from the operational NWP system and sea surface temperature analysis achieved since JRA-55 (based on the operational set-up as of :2009). New datasets of past observations are also assimilated, including rescued historical observations and reprocessed satellite data supplied by meteorological and satellite centers worldwide. Many of the deficiencies of JRA-55 are alleviated in JRA-3Q, providing a high-quality homogeneous reanalysis dataset that covers the previous 75 years. 

Data Access: DIAS | NCAR |

Homepage | References |


Sub-product JRA-3Q-COBE

In JRA-3Q, the sea surface temperature (SST) specified as the lower boundary condition is the Centennial In Situ Observation-based Estimates of the Variability of SSTs and Marine Meteorological Variables Version 2 (COBE-SST2) with a resolution of 1° based on in situ observations until May 1985 and the Merged Satellite and In-Situ Data Global Daily Sea Surface Temperature (MGDSST) with a resolution of 0.25° based on satellite observations since June 1985. To enable evaluation of changes in product characteristics following the switch from COBE-SST2 to MGDSST, a sub-product using COBE-SST2 (JRA-3Q-COBE) is also provided for the period from June 1985 to December 1990.

Data Access: DIAS |


 

NASA Modern Era Reanalysis for Research and Applications (MERRA): 1979-2016(Feb)

MERRA is a NASA reanalysis for the satellite era using a major new version (circa 2008) of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5) produced by the NASA GSFC Global Modeling and Assimilation Office (GMAO). The Project focused on historical analyses of the hydrological cycle on a broad range of weather and climate time scales and placed the NASA EOS suite of observations in a climate context.

Data Access: GES MDISC | ESGF

Home Page | References | FAQ | Atlas | ClimateDataGuide | AMS Special Collection

 

NASA Modern Era Reanalysis for Research and Applications Version-2 (MERRA-2): 1980-present

MERRA-2 is a NASA reanalysis for the satellite era using a major new version of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5) produced by the NASA GSFC Global Modeling and Assimilation Office (GMAO). MERRA-2 assimilates observations not available to MERRA during the 2010s, and therefore, will continue processing in real time longer than MERRA.  There are numerous improvements and updates to the data assimilaiton, model and observing system. One notable change is the assimilation of aerosol observations, including black and organic carbon, sulfate and dust. Production began in the spring of 2014 and is presently available for access.

Data Access: GES MDISC | FTP Subsetter

Home Page | File Specification | Documentation | AMS Special Collection

References

Notes/questions/discussions

 

NCEP Climate Forecast System Reanalysis (CFSR): 1979-present

The National Centers for Environmental Prediction (NCEP) Climate Forecast System Reanalysis (CFSR) spans 1979 to present. The CFSR was designed and executed as a global, high resolution, coupled atmosphere-ocean-land surface-sea ice system to provide the best estimate of the state of these coupled domains over this period. The T382 resolution atmospheric data spans 1979 to 2010. The current T574 analysis is an extension of the CFSR as an operational, real time CFSv2 product from 2011 into the future.

Data Access: NCEP | NCDC NOMADS | NCAR (includes real time CFSv2) | ESGF

References | ClimateDataGuide

Notes/questions/comments

 

NCEP Climate Forecast System Reanalysis version 2 (CFSv2): 2011-present

The Climate Forecast System Version 2 (CFSv2) produced by the NOAA National Centers for Environmental Prediction (NCEP) is a fully coupled model representing the interaction between the Earth's oceans, land and atmosphere. The four-times-daily, 9-month control runs, consist of all 6-hourly forecasts, and the monthly means and variable time-series (all variables). The CFSv2 outputs include: 2-D Energetics (EGY); 2-D Surface and Radiative Fluxes (FLX); 3-D Pressure Level Data (PGB); 3-D Isentropic Level Data (IPV); 3-D Ocean Data (OCN); Low-resolution output (GRBLOW); Dumps (DMP); and High- and Low-resolution Initial Conditions (HIC and LIC). The monthly CDAS variable timeseries includes all variables. The CFSv2 period of record begins on April 1, 2011 and continues onward. CFS output is in GRIB-2 file format.

Data Access: https://www.ncei.noaa.gov/access/metadata/landing-page/bin/iso?id=gov.noaa.ncdc:C00877 

 

NCEP/DOE Reanalysis II: 1979-near present

NCEP produced a second version of their first reanalysis starting from the beginning of the major satellite era. More observations were added, assimilation errors were corrected and a better version of the model was used.

Data Access: NCEP NOMADS | NCAR | ESRL | KNMI | IRI

References | ClimateDataGuide

 

NCEP/NCAR Reanalysis I: 1948-present

This reanalysis was the first of its kind for NOAA. NCEP used the same climate model that were initialized with a wide variety of weather observations: ships, planes, RAOBS, station data, satellite observations and many more. By using the same model, scientists can examine climate/weather statistics and dynamic processes without the complication that model changes can cause. The dataset is kept current using near real-time observations.

Data access: NCEP NOMADS| NCAR | NOAA PSL | IRI | KNMI 

References | FAQ | FGDC | ClimateDataGuide

 

NCEP North American Regional Reanalysis (NARR): 1979-near present

The NARR reanalysis was done to produce very high resolution output over the North American region. Observational inputs were similar to NCEP I with the addition of assimilated precipitation. The NARR model region was nested in a global, lower resolution model. Outputs are similar to the NCEP I and II models but with more snow, ice and precipitation related variables.

Data Access: NCDC and NCEP NOMADS | NCAR | NOAA PSL

References | FAQ | ClimateDataGuide

 

NOAA-CIRES 20th Century Reanalysis version 2 (20CRv2): 1871-2012

The 20th Century Reanalysis version 2 (20CRv2) dataset contains global weather conditions and their uncertainty in six hour intervals from the year 1871 to 2012. Surface and sea level pressure observations are combined with a short-term forecast from an ensemble of 56 integrations of an NCEP numerical weather prediction model using the Ensemble Kalman Filter technique to produce an estimate of the complete state of the atmosphere, and the uncertainty in that estimate. The uncertainty is approximately inversely proportional to the density of observations. Additional observations and a newer version of the NCEP model that includes time-varying CO2 concentrations, solar variability, and volcanic aerosols are used in version 2. The long time range of this dataset allows scientists to examine better long time scale climate processes such as the Pacific Decadal Oscillation and the Atlantic Multidecadal Oscillation as well as looking at the dynamics of historical climate and weather events. Verification tests have shown that using only pressure creates reasonable atmospheric fields up to the tropopause. Additional tests suggest some correspondence with observed variations in the lower stratosphere.

Data Access: NOAA PSL | KNMI | IRI | NCAR | NERSC | BADC | ESGF

Homepage | References | Related Publications | ClimateDataGuide

 

NOAA-CIRES 20th Century Reanalysis version 2c (20CRv2c): 1851-2012 [2013-2014]

The 20th Century Reanalysis version 2 (20CRv2c) dataset contains global weather conditions and their uncertainty in six hour intervals from the year 1851 to 2012. Surface and sea level pressure observations are combined with a short-term forecast from an ensemble of 56 integrations of an NCEP numerical weather prediction model using the Ensemble Kalman Filter technique to produce an estimate of the complete state of the atmosphere, and the uncertainty in that estimate. The uncertainty is approximately inversely proportional to the density of observations. Additional observations from ISPDv3.2.9 and new boundary conditions from the Simple Ocean Data Assimilation with sparse observational input (SODAsi.2) pentad sea surface temperature and COBE-SST2 monthly sea ice concentration are used.  For the 2013 and 2014 extension, SSTs are from the NOAA daily 1/4 degree Optimal Interpolation version 2. 2014 does not include tropical cyclone pressure observations after April. 

Data Access: NOAA PSL |  NCAR | ESGF | NERSC (every member)

Homepage | References | Related Publications ClimateDataGuide

Notes/questions/discussion

 

 

NOAA-CIRES-DOE 20th Century Reanalysis version 3 (20CRv3): 1806-2015 

The 20th Century Reanalysis version 3 (20CRv3) is now available. It provides 8-times daily estimates of global tropospheric variability across ~75 km grids, spanning 1836 to 2015 and experimentally back to 1806 at NERSC.

Data Access: NOAA PSL |  NCAR | NERSC (every member back to 1806)

Homepage | References | Related Publications 

Notes/questions/discussion

 

NOAA Last Millennium Reanalysis version 2 (LMRv2): 1-2000CE

The Last Millennium Reanalysis (LMR) uses an ensemble methodology to assimilate paleoclimate data for the production of annually resolved, globally gridded, climate field reconstructions of the Common Era. File and variable naming conventions follow as closely as possible those for the NOAA 20th Century Reanalysis. Available fields include 2m air temperature, sea surface temperature, mean-sea-level pressure, 500 hPa geopotential height, precipitation, precipitable water, Palmer Drought Severity Index (PDSI), and a range of climate indices.

Data Access: NCEI | University of Washington

NCEI Home Page | References |

 

NZRA (NZ)

https://www.jstor.org/stable/27226715

 

MEteorological Reanalysis Italian DAtaset (MERIDA)

The new MEteorological Reanalysis Italian DAtaset (MERIDA) has been developed to deal with the increasingly frequent extreme weather conditions of the last 20 years, which have caused several disruptions to the Italian electricity system. This work has been developed following the indications emerged from the 'Working table for resilience' established by the Regulatory Authority for Energy Networks and the Environment (ARERA). MERIDA is able to respond to energy stakeholders, who need reliable meteorological data to implement effective adaptation strategies for safely operating the electricity system.

 

OCADA from the JMA 1836-2015

A historical atmospheric reanalysis from 1836 to 2015, assimilating only surface pressure observations with an atmospheric general circulation model. The reanalysis is called OCADA (Over-Centennial Atmospheric Data Assimilation), and it provides the evolution of the three-dimensional atmosphere and the quantitative information of the uncertainties.

Data Access: https://climate.mri-jma.go.jp/pub/archives/Ishii-et-al_OCADA/

No Homepage | References

Notes/questions/discussion

 

CORe from the NOAA/CPC 1950-near present

CORe was designed for climate monitoring. It assimilates most observations but does not include satellite observations with the exception of those used in the SST dataset used as a boundary forcing and for atmospheric motion vectors. This avoids spurious jumps when the satellite period began around 1979.

Data Access: NOAA/CPC has an avaluation dataset available.

Homepage | References 

Notes/questions/discussion


Have a question or comment on a specific reanalysis dataset or in general?

Use this link to Post Notes, Questions, and Comments on specific reanalyses


 

 

David (not verified)

Tue, 03/27/2018 - 15:38

Hi, I need to know what variables (T, UV winds, surface pressure, etc.) ERA-Interim, NCEP-CFSR, MERRA2 and JRA55 assimilate from land met stations and moored buoy arrays such as TAO, TRITON and RAMA.

Also, do ERA-Interim, NCEP-CFSR, MERRA2 and JRA55 assimilate any variables measured by moored buoys offshore the Spanish Atlantic coast, operated by the Spanish Agency Puertos del Estado?

Any help would be much appreciated, thanks!

Dear David,

Nice job also putting this wide-ranging question under each reanalysis question page. I would expect responses to go there. 

I would have expected the answer to your question to already be in the provided references. Did you not find this information in the references that are linked for each dataset? I believe that each reference paper describes the assimilated platforms and variables in some detail. I suggest that you update your specific comments with the page of each paper where you would have expected the information to be but are not finding it.  Also, you may not be aware that the International Comprehensive Ocean Atmosphere Data Set (ICOADS, www.icoads.gov) ingests all of the marine observations and is used in all reanalyses. But, your specific question about which observed variables are assimilated is still a good one if you aren't finding this information in the references.

best wishes,

gil

 

 

 

Hi Gil, thanks for your quick reply.

Actually I went through all the mentioned reanalyses reference papers, and many more including the tech docs, and I cannot really find a conclusive answer to my (apparently not so) simple question. I've been digging through the literature for some months now...

From what I have found, I believe that ERA-Interim and JRA55 only assimilate surface pressure from land stations and moored buoys. MERRA2 doesnt assimilate UV from land stations (only sfc press), but seems to assimilate UV from some TAO buoys (not PIRATA though), but I'm not 100% sure if MERRA2 assimilates winds from moored buoys as a rule. Have no idea what CFSR does, although I'm inclined to think MERRA2 follows similar rules for conventional obs as CFSR.

Will hope for some insight in this forum!

 

 

 

David,

Sorry, it looks like no other replies have been posted, yet. In general, if the data are transmitted to the global telecommunications system (GTS), they are assimilated.  Hopefully, you will receive some other replies soon.

best wishes,

gil

 

Paul Berrisford (not verified)

Sat, 10/07/2017 - 04:12

Dear Yiyi,

In ERA-20C data the monthly means of daily means are averages over the available hours in a day, then over all days in the month, to represent the whole or complete monthly mean. Synoptic monthly means are averages over days in the month for a particular synoptic time eg 12 UTC, or in the case of accumulations, for only a particular accumulation period within the day eg 06 to 12 UTC.

For most applications you would use the monthly means of daily means. You would only use the synoptic monthly means if you wanted to restrict your attention to a particular point in, or portion of, the diurnal cycle.

Regards,

Paul Berrisford

gerald.potter

Fri, 10/06/2017 - 12:46

To be consistent with comparisons with 20CRv2c which or the ERA20C products should we use in our ESGF archive?  synoptic monthly means: In the case of analyses, these are averages throughout the calendar month for each available synoptic hour, whereas in the case of forecasts (all issued daily from 06 UTC), they are averages throughout the calendar month for each available forecast step up to 24 hours. or monthly means of daily means: In the case of analyses, these are averages throughout the calendar month across all the available synoptic hours,  whereas in the case of forecasts (all issued daily from 06 UTC), they are averages throughout the calendar month across all the available forecast steps up to 24 hours, for instantaneous forecasts, or just for step=24 hours, for accumulated forecasts.

Yiyi (not verified)

Tue, 02/21/2017 - 18:20

Hello everyone,

Currently I am using the cloud fraction and radiation flux monthly data from MERRA-2, 20CRv2c, ERA-Interim, JRA-55 and CFSR. As far as I know, these variables are calculated in the forecast portion of forecast-analysis update cycles. So I was wondering over which period the radiation fluxes and cloud variables are calculated (e.g., the first 12 hours of each forecast) in each reanalysis. I would be really appreciated if you can provide information for any one of them.

Best,

Yiyi

Wesley Ebisuzaki (not verified)

Wed, 12/14/2016 - 09:00

Alberto,

For your storm surge model you probably want surface winds (primary), surface pressure (secondary) and geopotential and temperature (tertiary).

The GFS analyses use satellite scatterometers to estimate the surface wind speed over water.  Both NCEP/NCAR and NCEP/DOE do not use these instruments.  However, CFSR, ERA-Interim, MERRA and JRA-55 do use scatterometers.

The first generation reanalyses had the resolution to resolve synoptic-scale+ features.  For many phenomenon, such as ENSO, this is adequate.  For storm surges, you want something that that can resolve much finer scale features.  The modern reanalyses (CFSR, ERA-Interim, MERRA, JRA-55) are run at a much higher resolution and are more suited.  However, they are run at a much lower resolution than the current GFS (GFS:T1534 vs CFSR:T384/T574)

The near-surface winds are strongly influenced by the physics in the model. The CFSR will more similar to the GFS, so the CFSR is looking more favorable. The CFSR products have not restriction for commercial use which is another advantage.  One disadvantage of the CFSR is difficulty in obtaining it from the official NOAA archive (NCEI) especially data from 2010 and onwards.  (I don't follow the situation at NCEI and the data may be available.)

My suggestion is to use the CFSR if you can get the data.  If you are affected by the commercial restriction, then the MERRA-2 reanalysis is available without a restriction for commercial use.  If the commercial restriction doesn't apply, I don't know which of the modern reanalyses gives the best surface winds.

 

 

Alberto Canestrelli (not verified)

Thu, 11/24/2016 - 08:16

Dear all, we are group working on storm surge forecasting. We are interested in using GFM as input for our statistical and deterministic models for storm surges. We have a couple of questions on this regard:

1) Our statistical models need a large historical dataset for calibration (mainly surface wind speed, surface pressure, geopotential and temperature), therefore we were planning to use reanalysis for calibration. In the website (http://www.esrl.noaa.gov/psd/data/gridded/reanalysis/ ) it looks like the best reanalysis are NCEP/DOE Reanalysis II  (2.5 deg resolution) and 20th Century Reanalysis (V2 and V2c) (2 deg resolution). Which one do you think is the one closer to the GFS operational model, which has a 0.25 degrees resolution, and which we will use operationally?

2) Our Deterministic (shallow water) models need a smaller dataset for calibration (only surface pressure and surface wind ). 5 or 10 years would be enough. Are the past GFS analysis at 0.25 degrees of resolution available for the past 5-10 years? Again we will use GSF operationally, therefore we need to calibrate using the same model. 

Thanks a lot. Regards

Alberto

Ashwin (not verified)

Wed, 09/21/2016 - 20:27

Is the same sigma coordinate used in the reanalysis data from UCAR FNL ? 0.25 x 0.25 degree resolution ? Are the 28 levels the same ?

Dear Ashwin,

I will need more information to be able to provide any assistance on this. What is the UCAR FNL? Do you have a web address?

What is the reference reanalysis you are asking about? Is it JRA55, ERA-Interim, CFSR?  You mention 28 levels. That could be 20CR or NCEP-NCAR reanalysis, but 0.25 resolution is more like a modern full-input reanalysis.

I will look forward to hearing from you.

Best wishes,

gil

sujan ghimire (not verified)

Fri, 09/09/2016 - 04:57

I am doing solar modelling and have downloaded the data but it is at 0.00 which is UTC and our region is UTC +10. so it means that the data is for 10AM here which is not useful and next hour is 6 which is 16hrs so it means 4 PM over here. So with the 10AM data and 4 PM data how can i do the modelling?

How can i download the daily data on hourly basis? Any idea highly appreciated.

Paul Berrisford (not verified)

Wed, 10/12/2016 - 12:04

In reply to by sujan ghimire (not verified)

Hello,

There is no hourly data in ERA-Interim. The analyses are 6 hourly and the twice daily forecasts (from 00 and 12 UTC) provide 3 hourly output to T+24 hours on pressure levels and at the surface, with output becoming less frequent to T+240, and to T+12 hours on model levels. Only a sub-set of this data is available on the point and click web interface (http://apps.ecmwf.int/datasets/data/interim-full-daily/levtype=sfc/), but all can be obtained by using script access to the data, see https://software.ecmwf.int/wiki/display/WEBAPI/Access+ECMWF+Public+Datasets.

Regards, Paul Berrisford

Julio Cardona (not verified)

Fri, 06/10/2016 - 10:33

Hello I am new to this reanalysis data, I would like to know where can I download data from precipitation and monthly average temperature from 1950 for the region of north central Mexico with good resolution and what software or application you recommend to view and extract data downloaded from the server because the files have .nc commonly extension. I am an engineering student at the Autonomous University of Zacatecas in Mexico and I'm doing my teisis in the analysis of drought, for which I need the data. Beforehand thank you very much

Many applications can read netCDF files. See unidata http://www.unidata.ucar.edu/software/netcdf/software.html and http://www.esrl.noaa.gov/psd/data/gridded/tools.html As far as which dataset, all reanalyses have precipitation and temperature (though precip is usually model output and not assimilated). See this table for resolution and time coverage. https://reanalyses.org/atmosphere/comparison-table There are also observed temperature and precipitation files. See http://www.esrl.noaa.gov/psd/data/gridded/tables/precipitation.html and http://www.esrl.noaa.gov/psd/data/gridded/tables/temperature.html NCAR archives many datasets, in addition. http://rda.ucar.edu Cathy

Wenjun Cui (not verified)

Fri, 06/03/2016 - 14:10

Hello all, I have a question about CFSR precipitation data. According to Saha et al. (2010), for land-surface analysis, the model-generated precipitation is replaced by the a mix of observation-based (CMAP and CPCU) and model-generated precipitation as forcing data. So I am wondering, are the CFSR precipitation data I downloaded generated by model or generated by merging observations and model out? Thanks, Wenjun

Dear Wenjun, A little more information is needed to make a helpful reply. What "CFSR precipitation data" are you using? What is the source of this data? Where did this person download it and what is the exact name of the file you are looking at and the link to where you obtained it? There are several distributors of CFSR data. Thanks for clarifying,

Hello Dr. Compo, I downloaded CFSR monthly precipitation data from the UCAR/NCAR Research Data Archive, the link is "http://rda.ucar.edu/datasets/ds093.2/#!description". The variable I downloaded is total precipitation, and the file name is "pgbh.gdas.yyyymm.grb2.nc". Thank you for your time, Wenjun

Courtesy of Jesse Meng and Suru Saha of NCEP When you download the CFSR data, you are getting the model generated precipitation. The mixed precipitation approach is used in land analysis only, not in the product. Hope this answers the questions.

Rocio (not verified)

Mon, 05/30/2016 - 10:29

Hi all. I'm pretty new to all this stuff. Can anyone please give me a simplified, step by step explanation of how to get and use data from any of these reanalysis websites? I'm a student at a University in Cuba. I stumbled on this and I'd like to use data from this for my final dissertation.I need temperature, preassure and relative humidity data from at lees 1985 untill nowadays, with the best resolution I can get, I'll be using python to analize and plot the data. I'd really appreciate any help I can get. Thank you.

Dear Rocio, You can click on the Data Access links above, or it may be more convenient to use some plotting web tools first. See the page http://reanalyses.org/atmosphere/how-obtainplotanalyze-data . You didn't mention at what time resolution you need the data: subdaily, daily, or monthly? The table at http://reanalyses.org/atmosphere/comparison-table may help you select some datasets to examine. As to "best", it entirely depends on your application. I am afraid you will need to experiment some and see what works for you. Best wishes,

Anonymous (not verified)

Fri, 05/20/2016 - 05:39

Good day, I want to obtain the moisture bugdet term P-E from the evapotranpiration and Total precipitation data sets, and the evaporation values are negative. any explanation. Also I may want to know the unit of evapotranspiration. thanks

Dear Keerthi, For ERA-Interim "daily" data, the units of evaporation and precipitation are "m", and these quantities are accumulated from the beginning of the forecast for step hours. To convert to mm/day (for the period of step hours) you need to multiply by 1000*24/step. However, if you want a value of evaporation over one day, you could add the values for time=00, step=12 and time=12, step=12 and then multiply by 1000. Note that vertical fluxes are defined to be positive downwards, so precipitation is positive and evaporation is usually negative (though condensation would be positive). Regards, Paul

Hi all,

I've run across what is either a 2-day discrepancy or a misunderstanding on my part of the time coordinate in MERRA2 data accessed through OpenDAP. The description of the 'time' variable is 'days since 1-1-1 00:00:00'. However, the first element of the MERRA2 time vector, corresponding to 1980-1-1 00:00:00, is 722816 (days), whereas when I compute the difference between 1980-1-1 and 1-1-1 using Python's 'datetime', I get 722814 days. I've checked 'datetime' against test data in Appendix C of Dershowitz and Reinhold's book 'Calendrical Calculations', and it appears to be correct. Any ideas? I've appended a short iPython session demonstrating the issue below.

Thanks,

Scott Paine
Smithsonian Astrophysical Observatory

=================================
In [1]: import pydap.client

In [2]: import datetime

In [3]: dataset = pydap.client.open_url('http://goldsmr4.sci.gsfc.nasa.gov:80/dods/M2I1NXASM')

In [4]: var = dataset['time']

In [5]: var.attributes
Out[5]:
{'grads_dim': 't',
'grads_mapping': 'linear',
'grads_min': '00z01jan1980',
'grads_size': '324362',
'grads_step': '60mn',
'long_name': 'time',
'maximum': '01z01jan2017',
'minimum': '00z01jan1980',
'resolution': 0.0416666679084301,
'units': 'days since 1-1-1 00:00:0.0'}

In [6]: var[0]
Out[6]: array([ 722816.])

In [7]: d1 = datetime.date(1980, 1, 1)

In [8]: d0 = datetime.date(1, 1, 1)

In [9]: delta = d1 - d0

In [10]: delta.days
Out[10]: 722814

We've seen this 2 day error that some calendar calculations make and which I think the python and the calendar script are making.I think it is counting 2 years as leap years that are not. udunits (which we use) has the correct calculation and I believe MERRA2 does as well. Because the base date (1-1-1) is so far back, many calendar programs don't handle it correctly and we have shifted in our group to try to use a base date after the Gregorian calendar started so all calendar programs handle it correctly. I think this rule is the sticking point "The Revised Julian calendar adds an extra day to February in years that are multiples of four, except for years that are multiples of 100 that do not leave a remainder of 200 or 600 when divided by 900." .

Yiyi (not verified)

Wed, 04/13/2016 - 15:39

Hello there, Since I need to convert sea ice concentration to sea ice extent in MERRA-2 (0.625 x 0.5) and JRA-55 (1.25 x 1.25). I was wondering if these two products can provide gridded surface area information. Any help would be appreciated. Thanks, Yiyi

Daniel (not verified)

Tue, 03/15/2016 - 18:19

Hello, I have been working with the ensemble mean of the 20CR. However, I know that the 20CR ensemble mean is based on 56 members. I would like to work with some of this realizations. First of all, where do I more information about them? It seems that most information deals with the ensemble mean. How do I download them? Is is possible to know before downloading which members represent more extreme climates? Many thanks for you help!

Daniel, See the link on this page https://reanalyses.org/atmosphere/overview-current-reanalyses#TWENTv2c with "NERSC (every member)". This will take you to portal.nersc.gov, which has a "Browse" button. Use 20CR version 2c. Please feel free to respond to this thread with questions.

Anonymous (not verified)

Tue, 03/15/2016 - 10:10

Hi everyone, I am trying to use ERA Interim and CFSR for hydrological modelling in a mesoscale catchment in Africa. I have obtained CFSR data for SWAT modelling from globalweather.tamu.edu and ERA Interim data from http://apps.ecmwf.int/datasets/. However i have a problem using ERA Interim data as I can locate elevation data which is needed by SWAT model. Can some one direct me to where i can download elevation data? Thanks in advance for you help. Nkiaka

Dear Nkiaka, I presume you require the elevation of the surface of the Earth. The invariant (ie unchanging) fields are available from http://apps.ecmwf.int/datasets/data/interim-full-invariant/ and includes the (surface) geopotential. Divide by g (9.80665) to obtain surface geopotential height. Regards, Paul Berrisford

Senya Grodsky (not verified)

Mon, 03/14/2016 - 14:49

Is snowfall included in ERA-Interim total precipitation? Yes. precipitation is the liquid equivalent of all precipitation including rain/snow etc.

Yiyi (not verified)

Mon, 03/07/2016 - 13:42

Hello, Currently I am processing the cloud water content (for entire atmosphere) data in 20CRv2c. And I am wondering if this variable include liquid water, ice water and water vapor? Thanks. Yiyi

Dear Yiyi, Happy to help. A couple of questions. From where did you obtain the data? What format is it in? If it is in netcdf, please send the output of "ncdump -h" on the file. If it is in GRIB, please send the output of "wgrib -V" and only the first message is needed. I am fairly certain that the variable is "cloud liquid water" not "cloud water content", but I would need to see your output to be sure of what you are accessing. Best wishes,

Thanks for your help! I downloaded data from ESRL-PSD 20CRv2c webpage. The data link is ftp://ftp.cdc.noaa.gov/Datasets/20thC_ReanV2c/Monthlies/monolevel/cldwtr.eatm.mon.mean.nc. The data is in netcdf format, and the output of "ncdump -h" is following: float cldwtr(time, lat, lon) ; cldwtr:cell_methods = "time: mean (monthly from 6-hourly values)" ; cldwtr:long_name = "Monthly Cloud Water for entire atmosphere" ; cldwtr:units = "kg/m^2" ; cldwtr:precision = 4s ; cldwtr:GRIB_id = 76s ; cldwtr:GRIB_name = "C WAT" ; cldwtr:var_desc = "Cloud Water Content" ; cldwtr:dataset = "NOAA-CIRES 20th Century Reanalysis version 2c Monthly Averages" ; cldwtr:level_desc = "Entire Atmosphere Considered As a Single Layer" ; cldwtr:statistic = "Ensemble Mean" ; cldwtr:parent_stat = "Individual Obs" ; cldwtr:standard_name = "atmosphere_cloud_condensed_water_content" ; cldwtr:missing_value = -9.96921e+36f ; cldwtr:valid_range = 0.f, 6.5532f ; cldwtr:statistic_method = "Ensemble mean is calculated by averaging over all 56 ensemble members at each time step and then averaging mean over all time steps in a month" ; cldwtr:GridType = "Cylindrical Equidistant Projection Grid" ; cldwtr:datum = "wgs84" ; cldwtr:actual_range = 0.f, 0.3662097f ; Thanks, Yiyi

For land surface modeling, it is useful to know temporal frequency of reanalysis output (hourly, 3-hourly, etc...). Some have this mentioned, others make it hard to figure out. Is there a simple list somewhere? In particular, for some of my applications, temporal frequency of surface meteorology trumps spatial resolution. Not sure if any hourly output exists. Thanks. -ankur, UW-Madison, desai@aos.wisc.edu

Ankur, For offline land modeling, the MERRA-2 data includes our lowest model level data. This is on the terrain following coordinate, so the height AGL is variable, roughly 60m (but also provided). The advantages of lowest model level to land modeling are 1) this level includes a portion of the analysis increment, so the observations that help constrain the prognostic state fields and 2) it does not include the surface layer similarity parameterization interpolation that we use to determine fluxes for our land model. This should allow your land model and surface layer to develop independently of what the reanalyses systems do. In this way you can also compare back to the 2m meteorology and even diffusion coefficients that MERRA-2 provides.

MERRA-2 and CFSR provide 1 hourly frequency data, and CFSR does have higher spatial resolutions.

Ankur, Courtesy of Suru Saha of NCEP: "CFSR has hourly output for all land surface variables at full model resolution." I see from the links http://reanalyses.org/atmosphere/overview-current-reanalyses#CFSR one to NOMADS NCDC http://nomads.ncdc.noaa.gov/data.php?name=access#cfsr . Also, the link to NCAR should be useful http://rda.ucar.edu/#!lfd?nb=y&b=proj&v=NCEP%20Climate%20Forecast%20System%20Reanalysis . best wishes, gil

New student (not verified)

Sun, 11/08/2015 - 12:30

Hello,I am a student currently working on MERRA data, I need some links or detailed information for the parameters of Radiation ; SWGDN(Surface incident shortwave flux) & SWGNT(Surface net downward shortwave flux). What are the differences in both? How both can have effect on a body lying on Earth surface(probably near equator)? Your help will mean alot to me. Thanks in advance

In MERRA, there are two fundamental components of the radiation in shortwave. Downward, the solar radiation that reaches the surface through clouds and other atmospheric attenuation. Upward, the reflected radiation which depends on the downward radiation, and the albedo. The net shortwave is the downward minus the upward. It is described as net downward to provide the direction (or sign) of the data. For more information on MERRA data, you can refer to the File Specification document, and the budget appendix.
http://gmao.gsfc.nasa.gov/research/merra/file_specifications.php

fry.meridith

Wed, 10/28/2015 - 15:39

Hi all,

I am currently looking for gridded datasets of evapotranspiration (daily, ideally, at national/global scale). I have derived daily potential evapotranspiration estimates for the U.S. using the Hargreaves-Samani equation and the NCEP/NCAR Reanalysis dataset. However, I would like to compare these estimates to other datasets/derivations if possible. I know that Penman-Monteith is another standard method for calculating, but I have not attempted to calculate using P-M yet because of the greater number of inputs needed.

I am interested in learning more about the potential evaporation rate (W/m2) in the NCEP/NCAR Reanalysis dataset (Kalnay et al., 1996) - Does anyone have familiarity with this particular variable and/or know how it was derived? I know that actual evapotranspiration, potential evaporation, and potential evapotranspiration are often distinguised in the literature, so I also wanted to confirm what the potential evaporation rate in this dataset represents.

I also recently asked ESRL PSD about the potential evaporation and transpiration variables in the NOAA-CIRES 20CR dataset, and Gil Compo was very helpful in providing those references (Mahrt and Ek, 1984 - eq 9; Chen et al., 1996 - eqn 11).

If there are other national (or global) gridded datasets of daily evapotranspiration that you know of (eventually I will need to have PET in mm/day), please let me know.

Thank you in advance!
Best regards,
Meridith Fry (EPA/OPP)

There is a description of how CAPE is calculated (in the post processing) in ERA-Interim, in Part IV Physical processes, Chapter 5 Convection, Section 5.11, of the ERA-Interim model (IFS) documentation: https://software.ecmwf.int/wiki/display/IFS/CY31R1+Official+IFS+Documentation Also note that in ERA-Interim the CAPE at forecast step=0 is erroneously set to zero everywhere.

Fabio (not verified)

Fri, 10/09/2015 - 08:33

Hello, Which dataset do you think has the most accurate data for tropical central africa and has a time-step of at least 6-hours? Thanks

Anonymous (not verified)

Sat, 08/29/2015 - 09:34

I am looking at long term drought in the Southern Africa region and I would like to utilise ERA-INTERIM Reanalysis data. I am just not sure of the difference between Large-scale and total precipitation and which one is better to use for such analysis. I would also like to find out if there are other rainfall parameters that are available that I could use. Miya

In ERA-Interim, the total precipitation is the sum of the large-scale precipitation and convective precipitation. There is also snowfall, large-scale snowfall and convective snowfall available. All these fields are accumulated from the beginning of the forecast and the units are "m of water" or "m of water equivalent".

Yiyi (not verified)

Tue, 08/11/2015 - 16:29

Hello there, I found that in some reanalyses products, they would provide FORECAST and ANALYSIS products. Thus I am wondering that if forecast data is only model output and analysis data is produced by model and assimilation method. Can anyone help to explain the differences between them? Also, why some variables are only available in FORECAST but not in ANALYSIS? Thanks. Yiyi

Mr Al (not verified)

Wed, 07/15/2015 - 10:58

Hi, I too have just started to review some reanalysis surface pressure data and was hoping if someone could clarify a particular point. The data I'm looking at is from: http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.ESRL/.PSD/.rean20thcent/.V2/.six-hourly/.monolevel/.sfc/.pres/ and is 6hrly surface pressures at 2deg grid increments. My question is whether this is likely to be the spatial mean surface pressure across a grid square (and if so, would the coordinates represent the grid square centre) or whether the dataset should be considered as point data applicable to precise coordinates? thanks, Alan

Nigerian Student (not verified)

Mon, 07/13/2015 - 12:45

Hi guys. I'm pretty new to all this stuff. Can anyone please give me a simplified, step by step explanation of how to get and use data from any of these reanalysis websites? I'm a student at a University in Nigeria. I stumbled on this and I'd like to use data from this for my final dissertation. I'd really appreciate any help I can get. Thank you.

Dear Student, Please provide more information about what you are trying to accomplish. What variables? What time period? What time resolution? There is no single way to get data, and there are many possibilities. What software will be using to analyze and plot the data? Will any of the tools for subdaily, daily-average, or monthly average data available off of go.usa.gov/XTd work for you? If monthly mean data are what you are interested in, you may want to consider using the web-based reanalysis intercomparison tool or one of the other tools listed at http://reanalyses.org/atmosphere/tools. best wishes,

SSA (not verified)

Thu, 05/07/2015 - 21:29

Hello all, can anyone tell me the difference between the sea ice cover and sea ice extent. can i using the sea ice cover data in era iterim to explain how much the sea ice extent from one month to other month???

Alba Cid (not verified)

Tue, 04/28/2015 - 02:21

Hello! I'm using sea level pressure fields from ERA-interim reanalysis and from the 20th century reanalysis. There are some regions where SLP from 20CR is much lower than SLP from ERA-interim. For instance, around lon = 134ºW, lat = 14ºN, there are several drops in the SLP from 20CR not present in ERA-interim, with differences of about 20 mb. Does anybody know if there is a physical explanation for that or if they are outliers? Thank you very much in advance Alba

Dear Gilbert, thank you very much for your answer. Following your suggestion, I made a page at reanalyses.org where a time series comparison can be seen and where I specified the details about the data. The page is https://reanalyses.org/atmosphere/slp-drops-20cr-not-present-era-interim-reanalysis Thanks again! Alba

Alexander Cher… (not verified)

Tue, 02/24/2015 - 07:01

Does anyone know something about precipitation data in the ERA-20C reanalyses. Here is no such variable: http://apps.ecmwf.int/datasets/data/era20c_daily/ but there are new variables like: Total column rain water or Total column snow water (additionally to the standard Total column liquid/ice water). Is the following assumption correct: precipitation rate = Total column rain water + Total column snow water ? Is there any literature on this issue?

In ERA-20C there are various precipitation fields at the surface. There are no mean rate precipitation fields - the precipitation fields are accumulated from the beginning of the forecast for +step hours. To obtain the mean rate quantity you need need to divide by the number of seconds in step. The parameter names are: convective precipitation, convective snowfall, large-scale precipitation, large-scale snowfall, snowfall and total precipitation. Total column fields are vertically integrated quantities, not fluxes.

Patrick Boylan (not verified)

Wed, 02/11/2015 - 16:02

Does anyone know why the surface pressures from the surface level files (Sp) do not equal the surface pressure from the model level files (ln(Sp)). I have looked at several months in 2010 at all 4 times and step equal to 0.

The surface pressure (sp) archived at the surface is calculated from the model level data. However, the latter is archived by storing the spectral coefficients of ln(sp) (natural log of sp) whereas at the surface sp is archived as sp in grid point space. Differences between these two fields will arise because of the different packing errors associated with their GRIB packing and due to any differences in the methodologies used for transforming from the spectral representation to the grid point representation.

Cathy.Smith@noaa.gov

Thu, 02/05/2015 - 14:46

Does anyone know why the only surface humidity field from the ERA-Interim dataset is 2m dew point and not the more commonly used fields of specific humidity and/or relative humidity (which are also available as pressure level fields)?

The reason ERA-Interim only has 2m dew point temperature and not specific or relative humidity is historical. There is a FAQ about this, which describes how to calculate the 2m specific and relative humidity: http://www.ecmwf.int/en/does-era-40-dataset-contain-near-surface-humidity-data

What do you mean by "modern" humidity, Cathy? The synoptic surface atmospheric observations assimilated by ERA-Interm are reported as dewpoints and the synoptic message that contains the dew points also reports temperature and surface pressure, whose values are needed to compute other humidity variables. This was past practice, and is current practice. What is actually measured today depends on the instrument that is deployed, but the conversion to dewpoints for uniform reporting purposes should follow procedures laid down in WMO regulations. Dew point is no less modern than any other humidity variable. If reanalysis output is to be made available for only one humidity variable, it seems reasonable to me that one should use the same variable that is used in observational reports. Providing output for alternative humidity variables, using documented conversion formulae is certainly an option, though small numerical inconsistencies between the variables would arise from data encoding and interpolation.

Having specific humidity available in addition to Td (which is also important, as you say) is a valuable thing and makes certain calculations much easier as you are not combining T and q in one variable. To get the actual moisture in the air with Td, you have to also calculate the saturation q for the measured temperature so you have to read both Tsfc and Td and do the additional calculation. And, as many of the other reanalyses do not output dewpoint, it makes comparisons with them much easier if you have the same variable. In addition, the calculation of saturation q is a nonlinear function of T, so if you want to compare monthly means of other reanalyses, you have to calculate q (sfc) for each time step in a monthly average and then average (or compute Td from each time step of q and T in the other reanalyses). The non-linearity is also an issue for reanalyses which output ensemble means. Theoretically, Td ought to be calculated separately for each member and then averaged.

Agreed it is a bit of a nuisance to have to go through these steps. We went through them to compute monthly-mean specific and relative humidities in our 2010 ERA-Interim paper (doi: 10.1029/2009JD012442) and go through them regularly in preparing our annual contributions to the BAMS state-of-the climate article. But there are several possible variables - the HadISDH datset based on direct analysis of the synoptic data caters for seven different ones.

Sneha (not verified)

Tue, 12/30/2014 - 04:06

Hello, As per the documentation on MERRA, vertical resolution is 72 levels. However the v-wind given by the dataset has only 42 available levels eventhough the latitude and longitude resolutions remain the same. May I know what is the reason behind this?

The modeling and assimilation in the GEOS5 system that performs the MERRA reanalysis runs at 72 terrain following (eta) coordinates. These are not typically what most meteorological studies would favor, so the models eta coordinate is interpolated to 42 pressure levels. For certain variables it is beneficial to provide data in both coordinates. Please see the MERRA File Specification Document for details: http://gmao.gsfc.nasa.gov/research/merra/file_specifications.php

None of the "operational" analyses (JMA, ECMWF, NMC, NCEP, etc) are considered to be reanalyses, simply because in each of these the record contains discontinuities caused by periodic upgrades and changes in model, analysis methods, resolution, observation streams, and whatever else constituted the improvements from which all the operational systems have benefitted over time. In fact, a major rationale for doing reanalysis at all was the possibility to create long records of weather, using modern analysis/forecast systems, and without the operational discontinuities. Comparisons can certainly be made however, between operational systems and reanalyses, for what that might be worth.

Paul Poli (not verified)

Tue, 11/04/2014 - 01:53

Hello Mike, Glad to exchange with you via this forum. Generally reanalysis producers prefer to see only their latest and shinest product used, not just because it tends to give them 'better press', but rather for the immediate feedback they get from users regarding the new products, and so as to improve them next time around. And thus we collectively tend to instruct users 'please do not use earlier products for new research' (i.e. feel free to continue using it in ongoing projects, but do not start *new* work with these data-- please use instead the latest product). If we went along with this we would actually shorten the list above! That said, in the user survey conducted last year (responded by 2500+, the survey mostly reached ECMWF users though), there were 170 respondents who said they were using ERA-15. I doubt these have all been using ERA-15 for the same work over and over in the past nearly 20 years so this suggests there are probably new users of ERA-15, as there are new users of ERA-40. I'll add ERA-15 there, but we should also add FGGE if everybody found its most ancient data holdings. The whole series of reanalyses makes for a nice historical summary of atmospheric research improvements in the last 3 decades! But this shouldn't confuse users, so we should also probably mark with a special flag here those products that we think are, how to say it better, 'outdated'? Paul Poli

michael.fiorino

Mon, 11/03/2014 - 17:24

whither ERA-15 in this section?

I know ERA-15 is kind of 'OBE' (overtaken by events) relative to ERA-40 (I worked on both reanalyses)...However...

ERA-15 would be useful in assessing observing system variability and the benefits of observation data set 'cleansing'/improvement that were brought about from the initial comparisons of older obs to modern models in the pioneering reanalyses (NCEP/NCAR I NCEP/DOE II and ERA-15).

from an old reanalysis guy...

best /R Mike Fiorino

And the DAO reanalysis too! (Sorry, I think that was lost some time ago) ERA-15 is still available at the ECMWF data server (http://apps.ecmwf.int/datasets/data/era15/) and is also described at the Climate Data Guide (https://climatedataguide.ucar.edu/climate-data/era-15). As you say, it is probably best for marking the progression of reanalyses, but there are known issues that require new investigations to update to more recent data.

Alina (not verified)

Fri, 10/24/2014 - 11:36

Hello Everyone, I would need to know whether either or all of the following 3 reanalyses: - NCEP/NCAR - ERA-Interim - JRA25 assimilates data from the Tropical Moored Buoy System. I am particularly interested in data between 1979 and the present. Thank you in advance for any information on this subject!

Gary Barnes (not verified)

Tue, 09/16/2014 - 19:13

We are looking at Hurricane Felicia (2009) and have used the NCEP-NCAR reanalysis wind fields to look at the large scale environment. A colleague suggested that we look at CFSR. Does the CFSR reanalysis access different finer scale data? I understand it offers finer resolution but without finer resolution inputs we would necessarily see much difference? thanks, gary

Yes, CFSR uses finer scale observations than NCEP/NCAR Reanalysis. Automated aircraft reports: at cruising altitude 5-6 minutes between reports 737 cruises at 780 km/hr -> reports every 65-78 km see: http://amdar.noaa.gov/FAQ.html#bytes More reports during ascents/decents. So CFSR can get finer details from the aircraft data. Of course, commercial aircraft won't be flying near Hurricane Felicia. Satellite data: NCEP/NCAR Reanalysis uses temperature retrievals and cloud track winds. The temperature retrievals are reduced to a fixed horizontal and vertical resolution This kept the amount of satellite data more or less constant and prevented the satellite data from overwhelming the conventional data as the spatial and frequency resolution of the satellite data improved. The CFSR uses a direct assimilation of the satellite radiances as well at cloud track winds. Much satellite radiance data is thinned or "averaged" because it is of a higher resolution than the assimilation system. So CFSR can access the finer details from the satellite data. (BTW direct assimilation of the radiances is better than temperature retrievals.) However, the CFSR doesn't assimilate radiance data in cloudy "pixels" and hurricanes tend to be cloudy. So the CFSR has observations to support the finer resolution. However, too near the hurricane, the observation systems don't do a good job of sampling.

Thank you very much for your input. We pulled up the NCEP-NCAR reanalysis and compared it to CFSR. Looking at the 250 u and v components one can see that virtually all the larger scale features (> 5 deg latitude) are similar. The CFSR does generate many more fine scale features that I would be a little worried about, lots of closed contours covering length scales of 1-2 degrees. These tend to appear more frequently as one moves toward the equator. Of course subtle changes in the estimate will trigger a contour to appear or disappear. We see some nuances in the sub-tropical jet in CFSR but I think our interpretation of one vs . the other product would be close. Didn't see anything odd around the hurricane, at least at 250 hPa. Given the increased use of the aircraft data I imagine that the CFSR fields are better from Honolulu toward the west coast. regards, gary

Keith (not verified)

Wed, 09/10/2014 - 14:29

I'm curious whether sounding data from field campaigns (specifically the TEPPS cruise in 1997) would have been incorporated into the reanalyses. According to Serra and Houze (2000) pt I, the data was "transmitted via the Shipboard Envi- ronmental (data) Acquisition System (SEAS) to NOAA and were incorporated into the National En- vironmental Satellite, Data and Information Service model initialization." However, I have been unable to figure out if any (or all) of the reanalyses would have included this data.

Anonymous (not verified)

Mon, 08/25/2014 - 07:51

I've looked at the surface latent and sensible heat flux averaged for a polar cap (north of 70N). Both show odd seasonal cycles, with maximum values during winter, and minimum during summer. Is this mainly due to the sea ice misspecification in the 20CR dataset? The other fluxes (shortwave and longwave radiation at both surface and top of atmosphere) show more "normal" cycles (though somewhat higher values).

Dear Anonymous, As noted at https://reanalyses.org/atmosphere/inter-reanalysis-studies-0 perhaps what you are looking for is in the paper Lindsay, R., M. Wensnahan, A. Schweiger, J. Zhang, 2014: Evaluation of Seven Different Atmospheric Reanalysis Products in the Arctic*. J. Climate, 27, 2588–2606. doi: http://dx.doi.org/10.1175/JCLI-D-13-00014.1 Many additional seasonal intercomparison maps (many more than could be included in the publication) showing the median from the seven reanalyses and the deviations of each from the median are found at http://psc.apl.uw.edu/arctic_reanalyses. Both seasonal means and seasonal trends for the period 1981-2010 are shown. 34 different variables are included: surface fluxes, temperature, humidity, wind, precipitation, and pressure; layer heights and temperatures; and TOA radiative fluxes. best wishes, gil compo for Reanalyses.org

Anonymous (not verified)

Fri, 06/20/2014 - 06:56

I would like to know what is the vertical height levels for the reanalysis data like CFSR,MERRA, & ERA-I? Would there be different height levels possible? Also I want to know about Sigma levels ?

Dear User, The vertical levels for the post-processed data from the sources listed on http://reanalyses.org/atmosphere/overview-current-reanalyses under Data Access are described on each page. All of the datasets you list have multiple levels, some with more than 60 in the vertical. All of the datasets are available in self-describing formats that contain the level information. Sigma levels describe a vertical coordinate that is the level where the pressure is a specified fraction of the surface pressure. For example, sigma 0.995 is the level where the pressure is 0.995 times the surface pressure. If the surface pressure is 1000 hPa, then the pressure at the sigma level 0.995 is 995 hPa. Please reply back if you have additional questions.

andre (not verified)

Wed, 04/23/2014 - 11:16

Hello, What are the NCEP1 products that I should use to calculate Net Heat Flux at the air-sea interface? Qnet = SW- LW - LH - SH. where SW denotes net downward shortwave radiation, LW net upward longwave radiation, LH latent heat flux, and SH sensible heat flux I can find these products at http://www.esrl.noaa.gov/psd/data/gridded/data.ncep.reanalysis.surfaceflux.html Regarding the latent and sensible fluxes I don't have a problem (since there are only two in the NCEP list), but regarding the others I have several. For example: "Net longwave radiation", "Net shortwave radiation", "Upward longwave radiation flux" , "Downward solar radiation flux",... Hope you can help on this. Thanks!

Yes, that equation is correct and your abbreviations are correct. According to someone in our group who looked at your question "I think they should use the net shortwave and net longwave (if there are also upward and downward fluxes). Note that the shortwave from reanalysis has some real problems (it depends a lot on the cloud cover, which is not simulated well in the AGCM used in the reanalsyis). We did a paper on this a while back: Scott, J. D. and M. A. Alexander, 1999: Net shortwave fluxes over the ocean. J. Phys. Oceanogr., 29, 3167-3174. "

SA (not verified)

Tue, 04/01/2014 - 03:07

Hi everyone, I am analyzing hourly rainfall records in many regions of the world. However, I would like to know which reanalysis data is suitable to make some comparison. Thanks in advance for any suggestions :D

Dear SA, What you are asking turns out to be a research question. Several papers have looked into this. See a list at http://reanalyses.org/atmosphere/observational-studies and http://reanalyses.org/atmosphere/inter-reanalysis-studies-0#Precipitation Please report back with what you find. best wishes, gil compo

I can't say anything specific, since your comment has very little detail about where and when you are working. One thing that will be universal when considering reanalysis precipitation is that the quantity is derived from the background model forecast of the assimilation process. So, while the environment that produces precipitation is affected by the observational analysis, precipitation relies on the model physics, and has significant uncertainty. If observations of precipitation are available, you'll want to use those, at the least, in a comparison with the reanalysis data. Some reanalyses produce 1 hourly data, and some assimilate rainfall (see the North American Regional Reanalysis). Biases and uncertainty in reanalysis precipitation depends greatly on where and when you are looking. The papers listed in the pages Gil provided are a start, but be sure to follow those that they cite as well.

Mehdi (not verified)

Mon, 03/03/2014 - 06:09

Hi everyone, I'm trying to understand the vertical wind velocities in the ERA Interim data set in model levels ("eta" hybrid coordinates). According to the netCDF metadata, the provided vertical velocity is in Pa.s-1 which corresponds to a vertical velocity in pressure coordinates. Hence the following question : do we have d(p)/dt instead of d(eta)/dt in the data in model levels ? Thanks for any piece of advice.

Alima (not verified)

Thu, 02/27/2014 - 22:25

Hi everyone, I am looking for the land sea mask for 288*145, please let me know where I can have access it. Thanks in advance

Dear Alima, Is there a particular dataset whose land/sea mask you are trying to get? Depending on the dataset, the mask could be different. NCL could possibly be used to make a general conversion from the built-in mask http://www.ncl.ucar.edu/ but I have not test this. best wishes, gil

Remo Beerli (not verified)

Mon, 12/09/2013 - 02:35

Hi everyone, Is there a mask of the elevation of the topography of every grid point in 20CR? If yes, where can I access it? Thanks in advance for any help or suggestions!

Dear Remo, One source is to see the files listed at http://www.esrl.noaa.gov/psd/data/gridded/data.20thC_ReanV2.monolevel.html You want the file from the table for Time-Invariant Either Geopotential Height Surface 2x2 ftp://ftp.cdc.noaa.gov/Datasets/20thC_ReanV2/time_invariant/hgt.sfc.nc or Geopotential Height Surface (gaussian grid) ftp://ftp.cdc.noaa.gov/Datasets/20thC_ReanV2/gaussian/time_invariant/hgt.sfc.nc best wishes, gil compo

Hi Remo, The 20CR surface geometric height is contained in the file sflxgrbfg_orography.t62.grib, which can be downloaded at the following URL: http://rda.ucar.edu/datasets/ds131.1/index.html#sfol-wl-/data/ds131.1?g=309 You will need to sign in at the NCAR RDA website before downloading the file. Additionally, the ISPDv2, which was assimilated into the 20CR, contains the station elevation data and modified elevation for all stations in the ISPDv2. These data may be accessed from the NCAR RDA website at the following URL: http://rda.ucar.edu/datasets/ds132.0/ - Tom Cram

Anonymous (not verified)

Thu, 09/26/2013 - 06:02

Is NCEP reanalysis more accurate (lower bias and RMS) in summer (JJA) than in winter (DJF) in the stratosphere and troposphere of the northern hemisphere? If so, why? How about in the southern hemisphere? Thanks!

What variables are referring to? In general, your question is a research question that depends on your interests. More broadly, the paper Kalnay, E., M. Kanamitsu, R. Kistler, W. Collins, D. Deaven, L. Gandin, M. Iredell, S. Saha, G. White, J. Woollen, Y. Zhu, A. Leetmaa, R. Reynolds, M. Chelliah, W. Ebisuzaki, W. Higgins, J. Janowiak, K. C. Mo, C. Ropelewski, J. Wang, R. Jenne, D. Joseph, 1996: The NCEP/NCAR 40-year reanalysis project, Bull. Amer. Meteor. Soc., 77, 437-470, doi: 10.1175/1520-0477(1996)077<0437:TNYRP>2.0.CO;2. describes the expected level of reliability of the various variables. With more than 10,000 papers having used the dataset, it is possible that someone has already looked into your question, but without more detail, it is difficult to provide any additional direction. Links to additional information (FAQ, ClimateDataGuide) can be found at http://reanalyses.org/atmosphere/overview-current-reanalyses#NCEP1 best wishes, gil compo U. of Colorado CIRES & NOAA Earth System Research Laboratory

Paul Trimble (not verified)

Wed, 09/25/2013 - 06:31

Is the NARR going to be run back to 1900 with 20th Century Reanalysis being used for its boundary coniditions? This would be very useful for studying regional climate and hydrologic within the early portion of the 20th Century. Thanks Paul

Dear Paul, There are no plans that I know of do anything like this specifically. You may be interested in the dynamically downscaled data described in DiNapoli, S. M. and V. Misra, 2012: Reconstructing the 20th century high-resolution climate of the southeastern United States, J. Geophys. Res., 117, D19113, doi:10.1029/2012JD018303. best wishes, gil compo

Nirvikar Dashora (not verified)

Thu, 09/12/2013 - 08:16

Thanks a lot to all of you who responded to my query regarding GPS based water vapor estimation and high res. data. I, indeed, am thankful to you all and at the moment feeling overwhelmed to receive four replies and all are supporting and relevant. So now, let see how all comments work-out. I would like to come back with my findings again to this forum. It has been useful to post a comment here.

ndashora (not verified)

Fri, 09/06/2013 - 03:05

While working for estimation of IWV using GPS, I learned that the diurnal variations in GPS-IWV can be obtained if we use high resolution (better than 6 hours i.e. 3 hourly) surface temperature and pressure values. These values, in turn are required to obtain the hydrostatic delay over the GPS site for estimation of wet delay. I would really appreciate if somebody can provide information about a reanalysis product that has temporal resolution of 3 hours and spatial resolution about 100 km or better. I downloaded MERRA 3-hour product, but observations from our AWS do not match with this data for shorter scales (like diurnal variations and range of variations of parameters).

Dear ndashora, It would be very helpful if you would make a Page on the site and post a figure illustrating the issue. If you do not have an account, go to https://reanalyses.org/user/register to make one. A listing of the spatial and temporal resolution of the atmospheric reanalysis datasets is given at https://reanalyses.org/atmosphere/comparison-table see the Model Output Resolution column and Publicly Available Dataset Resolution column. Links to Data Access can be found under the descriptions at https://reanalyses.org/atmosphere/overview-current-reanalyses Oh, you may want to spell out the acronym IWV. Other users refer to is as Water Vapor Path or other names.

David (not verified)

Thu, 08/22/2013 - 15:07

I didn't quite formulate my question earlier. Let me retry. The general question is what the kg/m2 means in NARR in monthly files? My assumption is that for these "transports" that the value is an accumulation over 3hr. So, to get to a daily value of, say, ssrun, one would simply multiply by 8. And to a monthly integral just days per month. Could someone confirm this? Regards, David

Dick Dee (not verified)

Tue, 07/30/2013 - 04:05

The main ECMWF reanalysis webpage (www.ecmwf.int/research/era) has some information about observations used in ERA-Interim, including a timeline (http://www.ecmwf.int/research/era/do/get/index/29/29?showfile=true) and a complete inventory of radiosonde observations (http://www.ecmwf.int/research/era/do/get/index/29/28). We are working on a system that will allow users to view and download all observations used in our reanalyses - stay tuned.

Christopher (not verified)

Sat, 07/27/2013 - 05:29

Hello, I am looking for the PFT maps used in NCEP I (and other reanalysis, but NCEP I is the first one I'd like to use)? So, the underlying classification of land grid cells according to vegetation or similar used in the reanalysis. I have had no luck finding these online so wanted to ask here? Thanks, Christopher

Cathy.Smith@noaa.gov

Mon, 07/29/2013 - 11:26

In reply to by Christopher (not verified)

I think the files are here (monthly) ftp://ftp.emc.ncep.noaa.gov/mmb/gcp/sfcflds/test/fixed/README_albedo_gfrac.txt NCAR has ncep R1 files and lists vegetation (grib 225). I'm not sure which set of products it is in. http://rda.ucar.edu/datasets/ds090.0/#description
Cathy

It looks like NCAR has the variable Vegetation Species for the NCEP/NCAR Reanalysis at http://rda.ucar.edu/datasets/ds090.0/#description The University of Maryland table describing the land cover for 1 degree data from which the NCEP/NCAR vegetation species is presumably derived is at http://glcf.umd.edu/data/landcover/ (after consulting with Mike Ek of NOAA). best wishes, gil compo

asimnicol (not verified)

Tue, 07/23/2013 - 04:30

Has anyone worked with the uncertainties of monthly values derived from the 20th Century Reanalysis product? I know there are monthly mean values of sub-daily ensemble spread available, but these are not the same as the spread of the monthly averages calculated using each ensemble. That sentence is confusing, because I am confused! Would be very grateful for any advice or ideas.

Dear Asimnicol, Your comment had spam lines, which have been deleted. At portal.nersc.gov, you can find each member of selected variables averaged to a daily mean and to a monthly mean. From this, you can construct your own ensemble spread or other statistic. Please let me know of any additional questions. best wishes, gil compo (University of Colorado/CIRES and NOAA/Earth System Research Laboratory/Physical Sciences Division)

Tade (not verified)

Mon, 07/08/2013 - 14:59

hello there, I'm wondering if anyone out there could provide and /or confirm on the availability of ERA interim reanalysis at 0.25 degree spatial resolution and sub daily or daily temporal resolution for public access. Apparently, I read from ECMWF portal that ERA interim reanalysis data has approximately 80 km resolution. I'm interested to use a global reanalysis data to force hydrological models such as SWAT for a meso watershed with sparse hydrometeorological stations. I would appreciate if you drop me any piece of information on the availability of global reanalysis data with resolution in the order of 20 -30km at daily scale or shorter. So far I saw CFSR with 38 km which has a potential use but I'm hoping if there is more resoluted one. Many thanks, Tade

Tade, To date, there is no global reanalysis dataset at the resolution you are requesting. See the overview table at http://reanalyses.org/atmosphere/comparison-table There are regional reanalyses that come close to your desired resolution. Again, see the table. best wishes, gil compo (University of Colorado/CIRES and NOAA/Earth System Research Laboratory/Physical Sciences Division)

Anonymous (not verified)

Mon, 06/17/2013 - 06:39

Hi Dears, Where can I find the list of surface station observations used in ERA-Interim? Where can I find the list of radiosonde station observations used in ERA-Interim? Thanks, Celeste

I just took a quick look at the MERRA assimilated observations in Jan2000. I can see data near Summit in surface pressure, but not near Humbolt, GITS, Tunu-N or Petermann. I'm not so familiar with the stations data availability. If they were in the GTS, then they would be input. Note, that MERRA assimilates surface pressure from surface meteorology stations, not temperature, moisture or wind.

To look at this, I used MERRA's Gridded Innovations and Observations data, on openDAP at: http://opendap.nccs.nasa.gov/dods/MerraObs

It can also be downloaded from GES DISC: http://disc.sci.gsfc.nasa.gov/mdisc/data-holdings/merra-innov

These are not yet well documented.

We did not use these data in ERA-Interim - they are also not used by the ECMWF operational forecast system. Most of the Greenland station data that currently arrive at ECMWF are from coastal stations. Those inland stations could be very valuable for forecasting (and reanalysis, of course).

For the 20th Century Reanalysis (20CR, http://reanalyses.org/atmosphere/overview-current-reanalyses#TWENT ), you can obtain all of the observations used from the International Surface Pressure Databank version 2 ( http://reanalyses.org/observations/international-surface-pressure-datab… ) for the entire global domain and time period (1871-2010) or for a subset period or region using the tools
courtesy of the Data Support Section of the Computational and Information Systems Laboratory at the National Center for Atmospheric Research from http://rda.ucar.edu/datasets/ds132.0/.

Maps of the stations available to the 20CR can be viewed at http://www.esrl.noaa.gov/psd/data/ISPD/v2.0/.
A text file with the stations available is at http://reanalyses.org/sites/default/files/groups/users/gilbert.p.compo/… .
See the ISPD home page http://reanalyses.org/observations/international-surface-pressure-datab… for more information.

Please let me know if I can of more help.

best wishes,
gil compo

Gijs de Boer (not verified)

Wed, 02/20/2013 - 14:02

I have a couple of quick questions about ERA-Interim. The documentation is a bit fuzzy on this, but as far as I can tell, the radiation scheme used in Interim is RRTM, is that correct? Also, am I reading correctly that SST and sea ice come from the NCEP analysis for years prior to June 2001, then the NOAA OISST from July 2001-December 2001, the NCEP RTG from January of 2002-January 2009 and finally OSTIA from February 2009 onwards? Thanks, Gijs de Boer

Please take a look at http://www.ecmwf.int/research/era, specifically the links to the IFS documentation, which has all the details about the radiation scheme used in the model, and links to 'known quality issues' which include the inconsistent use of SST products.

I did look at the documentation before posting my questions. However, I was not convinced that I had all of the answers to the questions I posed. For longwave radiation, the model documentation states: "Since cycle Cy22r3, two longwave radiation schemes are available in the ECMWF model, the pre-cycle Cy22r3 by Morcrette (1991), and the current longwave radiation transfer scheme, the Rapid Radiation Transfer Model (RRTM)." It is not stated (as far as I can tell), which version is used for the ERA-Interim runs, which is what I am trying to figure out... While those at ECMWF are likely versed in which model versions are used for the ERA-I production runs, unfortunately I'm not. If I am reading the documentation correctly, the shortwave portion of the radiative transfer scheme is described in Fouquart and Bonnel (1980), and RRTM is NOT used for shortwave radiation. As far as SST goes, the model documentation states: "For the operational ten-day forecasts, ECMWF uses the NCEP daily real-time global SST product (RTG_SST) at 0.5 degree resolution." In the Dee et al. paper, it states that ERA-Interim uses NCEP RTG between 01/02 and 01/09. I was just trying to confirm that this is the case, given the documentation's description. Thanks for providing the hint about searching under the "known quality issues" section, where what I describe above appears to be confirmed. Thanks again for any insight that folks may be able to provide on the longwave radiation scheme used for the ERA-I runs.

Sorry about that - there is a lot of information available but unfortunately it is not all in one place, and not always clear, and it could certainly be much better organised. We tried to be thorough in Dee et al 2011, which is the basic reference for ERA-Interim. In fact it is just as you say - in ERA-Interim LW radiation is computed using RRTM while SW is still based on Fouquart and Bonnel with six spectral intervals.

Brian Walsh (not verified)

Thu, 01/31/2013 - 13:52

I'm looking for high resolution surface wind (10 metres above ground) for 5 years (2008-2012) off Western Greenland. We'd prefer something less than 20 km in spatial resolution and at least 6 or 12 hourly time steps. Is that available from any reanalysis dataset?

matthias.jerg

Mon, 01/21/2013 - 03:23

Hello,

I would like to compare globally gridded monthly means of cloud products derived from satellite observations (AVHRR,MODIS) with reanalysis products. I am tending towards using ERA-Interim but would be interested in the general opinion on this question. I would also be very interested in any recommendations which products to look at. I am aiming for cloud fractional coverage, cloud liquid and ice water path and possibly cloud top height. Any comments on this also wrt common traps and problems, parameters to investigate etc. are highly appreciated.

Thanks,

Matthias

I can't say which you should compare, as it ultimately depends on your metrics and purpose. However, direct cloud data comparisons have been tricky, in my experience, since there are inherent differences in what is observed, and how the background models compute cloud quantities. Part of this is also the motivation for data simulators (e.g. ISSCP Simulator). I would encourage you to include radiation observations into the comparison, as those should be another variable where the feedback from clouds to the atmosphere manifests.

Thanks for your answer. You are certainly raising an important point. We might include direct radiation comparisons but the current scope of the project will not allow us to do much. Therefore, we may have to stick with direct cloud data comparisons for the time being.

Thanks,

Matthias

Anonymous (not verified)

Tue, 10/23/2012 - 20:51

Hi all, I am studying the surface energy balance problem and using the ERA-Interim solar radiation data, the fields are accumulated from the start of the forecast, so in order to get averaged values I divided the data by the length of the forecast step as the ERA-Interim website FAQs : ( FLD( STEP2)- FLD( STEP1))/(( STEP2-STEP1)*3600) while I get some negative values which I think is impossible,so can you tell me the right to handle the accumuliate field?Thanks. X.L

Paul (not verified)

Thu, 10/25/2012 - 06:08

In reply to by Anonymous (not verified)

In order to obtain average values from accumulated values you need to divide by the number of seconds in the STEP ie STEP*3600 because the accumulation is from the beginning of the forecast to the STEP (in hours) in question. If you require the average value from STEP1 to STEP2 then the formula you quote is correct provided that STEP2 is larger than STEP1. If you obtained netCDF data from the ECMWF data server at http://data-portal.ecmwf.int/ then you need to be aware that the data are packed, see the data FAQ at http://www.ecmwf.int/products/data/archive/data_faq.html#netcdfintegers, and that the scale_factor and add_offset vary with date, time and STEP etc.

Dick Dee (not verified)

Tue, 09/18/2012 - 05:15

Dear anonymous, your question would make a good subject for a paper. It is probably too general for this forum. I can say that we are reasonably confident about lower-tropospheric humidity in ERA-Interim, especially over land areas, based on the quality of the precipitation estimates generated by the model - see Dee et al QJ 2011 (http://onlinelibrary.wiley.com/doi/10.1002/qj.828/abstract). ERA-Interim humidity near the surface compares very well with independent observations - see Simmons et al JGR 2010 (doi:10.1029/2009JD012442). We have also looked at the variability of upper-tropospheric humidity and temperature in the tropics which seems reasonably good - see my presentation at the WCRP Open Science Conference in Denver last year (http://conference2011.wcrp-climate.org/orals/B4/Dee_B4.pdf) Dick

prakashb2002

Fri, 09/07/2012 - 00:39

Hello all,
I am studying applicability of met parameter (P, T & Rh) derived from reanalysis products to GPS PWV estimation. I selected NCEP R1, NCEP FNL and ERA-Interim for a decade and use the values (P, T & Rh) derived from them for inter-comparison. R1 and ERA-Interim are reanalysis products whereas FNL is operational GDAS analysis. Is it feasible to use them for inter-comparison? Any help will be highly appreciated.

Prakash

gregoire.leroy

Fri, 08/03/2012 - 03:47

Hello all,

I have a question regarding the CFSV2. UCAR website states that it is a continuation of CFSR. But is it a reanalysis like CFSR or is it an analysis? Can we consider that the quality of CFSV2 data are the same than CFSR?

Thanks,

G.L

Linden Ashcroft (not verified)

Thu, 07/05/2012 - 23:52

Has anyone worked with the uncertainties of monthly values derived from the 20th Century Reanalysis product? I know there are monthly mean values of sub-daily ensemble spread available, but these are not the same as the spread of the monthly averages calculated using each ensemble. That sentence is confusing, because I am confused! Would be very grateful for any advice or ideas.

Dear Linden, You are right that monthly means of sub-daily ensemble spread are not the same as the ensemble spread of the monthly averages. The "correct" spread will always only results from doing all analyses for each member separately and then analyse the spread of the results (e.g., averages, trends, any other statistics). The monthly means of sub-daily ensemble spread can only tell you something about the ensemble spread of the monthly averages if you have a way to consider the autocorrrelation. In my view, it is still valuable as an upper-limit estimation. Maybe I am too simplistic, but some part of the spread will be close to random and thus its contribution is expected to decrease with the square root of n, so the true spread of the monthly means will be lower.

megha (not verified)

Tue, 03/27/2012 - 00:27

kindly suggest me that can we take two different parameters from two different grid data set of NCEP/NCAR reanalysis 2 to calculate a variable in which both the parameters have been involved? for example-can i take skin temperature from surface data grid and all other from pressure data grid to calculate latent heat flux ?

If I understand correctly, you would like to use data from N/N surface files and pressure level files, together, to make a new calculation of Latent heat flux? Ultimately, I don't think there is a specific reason that would prevent it. You would need to be careful about time step an grid centers (if all not identical). However, the reanalysis should produce it's own latent heat flux. Is the LE not sufficient? Can you offer more details or clarification?

The typical output would provide data centered on a grid box, and at the listed pressure level. However, for certain purposes, data offset to the edges are more accurate, but these should be easily identifiable. When in doubt, check the model or system documentation for a description of the grid and data format.

Huug van den Dool (not verified)

Thu, 03/22/2012 - 08:31

Yes, you understand correctly. The solar constant varies, but by the same % irradiance variation for each freq band. Moorthi or Yu-Tai can answer as to whether ozone varies in that set-up. Huug

Stergios (not verified)

Tue, 03/20/2012 - 03:48

Some questions regarding the 20th century reanalysis Which reconstruction of solar irradiance is used to force the model? Is the model forced with total or spectral solar irradiances? Is there a 11-yr solar cycle? Was the stratospheric one kept constant? Thank you very much.

The reconstruction is described in http://www.cpc.ncep.noaa.gov/products/people/wd51hd/vddoolpubs/solar_reconstruction.doc The NCEP model is forced by a spectral distribution of solar radiation. We do include the abt 11 yr cycle, even with a forecast to 2020. Not sure what is meant by the stratosphere question. Huug van den Dool (no need for anonymity on my part)

Thank you very much for the quick reply.

The NCEP model is forced by spectral irradiances but, if i understood correctly, the solar cycle variation refers to total solar irradiance only. This means that every spectral band of the radiation code increases equally (~0.1%) from the minimum to the maximum phase of the 11-yr solar cycle.
The last question was referring to stratospheric ozone. There is a prognostic equation for ozone, right? So, i guess there is a weak ozone variation in the course of the 11-yr solar cycle.

Stergios Misios

bastin (not verified)

Tue, 07/26/2011 - 00:39

So which is the best analysis for wind related long term calculations.......NCEP/NCAR reanalysis or NOAA-CIRES 20th Century Reanalysis V2 (20CR): 1871-2008

It depends on your needs, and which winds you are referring to. Ocean/SHem will have diffs in N/N when satellite data becomes available. 20CR is an ensemble of surface pressure only assimilation, no wind assimilation. the pressure gradients where obs are available should help the low level winds, but there is no upper level wind assimilation.

bottom line is that the 20CR is so new, you will likely have to determine this for your self, and we hope that you can share that information back here, as others may have similar questions. Be sure to search for new papers coming out and conference papers, 20CR is getting a lot of attention!
MB

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.