Journal cover Journal topic
Geoscientific Model Development An interactive open-access journal of the European Geosciences Union
Journal topic

Journal metrics

Journal metrics

  • IF value: 5.154 IF 5.154
  • IF 5-year value: 5.697 IF 5-year
    5.697
  • CiteScore value: 5.56 CiteScore
    5.56
  • SNIP value: 1.761 SNIP 1.761
  • IPP value: 5.30 IPP 5.30
  • SJR value: 3.164 SJR 3.164
  • Scimago H <br class='hide-on-tablet hide-on-mobile'>index value: 59 Scimago H
    index 59
  • h5-index value: 49 h5-index 49
Discussion papers
https://doi.org/10.5194/gmd-2019-291
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-2019-291
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.

Submitted as: methods for assessment of models 26 Nov 2019

Submitted as: methods for assessment of models | 26 Nov 2019

Review status
This discussion paper is a preprint. It is a manuscript under review for the journal Geoscientific Model Development (GMD).

ESMValTool v2.0 – Extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP

Veronika Eyring1,2, Lisa Bock1, Axel Lauer1, Mattia Righi1, Manuel Schlund1, Bouwe Andela3, Enrico Arnone4,5, Omar Bellprat6, Björn Brötz1, Louis-Phillippe Caron6, Nuno Carvalhais7,8, Irene Cionni9, Nicola Cortesi6, Bas Crezee10, Edouard Davin10, Paolo Davini4, Kevin Debeire1, Lee de Mora11, Clara Deser12, David Docquier13, Paul Earnshaw14, Carsten Ehbrecht15, Bettina K. Gier2,1, Nube Gonzalez-Reviriego6, Paul Goodman16, Stefan Hagemann17, Steven Hardiman14, Birgit Hassler1, Alasdair Hunter6, Christopher Kadow18, Stephan Kindermann15, Sujan Koirala7, Nikolay V. Koldunov19,20, Quentin Lejeune10,21, Valerio Lembo22, Tomas Lovato23, Valerio Lucarini22,24,25, Francois Massonnet13, Benjamin Müller26, Amarjiit Pandde16, Nuria Pérez-Zanón6, Adam Phillips12, Valeriu Predoi27, Joellen Russell16, Alistair Sellar14, Federico Serva28, Tobias Stacke29, Ranjini Swaminathan30, Verónica Torralba6, Javier Vegas-Regidor6, Jost von Hardenberg4,31, Katja Weigel2,1, and Klaus Zimmermann32 Veronika Eyring et al.
  • 1Deutsches Zentrum für Luft-und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
  • 2University of Bremen, Institute of Environmental Physics (IUP), Bremen, Germany
  • 3Netherlands eScience Center, Science Park 140, 1098 XG Amsterdam, the Netherlands
  • 4Institute of Atmospheric Sciences and Climate, Consiglio Nazionale delle Ricerche (ISAC-CNR), Italy
  • 5Department of Physics, University of Torino, Italy
  • 6Barcelona Supercomputing Center (BSC), Barcelona, Spain
  • 7Department of Biogeochemical Integration, Max Planck Institute for Biogeochemistry, Jena, Germany
  • 8Departamento de Ciências e Engenharia do Ambiente, DCEA, Faculdade de Ciências e Tecnologia, FCT, Universidade Nova de Lisboa, 2829-516 Caparica, Portugal
  • 9Agenzia nazionale per le nuove tecnologie, l’energia e lo sviluppo economico sostenibile (ENEA), Rome, Italy
  • 10ETH Zurich, Institute for Atmospheric and Climate Science, Zurich, Switzerland
  • 11Plymouth Marine Laboratory (PML), Plymouth, UK
  • 12National Center for Atmospheric Research (NCAR), Boulder, CO, USA
  • 13Georges Lemaître Centre for Earth and Climate Research, Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium
  • 14Met Office, Exeter, UK
  • 15Deutsches Klimarechenzentrum, Hamburg, Germany
  • 16Department of Geosciences, University of Arizona, Tucson, AZ, USA
  • 17Institute of Coastal Research, Helmholtz-Zentrum Geesthacht (HZG), Geesthacht, Germany
  • 18Freie Universität Berlin (FUB), Berlin, Germany
  • 19MARUM, Center for Marine Environmental Sciences, Bremen, Germany
  • 20Alfred‐Wegener‐Institut Helmholtz‐Zentrum für Polar‐und Meeresforschung, Bremerhaven, Germany
  • 21Climate Analytics, Berlin, Germany
  • 22CEN, University of Hamburg, Meteorological Institute, Hamburg, Germany
  • 23Fondazione Centro Euro-Mediterraneo sui Cambiamenti Climatici (CMCC), Bologna, Italy
  • 24Department of Mathematics and Statistics, University of Reading, Department of Mathematics and Statistics, Reading, UK
  • 25Centre for the Mathematics of Planet Earth, University of Reading, Centre for the Mathematics of Planet Earth Department of Mathematics and Statistics, Reading, UK
  • 26Ludwig Maximilians Universität (LMU), Department of Geography, Munich, Germany
  • 27NCAS Computational Modelling Services (CMS), University of Reading, Reading, UK
  • 28Institute of Marine Sciences, Consiglio Nazionale delle Ricerche (ISMAR-CNR), Italy
  • 29Max Planck Institute for Meteorology (MPI-M), Hamburg, Germany
  • 30Department of Meteorology, University of Reading, Reading, UK
  • 31Department of Environment, Land and Infrastructure Engineering, Politecnico di Torino, Turin, Italy
  • 32Rossby Centre, Swedish Meteorological and Hydrological Institute (SMHI), Sweden

Abstract. The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool designed to improve comprehensive and routine evaluation of Earth System Models (ESMs) participating in the Coupled Model Intercomparison Project (CMIP). It has undergone rapid development since the first release in 2016 and is now a well-tested tool that provides end-to-end provenance tracking to ensure reproducibility. It consists of an easy-to-install, well documented Python package providing the core functionalities (ESMValCore) that performs common pre-processing operations and a diagnostic part that includes tailored diagnostics and performance metrics for specific scientific applications. Here we describe large-scale diagnostics of the second major release of the tool that supports the evaluation of ESMs participating in CMIP Phase 6 (CMIP6). ESMValTool v2.0 includes a large collection of diagnostics and performance metrics for atmospheric, oceanic, and terrestrial variables for the mean state, trends, and variability. ESMValTool v2.0 also successfully reproduces figures from the evaluation and projections chapters of the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) and incorporates updates from targeted analysis packages, such as the NCAR Climate Variability Diagnostics Package for the evaluation of modes of variability the Thermodynamic Diagnostic Tool (TheDiaTo) to evaluate the energetics of the climate system, as well as parts of AutoAssess that contains a mix of top-down performance metrics. The tool has been fully integrated into the Earth System Grid Federation (ESGF) infrastructure at the Deutsches Klima Rechenzentrum (DKRZ) to provide evaluation results from CMIP6 model simulations shortly after the output is published to the CMIP archive. A result browser has been implemented that enables advanced monitoring of the evaluation results by a broad user community at much faster timescales than what was possible in CMIP5.

Veronika Eyring et al.
Interactive discussion
Status: open (until 21 Jan 2020)
Status: open (until 21 Jan 2020)
AC: Author comment | RC: Referee comment | SC: Short comment | EC: Editor comment
[Subscribe to comment alert] Printer-friendly Version - Printer-friendly version Supplement - Supplement
Veronika Eyring et al.
Veronika Eyring et al.
Viewed  
Total article views: 338 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
224 109 5 338 4 7
  • HTML: 224
  • PDF: 109
  • XML: 5
  • Total: 338
  • BibTeX: 4
  • EndNote: 7
Views and downloads (calculated since 26 Nov 2019)
Cumulative views and downloads (calculated since 26 Nov 2019)
Viewed (geographical distribution)  
Total article views: 214 (including HTML, PDF, and XML) Thereof 213 with geography defined and 1 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Cited  
Saved  
No saved metrics found.
Discussed  
No discussed metrics found.
Latest update: 14 Dec 2019
Publications Copernicus
Download
Short summary
The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool designed to improve comprehensive and routine evaluation of Earth System Models (ESMs) participating in the Coupled Model Intercomparison Project (CMIP). It has undergone rapid development since the first release in 2016 and is now a well-tested tool that provides end-to-end provenance tracking to ensure reproducibility.
The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance...
Citation