Journal cover Journal topic
Geoscientific Model Development An interactive open-access journal of the European Geosciences Union
https://doi.org/10.5194/gmd-2017-186
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 4.0 License.
Review and perspective paper
05 Sep 2017
Review status
This discussion paper is a preprint. It is a manuscript under review for the journal Geoscientific Model Development (GMD).
Crossing the Chasm: How to develop weather and climate models for next generation computers?
Bryan N. Lawrence1,2,3, Michael Rezny4, Reinhard Budich5, Peter Bauer6, Jörg Behrens7, Mick Carter8, Willem Deconinck5, Rupert Ford9, Christopher Maynard8, Steven Mullerworth8, Carlos Osuna10, Andrew Porter9, Kim Serradell11, Sophie Valcke12, Nils Wedi6, and Simon Wilson1,2,8 1Department of Meteorology, University of Reading, UK
2National Centre of Atmospheric Science, UK
3STFC Rutherford Appleton Laboratory, UK
4Monash University, Australia
5Max Planck Institute for Meteorology, Germany
6ECMWF, UK
7DKRZ, Germany
8Met Office, UK
9STFC Hartree Centre, Daresbury Laboratory, UK
10ETH, Switzerland
11Barcelona Supercomputing Center, Spain
12Centre Européen de Recherche et de Formation Avancée en Calcul Scientifique, France
Abstract. Weather and climate models are complex pieces of software which include many individual components, each of which is evolving under the pressure to exploit advances in computing to enhance some combination of a range of possible improvements (higher spatio/temporal resolution, increased fidelity in terms of resolved processes, more quantification of uncertainty etc). However, after many years of a relatively stable computing environment with little choice in processing architecture or programming paradigm (basically X86 processors using MPI for parallelism), the existing menu of processor choices includes significant diversity, and more is on the horizon. This computational diversity, coupled with ever increasing software complexity, leads to the very real possibility that weather and climate modelling will arrive at a chasm which will separate scientific aspiration from our ability to develop and/or rapidly adapt codes to the available hardware.

In this paper we review the hardware and software trends which are leading us towards this chasm, before describing current progress in addressing some of the tools which we may be able to use to bridge the chasm. This brief introduction to current tools and plans is followed by a discussion outlining the scientific requirements for quality model codes which have satisfactory performance and portability, while simultaneously supporting productive scientific evolution. We assert that the existing method of incremental model improvements employing small steps which adjust to the changing hardware environment is likely to be inadequate for crossing the chasm between aspiration and hardware at a satisfactory pace, in part because institutions cannot have all the relevant expertise in house. Instead, we outline a methodology based on large community efforts in engineering and standardisation, one which will depend on identifying a taxonomy of key activities – perhaps based on existing efforts to develop domain specific languages, identify common patterns in weather and climate codes, and develop community approaches to commonly needed tools, libraries etc – and then collaboratively building up those key components. Such a collaborative approach will depend on institutions, projects and individuals adopting new interdependencies and ways of working.


Citation: Lawrence, B. N., Rezny, M., Budich, R., Bauer, P., Behrens, J., Carter, M., Deconinck, W., Ford, R., Maynard, C., Mullerworth, S., Osuna, C., Porter, A., Serradell, K., Valcke, S., Wedi, N., and Wilson, S.: Crossing the Chasm: How to develop weather and climate models for next generation computers?, Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2017-186, in review, 2017.
Bryan N. Lawrence et al.
Bryan N. Lawrence et al.
Bryan N. Lawrence et al.

Viewed

Total article views: 1,117 (including HTML, PDF, and XML)

HTML PDF XML Total BibTeX EndNote
408 707 2 1,117 5 6

Views and downloads (calculated since 05 Sep 2017)

Cumulative views and downloads (calculated since 05 Sep 2017)

Viewed (geographical distribution)

Total article views: 1,117 (including HTML, PDF, and XML)

Thereof 1,106 with geography defined and 11 with unknown origin.

Country # Views %
  • 1

Saved

Discussed

Latest update: 20 Nov 2017
Publications Copernicus
Download
Short summary
Weather and climate models consist of complex software evolving in response to scientific requirements and changing computing hardware. After years of relatively stable hardware, more diversity is arriving. This hardware diversity and pace of change may lead to major software development problems. This chasm between aspiration and reality may need to be bridged by community efforts, rather than traditional in-house methods, and require new interdependencies and ways of working.
Weather and climate models consist of complex software evolving in response to scientific...
Share