Biological and Environmental Research - Earth and Environmental System Sciences
Earth and Environmental System Modeling

LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models

TitleLIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models
Publication TypeJournal Article
Year of Publication2017
AuthorsKennedy, Joseph H., Bennett Andrew R., Evans Katherine J., Price Stephen, Hoffman Matthew, Lipscomb William H., Fyke Jeremy, Vargo Lauren, Boghozian Adrianna, Norman Matthew, and Worley Patrick H.
JournalJournal of Advances in Modeling Earth Systems
Volume9
Number2
Pages854-869
Abstract / Summary

To address the pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice sheet models is underway. Concurrent with the development of the Community Ice Sheet Model (CISM), the corresponding verification and validation (V&V) process is being coordinated through a new, robust, Python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVVkit). Incorporated into the typical ice sheet model development cycle, it provides robust and automated numerical verification, software verification, performance validation, and physical validation analyses on a variety of platforms, from personal laptops to the largest supercomputers. LIVVkit operates on sets of regression test and reference data sets, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-for-bit evaluation, and plots of model variables to indicate where differences occur. LIVVkit also provides an easily extensible framework to incorporate and analyze results of new intercomparison projects, new observation data, and new computing platforms. LIVVkit is designed for quick adaptation to additional ice sheet models via abstraction of model-specific code, functions, and configurations into an ice sheet model description bundle outside the main LIVVkit structure. Ultimately, through shareable and accessible analysis output, LIVVkit is intended to help developers build confidence in their models and enhance the credibility of ice sheet models overall.

URLhttps://doi.org/10.1002/2017MS000916
DOI10.1002/2017MS000916
Journal: Journal of Advances in Modeling Earth Systems
Year of Publication: 2017
Volume: 9
Number: 2
Pages: 854-869
Publication Date: 03/2017

To address the pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice sheet models is underway. Concurrent with the development of the Community Ice Sheet Model (CISM), the corresponding verification and validation (V&V) process is being coordinated through a new, robust, Python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVVkit). Incorporated into the typical ice sheet model development cycle, it provides robust and automated numerical verification, software verification, performance validation, and physical validation analyses on a variety of platforms, from personal laptops to the largest supercomputers. LIVVkit operates on sets of regression test and reference data sets, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-for-bit evaluation, and plots of model variables to indicate where differences occur. LIVVkit also provides an easily extensible framework to incorporate and analyze results of new intercomparison projects, new observation data, and new computing platforms. LIVVkit is designed for quick adaptation to additional ice sheet models via abstraction of model-specific code, functions, and configurations into an ice sheet model description bundle outside the main LIVVkit structure. Ultimately, through shareable and accessible analysis output, LIVVkit is intended to help developers build confidence in their models and enhance the credibility of ice sheet models overall.

DOI: 10.1002/2017MS000916
Citation:
Kennedy, JH, AR Bennett, KJ Evans, S Price, M Hoffman, WH Lipscomb, J Fyke, et al.  2017.  "LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models."  Journal of Advances in Modeling Earth Systems 9(2): 854-869.  https://doi.org/10.1002/2017MS000916.
Related Publication(s):
Evans, KJ, JH Kennedy, D Lu, MM Forrester, S Price, J Fyke, A Bennett, et al.  2019.  "LIVVkit 2.1: Automated and Extensible Ice Sheet Model Validation."  Geoscientific Model Development 12(3): 1067-1086.  https://doi.org/10.5194/gmd-12-1067-2019.