eddy4r 0.2.0: a devops model for community-extensible processing and analysis of eddy-covariance data based on r, git, docker, and hdf5
Clicks: 110
ID: 254124
2017
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This
article has not been analysed, so there is no overall score —
reader engagement is measured and shown alongside.
Reader Engagement
Emerging Content
30.0
/100
110 views
26 readers
AI Quality Assessment
Not analyzed
Readership in this journal
EmergingRanked #82 of 133 articles by views in international journal of quantum chemistry
Most read
Least read
Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 133 in total.
Mint this article as an NFT
Not yet mintedCreate a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.
5
SUSD
one-off · no wallet required
Abstract
Large differences in instrumentation, site setup, data format, and operating
system stymie the adoption of a universal computational environment for
processing and analyzing eddy-covariance (EC) data. This results in limited
software applicability and extensibility in addition to often substantial
inconsistencies in flux estimates. Addressing these concerns, this paper
presents the systematic development of portable, reproducible, and
extensible EC software achieved by adopting a development and systems
operation (DevOps) approach. This software development model is used for the
creation of the eddy4R family of EC code packages in the open-source
R language for statistical computing. These packages are community developed,
iterated via the Git distributed version control system, and wrapped into a
portable and reproducible Docker filesystem that is independent of the
underlying host operating system. The HDF5 hierarchical data format then
provides a streamlined mechanism for highly compressed and fully
self-documented data ingest and output.
The usefulness of the DevOps approach was evaluated for three test applications. First, the resultant EC processing software was used to analyze standard flux tower data from the first EC instruments installed at a National Ecological Observatory (NEON) field site. Second, through an aircraft test application, we demonstrate the modular extensibility of eddy4R to analyze EC data from other platforms. Third, an intercomparison with commercial-grade software showed excellent agreement (R2 = 1.0 for CO2 flux). In conjunction with this study, a Docker image containing the first two eddy4R packages and an executable example workflow, as well as first NEON EC data products are released publicly. We conclude by describing the work remaining to arrive at the automated generation of science-grade EC fluxes and benefits to the science community at large.
This software development model is applicable beyond EC and more generally builds the capacity to deploy complex algorithms developed by scientists in an efficient and scalable manner. In addition, modularity permits meeting project milestones while retaining extensibility with time.
The usefulness of the DevOps approach was evaluated for three test applications. First, the resultant EC processing software was used to analyze standard flux tower data from the first EC instruments installed at a National Ecological Observatory (NEON) field site. Second, through an aircraft test application, we demonstrate the modular extensibility of eddy4R to analyze EC data from other platforms. Third, an intercomparison with commercial-grade software showed excellent agreement (R2 = 1.0 for CO2 flux). In conjunction with this study, a Docker image containing the first two eddy4R packages and an executable example workflow, as well as first NEON EC data products are released publicly. We conclude by describing the work remaining to arrive at the automated generation of science-grade EC fluxes and benefits to the science community at large.
This software development model is applicable beyond EC and more generally builds the capacity to deploy complex algorithms developed by scientists in an efficient and scalable manner. In addition, modularity permits meeting project milestones while retaining extensibility with time.
| Reference Key |
metzger2017geoscientificeddy4r 0.2.0:
Use this key to autocite in the manuscript while using
SciMatic Manuscript Manager or Thesis Manager
|
|---|---|
| Authors | ;S. Metzger;S. Metzger;D. Durden;C. Sturtevant;H. Luo;N. Pingintha-Durden;T. Sachs;A. Serafimovich;J. Hartmann;J. Li;K. Xu;A. R. Desai |
| Journal | international journal of quantum chemistry |
| Year | 2017 |
| DOI |
10.5194/gmd-10-3189-2017
|
| URL | |
| Keywords |
Citations
No citations found. To add a citation, contact the admin at info@scimatic.org
Comments
No comments yet. Be the first to comment on this article.