By Juliane Manitz and Joe Rickert | May 20, 2021
TransCelerate has published “Modernization of statistical analytics (MSA) Framework”. With goals similar to the R Validation Hub, the TransCelerate MSA framework seeks to demonstrate software reliability by establishing principles of accuracy, traceability, and reproducibility for a modern analytical software environment.
The MSA framework is centered around risk-assessment and mitigation practices to demonstrate reliability of software. This framework suggests assessing the accuracy of a software library via a confidence measure built on risk metrics such as published source code, issue management, usage, maturity, etc. If confidence does not meet the highest standards, additional testing is recommended. In addition, the intended use of a particular software library and the impact to the broader business outcome determines the requirement for additional testing. Altogether, the MSA framework is in line with the suggestions published in the R Validation Hub 2020 white paper for R. While the TransCelerate authors suggest their principles apply to a broad range of software, e.g. SAS, R, Python, Julia, etc, they do not provide specific suggestions for the implementation of their framework. The R Validation Hub can support the implementation of MSA inspired features with the R package riskmetric and the respective shiny app.
Beyond accuracy assessment, the MSA framework emphasizes reproducibility and traceability requirements and offers a variety of arguments for implementing MSA including the the emergence of electronic and digital data sources, the quantity of data being collected, the desire to automate analyses, and the accelerated pace of innovation in analysis techniques.
The R Validation Hub project team welcomes the publication of the TransCelerate MSA framework, and due to the close alignment between the two frameworks, we consider our early vision “validated” ;)
If you are interested in getting involved in contributing to our technical efforts then please send an email to email@example.com. Or join our mailing list to receive an invite to our quarterly meeting and receive notifications of new blog posts.