Blogs

{riskassessment} App voted best Shiny app at shinyConf 2023! 🎉

The {riskassessment} app, presented by Aaron Clark from the R Validation Hub Executive Committee, was voted best Shiny app at shinyConf 2023. The 2nd Annual Shiny Conference was held in March 2023. It was all virtual with over 4k global registrants. Congratulations!! The app provides a shiny front-end to augment the utility of the riskmetric package, thus user-friendly and interactive access to risk assessment of R packages. The apps functionalities include:

Continue reading

Summary of 2022 Case Studies

Last year, the R validation hub recently initiated a three-part presentation series on case studies in which eight pharmaceutical companies shared their experiences on building a GxP framework with R. These case studies highlighted both easy and challenging aspects of implementing risk assessment for R packages in a GxP environment. In this blog post we attempt to summarize common themes, difference in approaches, and challenges. All implementations followed the risk validation process for R packages outlined in the white paper.

Continue reading

ASA Biopharmaceutical report, Fall 2022

I’m pleased to share that the R Validation Hub’s efforts have been recognised in the ASA Biopharmaceutical report, Fall 2022. Within the edition you can find our paper, Risk Assessment of R Packages: Learnings and Reflections. This paper reflects on our white paper; provides an overview of our {riskmetric} package and Risk Assessment application; and summarises our 2022 case studies (which you can now find on our Case Studies page).

Continue reading

Status Update May 2022

It’s time to bring another update to you on the current status of the R validation hub: The riskmetric R package has been stable on CRAN. Recent work has focused on structuring “cohort metrics” – metrics that are conditioned on the package library or execution environment available to R. In R, package behaviors are often dependent on the rest of the R installation, and this new feature will help to make metrics more inspectible and reproducible, as well as allowing us to ask new questions like, “What would be the effect of installing a new package into an R environment?

Continue reading

Risk Assessment App Update

This is a re-post. The original post from the R Consortium can be found here Recent update by Marly Gotti on the Risk Assessment Shiny App. Marly is an executive committee member of the R Validation Hub where she advocates for the use of R within a biopharmaceutical regulatory setting, and Senior Data Scientist at Biogen. The Risk Assessment App is an interactive web application serving as a front end application for the riskmetric R package.

Continue reading

Some Considerations on Trusted Resources

There is a large variety of contributed R packages, which can be overwhelming when performing their accuracy assessment. These packages can be developed by anyone and may differ in accuracy. The white paper mentions the possibility to define “trusted resources” to simplify the assessment for some of the R packages. The idea follows vendor assessments / audits to explore the internal validation practices of the vendor for proprietary software. For open-source software such audits are not logistically feasible.

Continue reading

Status Update: R Validation Hub at R/Pharma 2021

Our favorite meeting of the year is approaching: R/Pharma 2021 will be held virtually November 2-4th, 2021. Also watch out for workshops the week before. Since the R validation Hub is closely associated with R/Pharma, we would like to highlight some of the presentations inspired by the R validation Hub, partner initiatives, or generally related to the topic of validation. Tuesday: November 2, 2021 11:00am “R Package Validation at Roche” by Coline Zeballos, Roche 11:20am “Statistical Analysis and Pathway to a Risk-based Assessment of R packages at Merck KGaA/EMD Serono” by Juliane Manitz, EMD Serono 1:50 PM “Panel Discussion – Validation” with representatives of the R validation Hub” Wednesday: November 3, 2021

Continue reading

Status Update: MSA Framework by TransCelerate

TransCelerate has published “Modernization of statistical analytics (MSA) Framework”. With goals similar to the R Validation Hub, the TransCelerate MSA framework seeks to demonstrate software reliability by establishing principles of accuracy, traceability, and reproducibility for a modern analytical software environment. The MSA framework is centered around risk-assessment and mitigation practices to demonstrate reliability of software. This framework suggests assessing the accuracy of a software library via a confidence measure built on risk metrics such as published source code, issue management, usage, maturity, etc.

Continue reading

Status Update: CRAN Release of `riskmetric`

We have reached a major milestone. The R package riskmetric has been released and is now available on CRAN. What is riskmetric? riskmetric is a collection of risk metrics to evaluate the quality of R packages following the framework suggested by the R validation hub (see our white paper for details). Various quality metrics are provided which evaluate best practices of software development, code documentation, community engagement and development sustainability.

Continue reading

Status Update: Conferences 2021

The new year is starting with some good news for the R validation hub. We will be able to present our work at a number of different meetings in 2021: National Institute of Statistical Sciences (NISS; April 21, 2021): NISS-Merck Meet-Up on Open Source Software in Pharma Annual Meeting of Statisticians in the Pharmaceutical Industry (PSI; June 21-23, 2021): Contributed session accepted Joint Statistical Meetings (JSM; August 7-12, 2021): Topic-contributed session accepted

Continue reading