Another Warning Letter … and we still miss software validation

Glanced through the latest FDA warning letters today.  From the FDA Medical Device & Radiological Health Operations West/Division 3 I see the inspector pointing out “This design validation also fails to include software validation [emphasis mine] to assure software will perform as intended and will not prevent safe operation by the user.”   Of course this is straight from the regs – 21CFR820.30(g). Absolutely one must consider the safe and effective operation of the software when making an argument for design validation.  For those of us familiar with software development, we are always skeptical our software will perform as expected under all operating conditions.

So what does FDA expect with regard to software validation?  A common misconception is that software validation is a very comprehensive test that is executed once the final version of software is created. While a comprehensive test is helpful, testing alone is insufficient to give confidence that software is performing according to all specs, meets the users’ expectations, and that defects will not lead to hazardous situations. FDA guidance recommends, and fully expects, an entire software development lifecycle approach to software quality.  Safe and effective software, at a minimum, should include:

  • designed-in risk control measures
  • other operating self checks of hardware and software

Additionally, the software should be developed under appropriate and sufficient process controls throughout the entire lifecycle.  IEC 62304 is an FDA recognized standard for software development process and IEC 80002-1 contains many excellent best practices for medical device software. These two standards are definitely a good start for ensuring the software development lifecycle process being used is state-of-the-art.

Beyond FDA expectations or requirements under ISO standards, each company should develop their own quality standards – remember published standards like IEC 62304 are meant to be the “bar” which in reality is a minimum.  Our goal as software professionals is to create defect-free designs. Go beyond the bar.  Focus on “real” quality – develop appropriate metrics so that it is clear where the process works well and where it is not working well.  As one professional stated, “Own it. Take responsibility for software errors and make the changes necessary to prevent inserting others.

About the author

Partner and General Manager, Brian Pate is ISO 1385:2016 Lead Auditor certified for Medical Device Quality Management Systems (MD), and ISO 19011:2018 Management Systems Auditing (AU) and Leading Management Systems Audit Teams (TL). Brian started his medical device career in anesthesia clinical research in 1985 and has since worked both academia and industry including many years with Johnson & Johnson, Baxter Healthcare, and GE Medical. Brian’s roles have included software engineering, systems engineering, quality assurance, and regulatory affairs. Brian has served on multiple AAMI TIR working groups, including TIR32-2008 (Application of ISO 14971 Risk Management to Software; now IEC 80002-1) and TIR45-2012 (Guidance on the use of Agile practices in the development of medical device software) and served as a reviewer for the 2nd edition of TIR45. Brian serves on the AAMI Software Committee and as an AAMI instructor for the software, design controls, and agile methods courses. Brian also is a member of the Underwriters’ Laboratories (UL) Standards Technical Panel for UL1998 (Software in Programmable Components) and or UL5500 (Remote Software Updates).

SoftwareCPR Training Courses

ISO13485:2016 ISO 13485 Internal Audit(or) Training Course (Live, 3-day)

IEC 62304 and other Emerging Standards Impacting Medical Device Software (Live, 3-day)

Being Agile & Yet CompliantISO 14971 SaMD Risk Management

Software Risk Management

Medical Device Cybersecurity

Software Verification

IEC 62366 Usability Process and Documentation

Or just email training@softwarecpr.com for more info.

Corporate Office

15148 Springview St.
Tampa, FL 33624
USA
+1-781-721-2921
Partners located in the US (CA, FL, MA, MN, TX) and Canada.