Application of Usability Engineering in Medical Device Development - 📚Protocol and📑Report

Usability engineering is an essential discipline in the development of medical devices. It focuses on optimizing the user interface and interaction to ensure safety, effectiveness, and user satisfaction. Usability engineering is applicable throughout the entire lifecycle of a medical device, from initial design and development to post-market surveillance. This approach helps to minimize user errors, enhance patient safety, and improve the overall performance of the medical device in real-world settings.

Key areas of applicability include:

• Design and Development: During the design phase, usability engineering helps to create intuitive and user-friendly interfaces that accommodate the needs of various users, including healthcare professionals and patients.
• Risk Management: Identifying potential usability-related hazards and incorporating mitigations into the design to reduce the risk of user errors.
• Validation and Verification: Conducting usability testing to validate that the device meets user needs and requirements, and verifying that the user interface functions as intended.
• Training and Documentation: Developing comprehensive user manuals and training programs based on usability findings to ensure that users can operate the device safely and effectively.
• Post-Market Surveillance: Continuously monitoring user feedback and incident reports to identify usability issues and implement necessary improvements.

Applicable Standards

Several international standards and guidelines govern the usability engineering process for medical devices. These standards provide a framework for integrating usability engineering into medical device development and ensuring compliance with regulatory requirements.

EC 62366-1 - Medical Devices – Part 1: Application of Usability Engineering to Medical Devices

• This standard specifies a process for manufacturers to analyze, specify, develop, and evaluate the usability of medical devices as it relates to safety.

ISO 14971- Medical Devices – Application of Risk Management to Medical Devices

• While primarily focused on risk management, ISO 14971 emphasizes the importance of considering user-related risks and integrating usability engineering into the risk management process.

ISO/IEC 62304- Medical Device Software – Software Life Cycle Processes

• This standard addresses the software lifecycle and includes requirements for usability engineering in the development of medical device software.

FDA Guidance on Human Factors and Usability Engineering - Applying Human Factors and Usability Engineering to Medical Devices

• This guidance document provides recommendations for incorporating human factors and usability engineering into the design and development of medical devices to ensure they are safe and effective for the intended users.

ISO 9241-210- Ergonomics of Human-System Interaction – Part 210: Human-Centred Design for Interactive Systems

• This standard provides principles and activities for human-centered design, which are applicable to the usability engineering of medical devices.

Key Elements of Usability Engineering

Element	Description
User Research and Analysis
User Profiles	Identifying the characteristics of the end-users, including their needs, limitations, and environments in which the device will be used.
Use Scenarios	Creating detailed scenarios that depict how the device will be used in real-world situations.
Usability Specifications
User Requirements	Defining the requirements based on user research, which guide the design process.
Task Analysis	Breaking down tasks that users will perform with the device to understand potential challenges and design accordingly.
Design and Prototyping
Iterative Design	Developing multiple prototypes and refining them based on user feedback.
Human Factors Engineering	Applying principles of human factors to ensure the device design accommodates human capabilities and limitations.
Usability Testing
Formative Testing	Conducting usability tests during the design process to identify and address issues early.
Summative Testing	Performing final usability tests to ensure the device meets usability requirements and is ready for clinical use.
Risk Management
Hazard Identification	Identifying potential usability-related hazards.
Risk Mitigation	Implementing design changes and controls to mitigate identified risks.

Usability Engineering Process

Step	Description
Planning	Develop a usability engineering plan that outlines the approach, activities, and deliverables.
Context of Use Analysis	Conduct field studies and interviews to understand the environments and conditions in which the device will be used.
User Interface Design	Design the user interface based on user requirements and task analysis. This includes layout, controls, displays, and feedback mechanisms.
Prototyping	Create low-fidelity (paper) and high-fidelity (functional) prototypes to visualize and test design concepts.
Usability Testing	Conduct usability tests with representative users to gather feedback and identify issues. Analyze test results to refine the design.
Validation	Perform final validation to ensure the device meets all usability requirements and regulatory standards.

A Typical Protocol Includes

Usability Engineering Protocol for Medical Devices
1. Introduction

Objective: To define the usability engineering activities necessary to ensure that the medical device is safe, effective, and user-friendly.
Scope: This protocol applies to the design, development, and post-market monitoring of the specified medical device.
2. Regulatory and Standards Compliance
Applicable Standards:IEC 62366-1:2015 – Application of Usability Engineering to Medical Devices
ISO 14971:2019 – Risk Management for Medical Devices
ISO/IEC 62304:2006/Amd 1:2015 – Software Life Cycle Processes
FDA Guidance on Human Factors and Usability Engineering
3. Usability Engineering Plan
Purpose: To outline the usability engineering process, activities, and deliverables.
Content:Project Overview
Objectives and Goals
Usability Engineering Team
Key Milestones and Timeline
Deliverables
4. User Research and Analysis
User Profiles:Identify user groups (e.g., clinicians, patients, caregivers).
Document user characteristics, needs, limitations, and environments.
Use Scenarios:Develop detailed use scenarios based on user profiles.
Include normal and adverse conditions.
5. Usability Specifications
User Requirements:Define usability requirements based on user research.
Prioritize requirements.
Task Analysis:Identify and document tasks users will perform.
Analyze potential challenges and design needs.
6. Design and Prototyping
Iterative Design:Develop initial design concepts and prototypes.
Conduct user feedback sessions and refine designs.
Human Factors Engineering:
Apply principles to optimize user interaction and reduce errors.
7. Usability Testing
Formative Testing:Plan and conduct usability tests during the design phase.
Document findings and iterate design based on feedback.
Summative Testing:Conduct final usability tests to validate design.
Ensure the device meets usability requirements and regulatory standards.
8. Risk Management
Hazard Identification:Identify potential usability-related hazards.
Use techniques such as Failure Modes and Effects Analysis (FMEA).
Risk Mitigation:Implement design changes to address identified risks.
Document risk mitigation strategies and outcomes.
9. Usability Validation
Validation Planning:
Develop a usability validation plan outlining objectives, methods, and criteria.
Execution:Conduct validation tests with representative users.
Collect and analyze data to ensure compliance with usability requirements.
10. Documentation and Reporting
Usability Engineering File:
Compile all usability-related documentation (e.g., plans, research, test results, risk analysis).
Usability Summary Report:Summarize usability engineering activities and outcomes.
Include evidence of compliance with applicable standards and regulations.
11. Post-Market Surveillance
Monitoring:Monitor device performance and user feedback in the market.
Collect data on usability issues and incidents.
Continuous Improvement:Update usability engineering activities based on post-market findings.
Implement design changes as needed to enhance usability.
12. References
List of all relevant standards, guidelines, and regulatory documents referenced in the protocol.
13. Appendices
Supporting documents, templates, and forms used in usability engineering activities.

 A Typical Usability Report Includes

Usability Report for [Medical Device Name]

1. Introduction

• Objective: To document the usability engineering activities conducted for [Medical Device Name] in accordance with relevant standards and guidelines.
• Scope: This report covers user research, design, testing, and validation activities performed to ensure the usability of the medical device.

2. Regulatory Compliance

• Standards and Guidelines:
• IEC 62366-1:2015 – Application of Usability Engineering to Medical Devices
• ISO 14971:2019 – Risk Management for Medical Devices
• FDA Guidance on Human Factors and Usability Engineering
• IEC 60601 series – Medical Electrical Equipment Standards
• Particular Safety Standards relevant to [Medical Device Name]
• Electromagnetic Compatibility (EMC) Standards, including IEC 60601-1-2

3. Usability Engineering Plan

• Document Reference: [Usability Engineering Plan Document]
• Summary: The Usability Engineering Plan outlines the approach, activities, and deliverables for [Medical Device Name].

4. User Research and Analysis

• Document Reference: [User Research Report]
• Summary: User profiles and use scenarios were developed based on field studies and interviews with representative users.

5. Usability Specifications

• Document Reference: [Usability Specifications Document]
• Summary: Usability requirements and task analysis were documented to guide the design and development process.

6. Design and Prototyping

• Document Reference: [Design Concepts and Prototypes]
• Summary: Iterative design and prototyping were conducted to refine the user interface based on user feedback.

7. Risk Management

• Document Reference: [Hazard Analysis and Risk Mitigation Plan]
• Summary: Usability-related hazards were identified and mitigated through design changes and controls.

8. Usability Testing & Validation

• Document Reference: [Usability Validation Plan and Results]
• Summary: Usability validation tests were performed to ensure compliance with usability requirements and regulatory standards.

8.1 Test Environment

• Define the testing environment to closely resemble real-world conditions where the device will be used.
• Consider factors such as lighting, noise, temperature, and space constraints.

8.2. Representative Users

• Select a diverse group of representative users who match the intended user population in terms of demographics, experience, and abilities.
• Ensure that users have varying levels of familiarity with similar devices or technologies.

8.3. Test Scenarios

• Develop realistic test scenarios that reflect typical tasks and workflows performed with the device.
• Include both routine and critical tasks to assess the device's performance under various conditions.

8.4. Usability Metrics

• Define quantitative and qualitative metrics to evaluate usability, such as task success rate, time to complete tasks, error rates, and user satisfaction ratings.
• Use standardized usability scales or questionnaires, such as the System Usability Scale (SUS), to gather subjective feedback from users.

8.5. Performance Measures

• Assess the device's performance in terms of efficiency, effectiveness, and safety.
• Measure the device's ability to accomplish intended tasks accurately and without errors.

8.6. Data Collection Methods

• Employ a combination of observation, task analysis, video recording, and user feedback collection methods to capture usability data.
• Use think-aloud protocols or cognitive walkthroughs to understand users' thought processes and decision-making during task execution.

8.7. Data Analysis

• Analyze collected data to identify usability issues, trends, and patterns.
• Prioritize identified issues based on severity and potential impact on user safety and device effectiveness.

8.8. Iterative Testing

• Conduct iterative usability testing to validate design improvements and refinements made based on earlier test findings.
• Incorporate user feedback and usability recommendations into subsequent design iterations.

9. Electrical Safety Standards and Reports

• Document Reference: [Electrical Safety Standards Compliance Report]
• Summary: [Medical Device Name] complies with relevant Electrical Safety Standards to ensure safe operation and user protection.

10. Particular Safety Standards

• Document Reference: [Particular Safety Standards Compliance Report]
• Summary: [Medical Device Name] adheres to specific safety standards relevant to its intended use and application.

11. EMI/EMC Standards

• Document Reference: [EMI/EMC Compliance Report]
• Summary: [Medical Device Name] meets Electromagnetic Compatibility (EMC) Standards to minimize interference and ensure device reliability.

12. Documentation and Reporting

• Usability Engineering File: [Reference to Usability Engineering File]
• Usability Summary Report: [Reference to Usability Summary Report]

13. Post-Market Surveillance

• Document Reference: [Post-Market Surveillance Plan and Reports]
• Summary: Post-market surveillance activities are ongoing to monitor usability issues and implement continuous improvements.

14. Conclusion

• The usability engineering activities conducted for [Medical Device Name] have ensured that the device meets usability requirements, regulatory standards, and safety considerations.

15. Recommendations

• Based on the findings of usability testing, post-market surveillance, and compliance reports, recommendations are proposed for further enhancing the usability and safety of [Medical Device Name].

16. References

• List of all documents referenced in the Usability Report.

17. Appendices

• Supporting documents, test protocols, compliance reports, and other relevant materials.

Challenges in Usability Engineering

Usability engineering for medical devices faces several challenges, including:

• Complexity: Medical devices are often complex, with multiple functions and modes of operation.
• Diverse User Base: Devices may be used by individuals with varying levels of expertise and experience.
• Regulatory Compliance: Navigating the complex regulatory landscape to ensure compliance with usability standards.