UltraSight AI Guidance
K223347 · Ultrasight, Inc. · QJU · Jul 24, 2023 · Radiology
Device Facts
| Record ID | K223347 |
| Device Name | UltraSight AI Guidance |
| Applicant | Ultrasight, Inc. |
| Product Code | QJU · Radiology |
| Decision Date | Jul 24, 2023 |
| Decision | SESE |
| Submission Type | Traditional |
| Regulation | 21 CFR 892.2100 |
| Device Class | Class 2 |
| Attributes | AI/ML, Software as a Medical Device |
Intended Use
The UltraSight AI Guidance is intended to assist medical professionals (not including expert sonographers) in acquiring cardiac ultrasound images. UltraSight AI Guidance is an accessory to compatible general-purpose diagnostic ultrasound systems. UltraSight AI Guidance is indicated for use in two-dimensional transthoracic echocardiography (2D- TTE) for adult patients, specifically in the acquisition of the following standard views: Parasternal Long-Axis (PLAX), Parasternal Short-Axis at the Aortic Valve (PSAX-AV), Parasternal Short-Axis at the Mitral Valve (PSAX-MV), Parasternal Short-Axis at the Papillary Muscle (PSAX-PM), Apical 4-Chamber (AP4), Apical 5-Chamber (AP5), Apical 2-Chamber (AP2), Apical 3-Chamber (AP3), Subcostal 4-Chamber (SubC4), and Subcostal Inferior Vena Cava (SC-IVC).
Device Story
Mobile application using machine learning/AI to provide real-time guidance for cardiac ultrasound image acquisition; assists non-expert medical professionals in positioning/orienting transducers. Inputs: real-time ultrasound video frames. Processing: deep learning algorithms classify image quality and probe orientation relative to target cardiac views. Outputs: on-screen 3D probe display with graphic cues (rotation, tilt, rock, slide) and real-time quality bar (score for diagnosability). Used in clinical settings with compatible ultrasound systems (e.g., Philips Lumify). Users infer maneuvers from visual cues to achieve diagnostic-quality clips; clips are saved manually via ultrasound interface. Benefits: enables non-experts to acquire diagnostic-quality echocardiographic images, facilitating assessment of LV/RV size/function and pericardial effusion.
Clinical Evidence
Prospective multi-center, multi-case (MRMC) pivotal study (n=240 subjects) compared non-expert users (with AI) vs. sonographers (without AI). Primary endpoints: diagnostic quality for LV/RV size/function and pericardial effusion. Results: non-expert users achieved sufficient visual quality in 93-100% of cases. Secondary endpoints (RV function, LA size, valve structure, IVC size) showed 67-98% success. Pilot study (n=61) showed similar results. Human factors validation confirmed successful completion of critical tasks by intended users.
Technological Characteristics
Software-based accessory for cleared ultrasound systems (e.g., Philips Lumify). Deep learning-based algorithm for real-time guidance and quality assessment. Connectivity: mobile application on tablet (Samsung Tab S6/S7). Software validation per IEC 62304. No hardware components; relies on third-party ultrasound transducer/system.
Indications for Use
Indicated for adult patients undergoing 2D-TTE for acquisition of 10 standard cardiac views (PLAX, PSAX-AV, PSAX-MV, PSAX-PM, AP4, AP5, AP2, AP3, SubC4, SC-IVC). Intended for use by medical professionals excluding expert sonographers.
Regulatory Classification
Identification
A radiological acquisition and/or optimization guidance system is a device that is intended to aid in the acquisition and/or optimization of images and/or diagnostic signals. The device interfaces with the acquisition system, analyzes its output, and provides guidance and/or feedback to the operator for improving image and/or signal quality.
Special Controls
*Classification.* Class II (special controls). The special controls for this device are:(1) Design verification and validation must include:
(i) A detailed, technical device description, including a detailed description of the impact of any software and hardware on the device's functions, the associated capabilities and limitations of each part, and the associated inputs and outputs.
(ii) A detailed, technical report on the non-clinical performance testing of the subject device in the intended use environments, using relevant consensus standards when applicable.
(iii) A detailed report on the clinical performance testing, obtained from either clinical testing, accepted virtual/physical systems designed to capture clinical variability, comparison to a closely-related device with established clinical performance, or other sources that are justified appropriately. The choice of the method must be justified given the risk of the device and the general acceptance of the test methods. The report must include the following:
(A) A thorough description of the testing protocol(s).
(B) A thorough, quantitative evaluation of the diagnostic utility and quality of images/data acquired, or optimized, using the device.
(C) A thorough, quantitative evaluation of the performance in a representative user population and patient population, under anticipated conditions and environments of use.
(D) A thorough discussion on the generalizability of the clinical performance testing results.
(E) A thorough discussion on use-related risk analysis/human factors data.
(iv) A detailed protocol that describes, in the event of a future change, the level of change in the device technical specifications or indications for use at which the change or changes could significantly affect the safety or effectiveness of the device and the risks posed by these changes. The assessment metrics, acceptance criteria, and analytical methods used for the performance testing of changes that are within the scope of the protocol must be included.
(v) Documentation of an appropriate training program, including instructions on how to acquire and process quality images and video clips, and a report on usability testing demonstrating the effectiveness of that training program on user performance, including acquiring and processing quality images.
(2) The labeling required under § 801.109(c) of this chapter must include:
(i) A detailed description of the device, including information on all required and/or compatible parts.
(ii) A detailed description of the patient population for which the device is indicated for use.
(iii) A detailed description of the intended user population, and the recommended user training.
(iv) Detailed instructions for use, including the information provided in the training program used to meet the requirements of paragraph (b)(1)(iv) of this section.
(v) A warning that the images and data acquired using the device are to be interpreted only by qualified medical professionals.
(vi) A detailed summary of the reports required under paragraphs (b)(1)(ii) and (iii) of this section.
(vii) A statement on upholding the As Low As Reasonably Achievable (ALARA) principle with a discussion on the associated device controls/options.
Predicate Devices
- Caption Health's Caption Guidance (DEN190040)
Related Devices
- K251416 — UltraSight Guidance · Ultrasight , Ltd. · Dec 17, 2025
- K200755 — Caption Guidance · Caption Health · Apr 16, 2020
- K243065 — Cardiac Guidance · Caption Health, Inc. · Jan 15, 2025
- K242807 — HeartFocus (V.1.1.1) · Deski · Apr 4, 2025
- DEN190040 — Caption Guidance · Bay Labs, Inc. · Feb 7, 2020
Submission Summary (Full Text)
{0}------------------------------------------------
July 24, 2023
Image /page/0/Picture/1 description: The image contains the logos of the Department of Health and Human Services and the U.S. Food and Drug Administration (FDA). The Department of Health and Human Services logo is on the left, featuring a stylized human figure. To the right is the FDA logo, with the letters "FDA" in a blue square, followed by the words "U.S. FOOD & DRUG ADMINISTRATION" in blue text.
UltraSight Ltd. % Janice Hogan Partner Hogan Lovells US LLP 1735 Market Street, Floor 23 PHILADELPHIA PA 19103
Re: K223347
Trade/Device Name: UltraSight AI Guidance Regulation Number: 21 CFR 892.2100 Regulation Name: Radiological acquisition and/or optimization guidance system Regulatory Class: Class II Product Code: QJU Dated: June 23, 2023 Received: June 23, 2023
Dear Janice Hogan:
We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database located at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.
If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.
Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's
{1}------------------------------------------------
requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801); medical device reporting of medical device-related adverse events) (21 CFR 803) for devices or postmarketing safety reporting (21 CFR 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (OS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR 4, Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050.
Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR Part 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.
For comprehensive regulatory information about mediation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).
Sincerely,
Yanna S. Kang -S
Yanna Kang, Ph.D. Assistant Director Mammography and Ultrasound Team DHT8C: Division of Radiological Imaging and Radiation Therapy Devices OHT8: Office of Radiological Health Office of Product Evaluation and Quality Center for Devices and Radiological Health
Enclosure
{2}------------------------------------------------
# Indications for Use
510(k) Number (if known)
#### K223347
Device Name UltraSight AI Guidance
#### Indications for Use (Describe)
The UltraSight AI Guidance is intended to assist medical professionals (not including expert sonographers) in acquiring cardiac ultrasound images. UltraSight AI Guidance is an accessory to compatible general-purpose diagnostic ultrasound systems. UltraSight Al Guidance is indicated for use in two-dimensional transthoracic echocardiography (2D- TTE) for adult patients, specifically in the acquisition of the following standard views: Parasternal Long-Axis (PLAX), Parasternal Short-Axis at the Aortic Valve (PSAX-AV), Parasternal Short-Axis at the Mitral Valve (PSAX-MV), Parasternal Short-Axis at the Papillary Muscle (PSAX-PM), Apical 4-Chamber (AP4), Apical 5-Chamber (AP2), Apical 2-Chamber (AP2), Apical 3-Chamber (AP3), Subcostal 4-Chamber (SubC4), and Subcostal Inferior Vena Cava (SC-IVC).
X Prescription Use (Part 21 CFR 801 Subpart D)
Over-The-Counter Use (21 CFR 801 Subpart C)
#### CONTINUE ON A SEPARATE PAGE IF NEEDED.
This section applies only to requirements of the Paperwork Reduction Act of 1995.
#### *DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.*
The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:
> Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff(@fda.hhs.gov
"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."
{3}------------------------------------------------
#### 510(k) SUMMARY UltraSight's UltraSight Al Guidance
K223347
### Applicant name: UltraSight Ltd.
8 Pinhas Sapir St. Ness Ziona 7403631 Israel Phone: +1-724-648-3514 Email: info@ultrasight.com Contact Person: Davidi Vortman Date Prepared: July 19, 2023
Name of Device: UltraSight AI Guidance
Classification Name: Image Acquisition And/Or Optimization Guided By Artificial Intelligence
Classification Code: QJU
Device class: II
Regulation number: 892.2100
Panel: Radiology
Predicate Devices: Caption Health's Caption Guidance (DEN190040)
#### Intended Use / Indications for Use
The UltraSight Al Guidance is intended to assist medical professionals (not including expert sonographers) in acquiring cardiac ultrasound images. UltraSight Al Guidance is an accessory to compatible general-purpose diagnostic ultrasound systems. UltraSight Al Guidance is indicated for use in two-dimensional transthoracic echocardiography (2D- TTE) for adult patients, specifically in the acquisition of the following standard views: Parasternal Long-Axis (PLAX), Parasternal Short-Axis at the Aortic Valve (PSAX-AV), Parasternal Short-Axis at the Mitral Valve (PSAX-MV), Parasternal Short-Axis at the Papillary Muscle (PSAX-PM), Apical 4-Chamber (AP4), Apical 5-Chamber (AP5), Apical 2-Chamber (AP2), Apical 3-Chamber (AP3), Subcostal 4-Chamber (SubC4), and Subcostal Inferior Vena Cava (SC-IVC).
#### Device Description
UltraSight Al Guidance is a mobile application based on machine learning that uses artificial intelligence (AI) to provide dynamic real-time guidance on the position and orientation of the transducer to help non-expert users acquire diagnostic-quality tomographic views of the system provides guidance for ten standard cardiac views.
{4}------------------------------------------------
Main features:
- Quality Bar: The system displays an image quality bar that is continuously updated while the user scans the subject, while attempting to find the maximal quality bar is a score for image diagnosability. It represents the classification between high and low quality images, where high quality images are defined as grade 3 or more based on ACEP guidelines (Rachel B. Liu et al., "Emergency Ultrasound Standard Reporting Guidelines", 2018, American College of Emergency Physicians).
- · View Detection: The system differentiates between three states, and the display adjusts accordingly:
- No heart heart is not visible, the user is expected to first find the acoustic window 1. where some heart tissue is visible and then follow the navigation instructions.
- Navigate the quality bar is below 8 bars, the heart is visible, the user should watch the 2. guidance cues and move the probe accordingly.
- 3. Hold position the quality bar has reached 8 bars (or more), the tail of the probe turns green, and the user should record a clip. Saving a clip functionality is not part of the UltraSight Al system; the user saves the clip manually using the Lumify interface.
- · Probe Guidance: The probe guidance feature provides graphic on-screen instructions for the user to emulate how a sonographer would manipulate the transducer to acquire the target cardiac view. The five possible guidance cues, rotation, tilt, rock, and slides in the lateralmedial and up/down (with respect to the subjects' head) directions.
The guidance user interface is composed of a 3D probe display that shows orientation guidance cues (rotations, tilts and rocks) and a cross that shows slide guidance cues (slides in x and y directions) The user infers the maneuver they should perform from viewing the 3D probe display and the slides cross. No explicit text messages appear on the screen regarding guidance cues.
# Technological Characteristics
The UltraSight AI Guidance software application is similar in its technological features to its predicate device, the Caption Health's Caption Guidance (DEN190040). Both systems are intended as an assistive tool to aid medical professionals in the acquisition of cardiac ultrasound images. Specifically, both systems are indicated to aid in the acquisition of the following standard views: Parasternal Long-Axis (PLAX), Parasternal Short-Axis at the Aortic Valve (PSAX-AV), Parasternal Short-Axis at the Mitral Valve (PSAX-MV), Parasternal Short-Axis at the Papillary Muscle (PSAX-PM), Apical 4-Chamber (AP4), Apical 5-Chamber (AP5), Apical 2-Chamber (AP2), Apical 3-Chamber (AP3), Subcostal 4-Chamber (SubC4), and Subcostal Inferior Vena Cava (SC-IVC). Both systems are software applications that apply deep learning-based algorithm to emulate the expertise of a sonographer by providing real-time guidance on how to position and manipulate the transducer on a patient's body. Both systems are installed on a third-party, previously cleared ultrasound device. There are minor technological differences between the subject and the predicate device, mainly the ultrasound device with which the software interfaces and few features offered by the predicate device and not by the subject device (auto capture and save best clip). However, as explained in more detail
{5}------------------------------------------------
below, these differences do not raise new or different questions of safety or effectiveness since the principal technology remains very similar and, in both instances, the key question is whether the device enables the intended users to acquire limited (10-view) 2D transthoracic echocardiography (2D-TTE) in diagnostic quality. The clinical and human factors validation demonstrated that the use of the UltraSight Al Guidance, by users with no prior scanning experience, enabled users to acquire limited (10-view) 2D transthoracic echocardiography (2D-TTE) with similar performance as the predicate device.
A table comparing the key features of the subject and the predicate devices is provided below:
| Parameters | Caption Guidance<br>DEN190040 | Proposed UltraSight Al<br>Guidance | Conclusion |
|--------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Classification<br>name | Image Acquisition And/ Or<br>Optimization Guided By<br>Artificial Intelligence | Image Acquisition And/ Or<br>Optimization Guided By<br>Artificial Intelligence | Identical |
| Product Code | QJU | QJU | Identical |
| Intended Use | The Caption Guidance<br>software is intended to<br>assist medical<br>professionals in the<br>acquisition of cardiac<br>ultrasound images.<br>Caption Guidance<br>software is an accessory<br>to compatible general<br>purpose diagnostic<br>ultrasound systems | The UltraSight Al<br>Guidance software is<br>intended to assist medical<br>professionals in the<br>acquisition of cardiac<br>ultrasound images.<br>UltraSight Al Guidance<br>software is an accessory<br>to compatible general<br>purpose diagnostic<br>ultrasound systems | Identical |
| Indications for | Caption Guidance | UltraSight Al Guidance | Similar |
| use | software is indicated for<br>use in two-dimensional<br>transthoracic<br>echocardiography (2D-<br>TTE) for adult patients,<br>specifically in the<br>acquisition of the following<br>standard views:<br>Parasternal Long-Axis<br>(PLAX), Parasternal<br>Short-Axis at the Aortic<br>Valve (PSAX-AV),<br>Parasternal Short-Axis at<br>the Mitral Valve (PSAX-<br>MV), Parasternal Short-<br>Axis at the Papillary<br>Muscle (PSAX-PM),<br>Apical 4-Chamber (AP4) | software is indicated for<br>use in two-dimensional<br>transthoracic<br>echocardiography (2D-<br>TTE) for adult patients,<br>specifically in the<br>acquisition of the following<br>standard views:<br>Parasternal Long-Axis<br>(PLAX), Parasternal<br>Short-Axis at the Aortic<br>Valve (PSAX-AV),<br>Parasternal Short-Axis at<br>the Mitral Valve (PSAX-<br>MV), Parasternal Short-<br>Axis at the Papillary<br>Muscle (PSAX-PM),<br>Apical 4-Chamber (AP4) | Since the use of the<br>UltraSight Al Guidance<br>and its impact to expert<br>sonographers has not<br>been evaluated, this<br>users' population is<br>excluded from the device's<br>intended users. |
| Parameters | Caption Guidance<br>DEN190040 | Proposed UltraSight Al<br>Guidance | Conclusion |
| | Apical 2-Chamber (AP2),<br>Apical 3-Chamber (AP3),<br>Subcostal 4-Chamber<br>(SubC4), and Subcostal<br>Inferior Vena Cava (SC-<br>IVC). | Apical 2-Chamber (AP2),<br>Apical 3-Chamber (AP3),<br>Subcostal 4-Chamber<br>(SubC4), and Subcostal<br>Inferior Vena Cava (SC-<br>IVC).<br>The UltraSight Al<br>Guidance is not intended<br>to be used by<br>Sonographers. | |
| Intended user | Medical professionals<br>(including expert<br>sonographers) | Medical professionals (not<br>including expert<br>sonographers) | Substantially Equivalent:<br>It should be noted that<br>the intended users'<br>population of the<br>UltraSight Al Guidance is<br>slightly narrower than the<br>predicate and does not<br>include sonographers.<br>However, the intended<br>user population of the<br>UltraSight Al Guidance is<br>a subset of the broader<br>user population for the<br>predicate; thus, the<br>intended use and<br>indications are fully<br>encompassed within the<br>predicate indications.<br>Therefore, the first<br>criterion for a finding of<br>substantial equivalence<br>is satisfied. |
| Compatible<br>Ultrasound<br>system and<br>probe | The uSmart 3200t Plus<br>ultrasound system with the<br>3200t-compatible Terason<br>4V2A linear phased array<br>probe | Philips Lumify With S4-1<br>probe and Samsung Tab<br>S6 and S7 tablets | Substantially Equivalent:<br>Both the predicate device<br>and the proposed device<br>function as a software<br>accessory to a cleared to<br>market ultrasound device.<br>Both ultrasound devices<br>are cleared for the<br>diagnostic ultrasound<br>clinical application of<br>acquiring cardiac images |
| Parameters | Caption Guidance<br>DEN190040 | Proposed UltraSight Al<br>Guidance | Conclusion |
| | | | of adult patients. Since<br>both ultrasound devices<br>are cleared for the<br>required clinical use, the<br>use of different ultrasound<br>devices does not raise<br>new questions of safety<br>and/or effectiveness. |
| Clinical Features | | | |
| Image<br>acquisition<br>guidance | Prescriptive Guidance:<br>The prescriptive guidance<br>feature in Caption<br>Guidance provides<br>direction to the user to<br>emulate how a<br>sonographer would<br>manipulate the transducer<br>to acquire the optimal view | Probe Guidance: The<br>probe guidance feature<br>provides graphic on-<br>screen instructions for<br>the user to emulate how<br>a sonographer would<br>manipulate the<br>transducer to acquire the<br>target cardiac view. | Substantially Equivalent:<br>While the user interface is<br>slightly different, the<br>functionality and type of<br>guidance provided to the<br>user will be the same.<br>Specifically, both devices<br>provide to the user<br>instructions on how to<br>manipulate the probe<br>(translational, tilt and<br>rotation guidance cues)<br>together with real-time<br>feedback on the<br>expected diagnostic<br>quality of the resulting clip<br>to direct the user to a<br>probe position that will<br>enable acquisition of a<br>diagnostic quality clip.<br>Hence, this difference<br>does not raise new<br>questions of safety and/or<br>effectiveness. |
| Real time<br>feedback on<br>image quality | Quality Meter: a real-time<br>feedback from the Quality<br>Meter advises the user on<br>the expected diagnostic<br>quality of the resulting clip,<br>such that the user can<br>make decisions to further<br>optimize the quality, for<br>example by following the<br>prescriptive guidance | Quality Bar: a real-time<br>quality bar providing<br>feedback on the clip's<br>quality advises the user on<br>the expected diagnostic<br>quality of the current<br>image. This information<br>can be used by the users<br>to assess how close they<br>are to capturing a | Substantially Equivalent |
| Parameters | Caption Guidance<br>DEN190040 | Proposed UltraSight Al<br>Guidance | Conclusion |
| | | | |
| Automatic<br>capture of clips<br>with predicted<br>diagnostic<br>quality | Auto-Capture: The<br>Caption Guidance Auto-<br>Capture feature triggers<br>an automatic capture of a<br>clip when the quality is<br>predicted to be diagnostic,<br>emulating the way in<br>which a sonographer<br>knows when an image is<br>of sufficient quality to be<br>diagnostic and records it. | None | Substantially Equivalent:<br>This feature is not<br>provided; the UltraSight<br>software provides to the<br>user the view detection<br>and quality bar features<br>which enable any user to<br>clearly identify when a<br>diagnostic quality image<br>has been achieved and to<br>manually save the clip. |
| Retrospectively<br>recording of<br>highest quality<br>clip | Save Best Clip: This<br>feature continually<br>assesses clip quality while<br>the user is scanning and,<br>in the event that the user<br>is not able to obtain a clip<br>sufficient for Auto-<br>Capture, the software<br>allows the user to<br>retrospectively record the<br>highest quality clip<br>obtained so far, mimicking<br>the choice a sonographer<br>might make when<br>recording an exam. | None | Substantially Equivalent:<br>Although this feature is not<br>provided, the<br>UltraSight software<br>provides to the user the<br>view detection and quality<br>bar features which enable<br>any user to clearly identify<br>when a diagnostic quality<br>has been achieved and to<br>manually save the clip. |
| Deep Learning<br>Based<br>Algorithm | Yes | Yes | Substantially Equivalent |
{6}------------------------------------------------
{7}------------------------------------------------
{8}------------------------------------------------
# Substantial Equivalence
The UltraSight AI Guidance is as safe and effective as the Caption Health's Caption Guidance. The UltraSight Al Guidance has the same intended uses and indications for use and similar technological characteristics, and principles of operation as its predicate device. The minor technological differences between the UltraSight Al Guidance and its predicate device raise no new issues of safety or effectiveness. Performance data demonstrate that the UltraSight Al Guidance is as safe and effective as Caption Health's Caption Guidance. Thus, UltraSight Al Guidance is substantially equivalent to Caption Health's Caption Guidance.
{9}------------------------------------------------
### Non-Clinical Performance Data
The following testing was conducted to evaluate the device:
- 1. Software moderate level of concern verification and validation testing was conducted as required by IEC 62304 and FDA Guidance on General Principles of Software Validation, January 11, 2002.
- 2. UltraSight AI Guidance Algorithms' standalone performance was validated with a number of standalone performance tests, see detailed description below.
- 3. Human factors Validation: the system was validated with intended users in simulated use conditions to ensure the user needs and intended use requirements were met. All tasks, including a critical task, were met and no new issues of safety or effectiveness were raised.
# Non-Clinical Standalone Performance Testing of AI algorithms
The Datasets used for algorithm development and performance testing are listed in Table 1:
#### Table 1: Data used for Algorithm Development and Performance Testing
| Phase | Algorithm development | Performance tests for Quality Bar | Performance test for View<br>Detection and Guidance tests |
|-----------------------|------------------------------------------|-----------------------------------|-----------------------------------------------------------|
| Number of<br>subjects | 580 | 312 | 75 |
| Number of<br>samples | 5 million frames<br>of ultrasound images | 5,800 clips | 2.3 million frames<br>of ultrasound images |
The data used for performance testing was collected at different sites, geographically separated, from the sites used for collection of the algorithm development data. The data used in the performance testing was collected from a population representative to the intended population.
#### Performance Tests Overview
The following features of the system were tested:
- Quality bar .
- View detection (part of the quality bar functionality as explained below) ●
- Probe Guidance ●
Each feature of the system (Quality Bar, View Detection, Probe Guidance) was tested independently.
{10}------------------------------------------------
# Quality Bar:
The quality bar is a score for image diagnosability. It represents the classification between high- and low-quality images, where high quality images are defined as grade 3 or more based on ACEP quidelines.
The test was performed on 312 clips. Each clip in the dataset is associated with a target cardiac view and was annotated with a clip diagnosability label (diagnosable / non-diagnosable), by three cardiologists.
The test assessed the classification performance between "diagnosable" clips of each view. The mean AUC was 0.86 with 95% Cl [0.85, 0.87] showing good classification performance, relative to the success criteria of AUC > 0.8. The mean PPV was 0.93 with 95% CI [0.92, 0.94] relative to the success criteria of PPV > 0.75, showing good classification performance. Stratified analysis was performed, for each target cardiac view the AUC was greater than 0.8, and the PPV was above 0.75.
### View Detection:
The system provides view detection classification that distinguishes between three system states: "Hold Position", "Navigate", and "No Heart". The test was performed on 75 subjects on a total of 2.3 million frames of ultrasound images.
The view detection classification performance is quantified for the classification tasks of "Hold position" vs. "Navigate" and "Hold position" vs. "No heart". The ground truth labels were defined on the frame level using annotation of expert sonographers. The mean AUC was 0.988 with 95% Cl (0.985, 0.990) showing good classification performance, relative to the success criteria of AUC > 0.8. Stratified analysis was performed and showed that for each individual binary classification test the AUC was above 0.8.
# Probe Guidance:
The system provides guidance cues when the heart is visible on the ultrasound image. To provide the correct guidance cues, the system needs to be able to identify the position and orientation of the probe relative to the target cardiac view. There are five possible guidance cues: rotations, tilts, rocks, and slides in the x (lateral-medial) and y (superior-inferior) directions.
The testing was performed on 75 subjects on a total of 2.3 million frames of ultrasound images. The testing evaluated the frame level accuracy of each guidance cue prediction. For each quidance cue, a series of tests was defined to check if the guidance cue is functioning correctly in a particular direction (for example, clockwise rotative to 2C view, tilts up from PLAX). Each test was formulated as a binary classification test.
The mean AUC was 0.821 with 95% Cl [0.813, 0.827] showing good classification performance, relative to the success criteria of AUC > 0.8. Stratified tests show that individual classifiers have reasonable discrimination ability, and acceptable classifiers.
{11}------------------------------------------------
### Human factors Validation:
The UltraSight AI Guide application underwent summative usability validation in accordance with the FDA Guidance Document, "Applying Human Factors and Usability Engineering to Medical Devices" (2016). All user tasks associated with the device were evaluated and critical tasks were identified for usability evaluation, where if performed incorrectly or not performed at all would or could cause serious harm. All participants successfully completed the testing sessions and performed the critical task identified in the study without any use errors, close calls, or other issues.
Based on the results of the summative usability validation, it can be concluded that the UltraSight Al Guide application is deemed adequately safe and effective for its intended users, uses, and use environments.
### Clinical Performance Data
### Pilot Study
A prospective single center, multi-case (MRMC) study, primarily designed to obtain the quality of the clips obtained by medical professionals without specialized echocardiography training (non-expert users) when using the Ultrasound Al was conducted. Sixty-one (61) subjects were scanned twice, once by a non-expert user, using Philips Lumify with the UltraSight Al guidance; and, by a cardiac sonographer using the Philips Lumify hardware but without Al guidance. The clips acquired during those scans were reviewed by a panel of 5 expert cardiologists blinded to whether the clip was acquired by a non-expert user or a sonographer and to each other's evaluations. The cardiologists assessed whether the non-expert users' scans were of sufficient quality for the expert readers to make qualitative visual assessment of left ventricular (LV) size, LV function, right ventricular (RV) size, and the presence of nontrivial pericardial effusion. Six additional echocardiographic parameters were visually assessed as secondary endpoints: qualitative assessment of RV function; left atrium size; structural assessment of the aortic, mitral, and tricuspid valves; and qualitative assessment of IVC size.
The exams performed by the non-expert users had sufficient visual quality in 100% of cases based on majority agreement to assess LV size and function, RV size, and pericardial effusion. For the secondary endpoints, the exams performed by non-expert users had sufficient visual quality based on majority in 90-100% of cases to assess RV function, left atrium size, AV structure, MV structure, TV structure, and IVC size. Furthermore, the exams performed by non-expert users had sufficient diagnostic quality based on majority in 80% to 100% of cases to assess PLAX, PSAX MV, PSAX PM, AP2, AP3, AP5, Sub4C and SC-IVC. In addition, most clips (range 78.6-97.9%) taken by the non-expert users had a diagnostic quality score of 3 of higher based on American College of Emergency Physicians (ACEP) scale.
# Pivotal Study
A prospective multi-center, multi-case (MRMC) pivotal clinical study was conducted to evaluate the use of UltraSight Al Guidance by medical professionals without specialized echocardiography training (non-expert/novice users).
{12}------------------------------------------------
A total of 240 subjects were scanned twice, once by a non-expert user, using the Philips Lumify with the UltraSight AI guidance; and, by a cardiac sonographer using the Philips Lumify hardware but without AI quidance. The clips acquired during the scans were reviewed by a panel of 5 expert cardiologists blinded to whether the clip was acquired by a non-expert user or a sonographer and to each other's evaluations. The cardiologists assessed whether the non-expert users' scans were of sufficient quality for the expert readers to make qualitative visual assessment of left ventricular (LV) size, LV function, right ventricular (RV) size, and the presence of nontrivial pericardial effusion. Six additional echocardiographic parameters were visually assessed as secondary endpoints: qualitative assessment of RV function; left atrium size; structural assessment of the aortic, mitral, and tricuspid valves; and qualitative assessment of IVC size. For the 4 co-primary endpoints, the non-expert users' scans were judged to have adequate visual quality on the majority agreement to assess the clinical parameters in nearly all subjects, in 93-100% of cases. For the secondary endpoints, the percentage of exams performed by non-expert users that had sufficient visual quality based on majority agreement was 98% for MV structure, 94% for RV function and left atrium size, 89% for AV structure, 74% for TV structure, and 67% for IVC size. Assessment of intra-cardiologists' variability using Cohen's kappa coefficient (k) was assessed on a randomly selected 10% of the examinations on which a repeated assessment was performed. There was very good agreement among the cardiologists when assessing the primary endpoints. The results of the study showed that exams performed by non-expert users using the UltraSight Al Guidance Software can provide clips with sufficient diagnostic quality even immediately upon completion of training.
# Conclusions
The UltraSight Al Guidance is substantially equivalent to Caption Guidance. The UltraSight Al Guidance has the same intended use and indications for use and similar technological characteristics, and principles of operation as its predicate device. The minor technological differences between the UltraSight Al Guidance and its predicate device raise no new issues of safety or effectiveness. Non-clinical and clinical performance data demonstrate that the UltraSight Al Guidance performs as expected and in a manner that is substantially equivalent to its predicate device. Thus, the UltraSight Al Guidance is substantially equivalent.