EFAI ChestSuite XR Pleural Effusion Assessment System

K222076 · Ever Fortune.Ai, Co., Ltd. · QFM · Sep 8, 2022 · Radiology

Device Facts

• Record ID: K222076
• Device Name: EFAI ChestSuite XR Pleural Effusion Assessment System
• Applicant: Ever Fortune.Ai, Co., Ltd.
• Product Code: QFM · Radiology
• Decision Date: Sep 8, 2022
• Decision: SESE
• Submission Type: Traditional
• Regulation: 21 CFR 892.2080
• Device Class: Class 2
• Attributes: AI/ML, Software as a Medical Device

Intended Use

EFAI Chestsuite XR Pleural Effusion Assessment System is a software workflow tool designed to aid the clinical assessment of adult (18 years of age or older) Chest X-Ray cases with features suggestive of pleural effusion in the medical care environment. EFAI Chestsuite XR Pleural Effusion Assessment System analyzes cases using an artificial intelligence algorithm to identify suspected findings on chest x-ray images taken in PA position. It makes case-level output available to a PACS/workstation for worklist prioritization or triage. EFAI Chestsuite XR Pleural Effusion Assessment System is not intended to direct attention to specific portions or anomalies of an image. Its results are not intended to be used on a stand-alone basis for clinical decision-making nor is it intended to rule out pleural effusion or otherwise preclude clinical assessment of X-Ray cases.

Device Story

EFAI ChestSuite XR Pleural Effusion Assessment System is a software-only radiological triage tool. It ingests DICOM PA chest X-ray images; applies filtering rules; normalizes image size and contrast; and uses a deep learning algorithm to identify suspected pleural effusion. The system outputs a case-level notification to a PACS/workstation for worklist prioritization. It does not highlight specific image regions. Deployed on a specialized server within a local hospital network, it is operated by radiologists to assist in workflow management. By prioritizing cases with suspected findings, it aims to expedite clinical review and improve patient care. It is not a diagnostic device and does not replace clinical assessment.

Clinical Evidence

Performance validated via retrospective non-clinical and clinical standalone testing. Non-clinical: 1,454 images (AUC 0.9517, sensitivity 0.9013, specificity 0.8869). Clinical standalone: 600 anonymized chest X-rays (286 positive, 314 negative) from 15+ scanner manufacturers. Results: AUC 0.9712 (95% CI 0.9538-0.9885), sensitivity 0.9510 (95% CI 0.9195-0.9706), specificity 0.9745 (95% CI 0.9505-0.9870). Average processing time 19.6 seconds. Subgroup analysis confirmed consistent performance across gender, data source, and scanner type.

Technological Characteristics

Software-only device; operates on specialized servers (physical or virtual). Inputs: DICOM PA chest X-rays. Processing: Deep learning algorithm, image normalization (size/contrast). Output: JSON notification to PACS/workstation. Complies with IEC 62304:2006/A1:2016. Deployed as a Docker container.

Indications for Use

Indicated for adult patients (18+ years) undergoing PA chest X-ray examinations to aid in the clinical assessment of pleural effusion. Not for stand-alone diagnostic use; not intended to rule out pleural effusion or preclude clinical assessment.

Regulatory Classification

Identification

Radiological computer aided triage and notification software is an image processing prescription device intended to aid in prioritization and triage of radiological medical images. The device notifies a designated list of clinicians of the availability of time sensitive radiological medical images for review based on computer aided image analysis of those images performed by the device. The device does not mark, highlight, or direct users' attention to a specific location in the original image. The device does not remove cases from a reading queue. The device operates in parallel with the standard of care, which remains the default option for all cases.

Special Controls

Radiological computer aided triage and notification software must comply with the following special controls: 1. Design verification and validation must include: i. A detailed description of the notification and triage algorithms and all underlying image analysis algorithms including, but not limited to, a detailed description of the algorithm inputs and outputs, each major component or block, how the algorithm affects or relates to clinical practice or patient care, and any algorithm limitations. ii. A detailed description of pre-specified performance testing protocols and dataset(s) used to assess whether the device will provide effective triage (e.g., improved time to review of prioritized images for pre-specified clinicians). iii. Results from performance testing that demonstrate that the device will provide effective triage. The performance assessment must be based on an appropriate measure to estimate the clinical effectiveness. The test dataset must contain sufficient numbers of cases from important cohorts (e.g., subsets defined by clinically relevant confounders, effect modifiers, associated diseases, and subsets defined by image acquisition characteristics) such that the performance estimates and confidence intervals for these individual subsets can be characterized with the device for the intended use population and imaging equipment. iv. Standalone performance testing protocols and results of the device. v. Appropriate software documentation (e.g., device hazard analysis; software requirements specification document; software design specification document; traceability analysis; description of verification and validation activities including system level test protocol, pass/fail criteria, and results). 2. Labeling must include the following: i. A detailed description of the patient population for which the device is indicated for use. ii. A detailed description of the intended user and user training that addresses appropriate use protocols for the device. iii. Discussion of warnings, precautions, and limitations must include situations in which the device may fail or may not operate at its expected performance level (e.g., poor image quality for certain subpopulations), as applicable. iv. A detailed description of compatible imaging hardware, imaging protocols, and requirements for input images. v. Device operating instructions. vi. A detailed summary of the performance testing, including: test methods, dataset characteristics, triage effectiveness (e.g., improved time to review of prioritized images for pre-specified clinicians), diagnostic accuracy of algorithms informing triage decision, and results with associated statistical uncertainty (e.g., confidence intervals), including a summary of subanalyses on case distributions stratified by relevant confounders, such as lesion and organ characteristics, disease stages, and imaging equipment.

*Classification.* Class II (special controls). The special controls for this device are:(1) Design verification and validation must include: (i) A detailed description of the notification and triage algorithms and all underlying image analysis algorithms including, but not limited to, a detailed description of the algorithm inputs and outputs, each major component or block, how the algorithm affects or relates to clinical practice or patient care, and any algorithm limitations. (ii) A detailed description of pre-specified performance testing protocols and dataset(s) used to assess whether the device will provide effective triage ( *e.g.,* improved time to review of prioritized images for pre-specified clinicians).(iii) Results from performance testing that demonstrate that the device will provide effective triage. The performance assessment must be based on an appropriate measure to estimate the clinical effectiveness. The test dataset must contain sufficient numbers of cases from important cohorts ( *e.g.,* subsets defined by clinically relevant confounders, effect modifiers, associated diseases, and subsets defined by image acquisition characteristics) such that the performance estimates and confidence intervals for these individual subsets can be characterized with the device for the intended use population and imaging equipment.(iv) Stand-alone performance testing protocols and results of the device. (v) Appropriate software documentation ( *e.g.,* device hazard analysis; software requirements specification document; software design specification document; traceability analysis; description of verification and validation activities including system level test protocol, pass/fail criteria, and results).(2) Labeling must include the following: (i) A detailed description of the patient population for which the device is indicated for use; (ii) A detailed description of the intended user and user training that addresses appropriate use protocols for the device; (iii) Discussion of warnings, precautions, and limitations must include situations in which the device may fail or may not operate at its expected performance level ( *e.g.,* poor image quality for certain subpopulations), as applicable;(iv) A detailed description of compatible imaging hardware, imaging protocols, and requirements for input images; (v) Device operating instructions; and (vi) A detailed summary of the performance testing, including: test methods, dataset characteristics, triage effectiveness ( *e.g.,* improved time to review of prioritized images for pre-specified clinicians), diagnostic accuracy of algorithms informing triage decision, and results with associated statistical uncertainty (*e.g.,* confidence intervals), including a summary of subanalyses on case distributions stratified by relevant confounders, such as lesion and organ characteristics, disease stages, and imaging equipment.

Predicate Devices

• HealthCXR (K192320)

Submission Summary (Full Text)

{0}------------------------------------------------

Image /page/0/Picture/0 description: The image shows the logo of the U.S. Food and Drug Administration (FDA). The logo consists of two parts: a symbol on the left and the text "FDA U.S. FOOD & DRUG ADMINISTRATION" on the right. The symbol on the left is a stylized image of a human figure, and the text on the right is in blue. The logo is simple and clean, and it is easily recognizable.

Ever Fortune.AI Co., Ltd. Ti-Hao Wang Chief Technology Officer Rm. D. 8 F., No. 573, Sec. 2, Taiwan Blvd., West Dist. Taichung City, 403020 TAIWAN

September 8, 2022

#### Re: K222076

Trade/Device Name: EFAI ChestSuite XR Pleural Effusion Assessment System Regulation Number: 21 CFR 892.2080 Regulation Name: Radiological computer aided triage and notification software Regulatory Class: Class II Product Code: QFM Dated: July 13, 2022 Received: July 14, 2022

Dear Ti-Hao Wang:

We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database located at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.

If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.

Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801); medical device reporting of medical device-related adverse events) (21 CFR 803) for

{1}------------------------------------------------

devices or postmarketing safety reporting (21 CFR 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR 4, Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050.

Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR Part 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.

For comprehensive regulatory information about medical devices and radiation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email ([e-mail]) or phone [phone] or 301-796-7100).

Sincerely,

Jessica Lamb, Ph.D. Assistant Director Imaging Software Team DHT8B: Division of Radiological Imaging Devices and Electronic Products OHT8: Office of Radiological Health Office of Product Evaluation and Quality

Enclosure

{2}------------------------------------------------

Image /page/2/Picture/0 description: The image contains a logo for a company called EVER FORTUNE.AI. The logo consists of a stylized human figure with a globe-like structure on top, both in a teal color. The text "EVER FORTUNE.AI" is written in a teal sans-serif font to the right of the figure. The word "FORTUNE" has a globe-like structure in place of the letter "O".

# Section 4. Indications for Use Statement (Form FDA 3881)

{3}------------------------------------------------

Image /page/3/Picture/0 description: The image shows the logo for Ever Fortune AI. The logo consists of a stylized teal figure with a green globe on top, followed by the text "EVER" in teal, and "FORTUNE.AI" in a smaller teal font below. The globe on top of the figure has a network pattern on it.

DEPARTMENT OF HEALTH AND HUMAN SERVICES Food and Drug Administration

#### Indications for Use

Form Approved: OMB No. 0910-0120 Expiration Date: 06/30/2023 See PRA Statement below.

510(k) Number (if known) K222076

Device Name

EFAI Chestsuite XR Pleural Effusion Assessment System

#### Indications for Use (Describe)

EF AI Chestsuite XR Pleural Effusion Assessment System is a software workflow tool designed to aid the clinical assessment of adult (18 years of age or older) Chest X-Ray cases with features suggestive of pleural efflusion in the medical care environment. EFAI Chestsuite XR Pleural Effusion Assessment System analyzes cases using an artificial intelligence algorithm to identify suspected findings on chest x-ray images taken in PA position. It makes case-level output available to a PACS/workstation for worklist prioritization or triage. EFAI Chestsuite XR Pleural Effusion Assessment System is not intended to direct attention to specific portions or anomalies of an image. Its results are not intended to be used on a stand-alone basis for clinical decision-making nor is it intended to rule out pleural effusion or otherwise preclude clinical assessment of X-Ray cases.

Type of Use (Select one or both, as applicable) > Prescription Use (Part 21 CFR 801 Subpart D) Over-The-Counter Use (21 CFR 801 Subpart C) CONTINUE ON A SEPARATE PAGE IF NEEDED. This section applies only to requirements of the Paperwork Reduction Act of 1995. *DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW." The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to: Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff(@fda.hhs.gov "An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number." FORM FDA 3881 (6/20) Page 1 of 1 PSC Publishing Services [phone]

{4}------------------------------------------------

Image /page/4/Picture/0 description: The image shows the logo for Ever Fortune AI. The logo consists of a stylized human figure in teal with a green circle on top of its head. The circle contains a network of white dots and lines. To the right of the figure is the text "EVER FORTUNE.AI" in teal.

# 510(k) Summary

# (K222076)

EFAI Chestsuite XR Pleural Effusion Assessment System Traditional 510(k)

{5}------------------------------------------------

Image /page/5/Picture/0 description: The image contains a logo for Ever Fortune AI. The logo consists of a stylized figure in teal with a green globe on top, and the text "EVER FORTUNE.AI" in teal to the right of the figure. The "O" in FORTUNE is replaced with a smaller version of the globe.

#### Section 5. 510(k) Summary

## 1. General Information

| 510(k) Sponsor | Ever Fortune.AI Co., Ltd. |
|-----------------------|-----------------------------------------------------------------------------------------|
| Address | Rm. D, 8F. No. 573, Sec. 2 Taiwan Blvd.<br>West Dist.<br>Taichung City 403020<br>TAIWAN |
| Applicant | Joseph Chang |
| Contact Information | 886-04-23213838 #216<br>[e-mail] |
| Correspondence Person | Ti-Hao Wang, MD |
| Contact Information | 886-04-23213838 #168<br>[e-mail] |
| Date Prepared | July 13, 2022 |

### 2. Proposed Device

| Proprietary Name | EFAI ChestSuite XR Pleural Effusion Assessment System |
|---------------------|--------------------------------------------------------------------|
| Common Name | EFAI PUEXR v1.0 |
| Classification Name | Radiological Computer-Assisted Prioritization Software For Lesions |
| Regulation Number | 21 CFR 892.2080 |
| Regulation Name | Radiological Computer Aided Triage and Notification Software |
| Product Code | QFM |
| Regulatory Class | II |

### 3. Predicate Device

| Proprietary Name | HealthCXR |
|------------------------|--------------------------------------------------------------------|
| Premarket Notification | K192320 |
| Classification Name | Radiological Computer-Assisted Prioritization Software For Lesions |
| Regulation Number | 21 CFR 892.2080 |
| Regulation Name | Radiological Computer Aided Triage and Notification Software |
| Product Code | QFM |
| Regulatory Class | II |

{6}------------------------------------------------

Image /page/6/Picture/0 description: The image shows a logo for a company called "EVER FORTUNE.AI". The logo consists of a stylized figure of a person with a head made of interconnected dots, and the company name is written in a bold, sans-serif font. Below the logo is the text "4. Device Description" in a large, bold font, indicating that this is a section heading within a document.

EFAI ChestSuite XR Pleural Effusion Assessment System, is a radiological computer-assisted triage and notification software system. The software uses deep learning techniques to automatically analyze PA chest x-rays and sends notification messages to the picture archiving and communication system (PACS)/workstation to allow suspicious findings of pleural effusion to be identified.

The device is intended to provide a passive notification through the PACS/workstation to the radiologists indicating the existence of a case that may potentially benefit from the prioritization. It does not mark, highlight, or direct users' attention to a specific location on the original chest X-ray. The device aims to aid in prioritization and triage of radiological medical images only.

The deployment environment is recommended to be in a local network with an existing hospitalgrade IT system in place. EFAI Chestsuite XR Pleural Effusion Assessment System should be installed on a specialized server supporting deep learning processing. The configurations are only being operated by the manufacturer:

- Local network setting of input and output destinations; ●
EFAI Chestsuite XR Pleural Effusion Assessment System is a software-only device which operates in four stages - data transfer, data preprocessing. AI inference and data post processing. The workflow of the device begins with applying a number of filtering rules based on image characteristics and DICOM tags to ensure only eligible images are analyzed by the algorithm. The image preprocessing unit ensures that all the input data are normalized (image size, contrast) such that it is ready for the algorithm to conduct the analysis. The AI inference generates an assessment which is then post-processed into a JSON message and transferred to an API server. The software is packaged as a docker container such that it can be installed and deployed to both a physical or virtual machine.

### 5. Intended Use

EFAI Chestsuite XR Pleural Effusion Assessment System is a software workflow tool designed to aid the clinical assessment of adult (18 years of age or older) Chest X-Ray cases with features suggestive of pleural effusion in the medical care environment. EFAI Chestsuite XR Pleural Effusion Assessment System analyzes cases using an artificial intelligence algorithm to identify suspected findings on chest x-ray images taken in PA position. It makes case-level output available to a PACS/workstation for worklist prioritization or triage. EFAI Chestsuite XR Pleural Effusion Assessment System is not intended to direct attention to specific portions or anomalies of an image. Its results are not intended to be used on a stand-alone basis for clinical decision-making nor is it intended to rule out pleural effusion or otherwise preclude clinical assessment of X-Ray cases.

{7}------------------------------------------------

Image /page/7/Picture/0 description: The image contains a logo for a company called "EVER FORTUNE.AI". The logo features a stylized human figure in teal, with a green globe-like shape with interconnected nodes as its head. To the right of the figure, the company name is written in teal, with "EVER" stacked above "FORTUNE.AI". The "O" in "FORTUNE" is replaced with a similar green globe-like shape as the head of the figure.

## 6. Comparison of Technological Characteristics with Predicate Device

Table below provides a comparison of the intended use and key technological features of EFAI Chestsuite XR Pleural Effusion Assessment System with that of the Primary Predicate, HealthCXR (K192320).

| Company | Ever Fortune.AI Co., Ltd.<br>(EFAI) | Zebra Medical Vision Ltd. |
|---------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Device Name | EFAI Chestsuite XR Pleural<br>Effusion Assessment System | HealthCXR |
| 510k Number | K222076 | K192320 |
| Regulation No. | 21CFR 892.2080 | 21CFR 892.2080 |
| Classification | II | II |
| Product Code | QFM | QFM |
| Intended<br>Use/Indication for<br>Use | EFAI Chestsuite XR Pleural<br>Effusion Assessment System is<br>a software workflow tool<br>designed to aid the clinical<br>assessment of adult (18 years of<br>age or older) Chest X-Ray cases<br>with features suggestive of<br>pleural effusion in the medical<br>care environment. EFAI<br>Chestsuite XR Pleural Effusion<br>Assessment System analyzes<br>cases using an artificial<br>intelligence algorithm to<br>identify suspected findings on<br>chest x-ray images taken in PA<br>position. It makes case-level<br>output available to a<br>PACS/workstation for worklist<br>prioritization or triage. EFAI<br>Chestsuite XR Pleural Effusion<br>Assessment System is not<br>intended to direct attention to<br>specific portions or anomalies of<br>an image. Its results are not<br>intended to be used on a stand-<br>alone basis for clinical decision-<br>making nor is it intended to rule<br>out pleural effusion or otherwise<br>preclude clinical assessment of | The Zebra HealthCXR device is<br>a software workflow tool<br>designed to aid the clinical<br>assessment of adult Chest X-Ray<br>cases with features suggestive of<br>pleural effusion in the medical<br>care environment. HealthCXR<br>analyzes cases using an artificial<br>intelligence algorithm to identify<br>suspected findings. It makes<br>case-level output available to a<br>PACS/workstation for worklist<br>prioritization or triage.<br>HealthCXR is not intended to<br>direct attention to specific<br>portions or anomalies of an<br>image. Its results are not intended<br>to be used on a stand-alone basis<br>for clinical decision-making nor<br>is it intended to rule out pleural<br>effusion or otherwise preclude<br>clinical assessment of X-Ray<br>cases. |

| | | Table - Comparison with the Predicate Device. | |
|--|--|-----------------------------------------------|--|
| | | | |

EFAI Chestsuite XR Pleural Effusion Assessment System Traditional 510(k)

{8}------------------------------------------------

Image /page/8/Picture/0 description: The image contains a logo with a teal color scheme. On the left side of the logo is a symbol that resembles a person with a network of connected dots forming the head. To the right of the symbol, the word "EVER" is written in large, bold letters. Below "EVER", the words "FORTUNE.AI" are written in a smaller font, with the "O" in "FORTUNE" replaced by a similar network of connected dots.

| | X-Ray cases. | |
|----------------------------------------------------------------------|-------------------------------------------------|--------------------------------------------------------------|
| Intended user | Radiologist | Radiologist |
| Supported Modalities | X-Ray (PA view) | X-Ray (PA or AP view) |
| Body Part | Chest | Chest |
| Artificial Intelligence<br>Algorithm | Yes | Yes |
| Limited to analysis of<br>imaging data | Yes | Yes |
| Aids prompt<br>identification of cases<br>with indicated<br>findings | Yes | Yes |
| Image Input | DICOM | DICOM |
| Identify patients<br>with a pre-specified<br>clinical condition | Yes | Yes |
| Clinical condition | Pleural Effusion | Pleural Effusion |
| Alert to finding | Yes; Passive notification<br>flagged for review | Yes; notification flagged for<br>review on hospital worklist |
| Independent of<br>standard of care<br>workflow | Yes; No cases are removed<br>from worklist | Yes; No cases are removed from<br>worklist |
| Where results are<br>received | PACS / RIS / Workstation | PACS / Workstation |

The proposed device, EFAI Chestsuite XR Pleural Effusion Assessment System, is substantially equivalent to the claimed predicate, HealthCXR (K192320).

{9}------------------------------------------------

Image /page/9/Picture/0 description: The image shows the logo for Ever Fortune AI, which is a teal-colored graphic of a person with a network of dots for a head. The text "EVER FORTUNE.AI" is to the right of the graphic. Below the logo is the text "7. Performance Data" in a bold font.

Performance of the EFAI Chestsuite XR Pleural Effusion Assessment System v1.0 has been evaluated and verified in accordance with software specifications and applicable performance standards through software verification and validation testing. Additionally, the software validation activities were performed in accordance with IEC 62304:2006/A1:2016 - Medical device software - Software life cycle processes, in addition to the FDA Guidance documents, "Guidance for the Content of Premarket Submissions for Software Contained in Medical Devices"(2005) and the recently published "Content of Premarket Submissions for Devices Software Functions (11-04-2021), and "Content of Premarket Submission for Management of Cybersecurity in Medical Devices."

To establish the performance of EFAI Chestsuite XR Pleural Effusion Assessment System, the performance was validated by clinical and nonclinical tests.

#### Nonclinical Tests

The company conducted an internal validation test to assess the performance of the EFAI Chestsuite XR Pleural Effusion Assessment System. A total of 1454 images were retrospectively collected between 2006 to 2018 from Taiwan. Ground-truthing (classified into positive and negative of pleural effusion) was done by three board-certified radiologists.

Summary of results: The AUC was 0.9517 (95% CI=0.9369-0.9666) with a sensitivity as 0.9013 (95% CI=0.8881-0.9132) and a specificity as 0.8869 (95% CI=0.8776-0.8957) for assessing pleural effusion. By confirming that the AUC, sensitivity, and specificity all exceed the prespecified performance goals, the performance of the algorithm of EFAI Chestsuite XR Pleural Effusion Assessment System was validated.

#### Clinical Tests

A standalone performance test was also performed. The test was conducted to compare the pleural effusion classification performance and processing time of EFAI Chestsuite XR Pleural Effusion Assessment System against the predicate device, HealthCXR. All data used during the standalone performance evaluation was acquired independently from product development training and internal testing. Each patient included only one image. The dataset included a retrospective cohort of 600 anonymized Chest X-ray images consecutively collected from multiple institutions in US and OUS (286 cases positive for pleural effusion and 314 cases negative for pleural effusion). The images were acquired from more than 15 X-Ray scanner manufacturers, including Samsung Electronics, SHIMADZU, TOSHIBA, KONICA MINOLTA, GE Healthcare, etc. The X-Ray is taken in a standard chest X-ray protocol in PA view. The confounding factors in this dataset include atelectasis, airspace disease, air-fluid level, blebs, fracture, infiltrate, mass, miliary disease, pneumonia, post-op change, pseudotumor, and pulmonary fibrosis.

Three US board-certified radiologists determined the presence of pleural effusion in each case independently. The majority agreement was used as the reference standard (ground truth). The performance acceptance criteria were set such that the lower bounds of both

{10}------------------------------------------------

Image /page/10/Picture/0 description: The image contains a logo for a company called "EVER FORTUNE.AI". The logo consists of a stylized figure of a person in teal, with a green circle containing a network of white dots as the head. To the right of the figure, the company name "EVER" is written in teal, with "FORTUNE.AI" written below in a smaller font, also in teal. The logo appears to be for a technology or artificial intelligence company.

sensitivity and specificity should exceed 0.80 and the lower bound of the AUC should exceed 0.95.

Summary of results: The dataset included 44.3% female and 55.3% male, and the mean age of cases was 58.7 years. Overall, the EFAI Chestsuite XR Pleural Effusion Assessment System was able to demonstrate sensitivity and specificity of 0.9510 (95% Cl=0.9195-0.9706) and 0.9745 (95% CI=0.9505-0.9870) respectively, as well as an AUC of 0.9712 (95% CI=0.9538-0.9885). The average performance time of the EFAI Chestsuite XR Pleural Effusion Assessment System was 19.6 seconds and was comparable with the predicate device HealthCXR (K192320, 27.76 seconds). Clinical subgroup analysis was performed for the gender, data source (US and OUS), scanner manufacturers, size, and location of pleural effusion, and demonstrated consistent performance for the device across all subgroups. The results demonstrate that the EFAI Chestsuite XR Pleural Effusion Assessment System device is as safe and effective as the predicate device HealthCXR.

### 8. Conclusion

Based on the information submitted in this premarket notification, and based on the indications for use, technological characteristics, and performance testing, the EFAI Chestsuite XR Pleural Effusion Assessment System v1.0 raises no new questions of safety and effectiveness and is substantially equivalent to the predicate device in terms of safety, effectiveness, and performance.