ART-Plan

K230023 · Therapanacea Sas · QKB · Apr 19, 2023 · Radiology

Device Facts

Record IDK230023
Device NameART-Plan
ApplicantTherapanacea Sas
Product CodeQKB · Radiology
Decision DateApr 19, 2023
DecisionSESE
Submission TypeSpecial
Regulation21 CFR 892.2050
Device ClassClass 2
AttributesAI/ML, Software as a Medical Device

Intended Use

ART-Plan is a software for multi-modal visualization, contouring and processing of 3D images of cancer patients for whom radiotherapy treatment has been prescribed. It allows the user to view, create and modify contours for the regions of interest. It also allows to generate automatically, and based on medical practices, the contours for the organs at risk and healthy lymph nodes and to register combinations of anatomical and functional images. Contours and images require verifications, potential modifications, and subsequently the validation of a trained user with professional qualifications in anatomy and radiotherapy before their export to a Treatment Planning System. ART-Plan offers the following visualization, contouring and manipulation tools to aid in the preparation of radiotherapy treatment: Multi-modal visualization and rigid- and deformable registration of anatomical and functional images such as CT, MR, PET-CT, 4D-CT and CBCT Display of fused and non-fused images to facilitate the comparison and delineation of image data by the user Manual modification and semi-automatic generation of contours for the regions of interest Automatic generation of contours for organs at risk and healthy lymph nodes, based on medical practices, on medical images such as CT and MR images. Generation of pseudo-CT for supported anatomies The device is intended to be used in a radiation therapy clinical setting, by trained professionals only.

Device Story

ART-Plan is a software application for radiation therapy planning; it processes 3D multi-modal medical images (CT, PET-CT, CBCT, 4D-CT, MR). The device features two primary modules: SmartFuse for image registration/fusion and Annotate for segmentation. It utilizes deep-learning algorithms to automatically delineate organs at risk and healthy lymph nodes, and to generate pseudo-CT images from MRI. Users (radiation oncologists, dosimetrists, physicists) import DICOM datasets, review AI-generated contours, perform manual or semi-automatic edits, and export results to treatment planning systems. The device operates in clinical radiation therapy settings. By automating contouring and image registration, it aims to standardize processes, reduce manual workload, and improve efficiency in radiotherapy preparation. Clinical experts must verify and validate all AI-generated outputs before clinical use.

Clinical Evidence

No clinical studies were conducted. Performance was established via bench testing using retrospective clinical data. The Annotate module's auto-segmentation performance was validated against inter-expert variability (Dice Similarity Coefficient) and qualitative expert evaluation (A+B score ≥ 85%). Synthetic-CT generation was validated using gamma passing criteria (≥95% at 2%/2mm) and mean dose deviation (≤2%).

Technological Characteristics

Software-based medical image management and processing system. Features deep-learning based automatic segmentation and synthetic-CT generation. Supports DICOM 3.0. Operates on standard networked computer hardware. No specific physical materials or energy sources (software-only).

Indications for Use

Indicated for cancer patients for whom radiation treatment has been planned. Intended for use by trained medical professionals including radiation oncologists, dosimetrists, and medical physicists.

Regulatory Classification

Identification

A medical image management and processing system is a device that provides one or more capabilities relating to the review and digital processing of medical images for the purposes of interpretation by a trained practitioner of disease detection, diagnosis, or patient management. The software components may provide advanced or complex image processing functions for image manipulation, enhancement, or quantification that are intended for use in the interpretation and analysis of medical images. Advanced image manipulation functions may include image segmentation, multimodality image registration, or 3D visualization. Complex quantitative functions may include semi-automated measurements or time-series measurements.

Special Controls

*Classification.* Class II (special controls; voluntary standards—Digital Imaging and Communications in Medicine (DICOM) Std., Joint Photographic Experts Group (JPEG) Std., Society of Motion Picture and Television Engineers (SMPTE) Test Pattern).

Predicate Devices

Related Devices

Submission Summary (Full Text)

{0}------------------------------------------------ Image /page/0/Picture/0 description: The image contains the logo of the U.S. Food and Drug Administration (FDA). On the left is the Department of Health and Human Services logo. To the right of that is the FDA logo, which is a blue square with the letters "FDA" in white. To the right of the FDA logo is the text "U.S. FOOD & DRUG ADMINISTRATION" in blue. Therapanacea SAS % Catherine Martineau-Huynh COO 7 bis boulevard Bourdon Paris, 75004 FRANCE April 19, 2023 Re: K230023/S001 Trade/Device Name: ART-Plan Regulation Number: 21 CFR 892.2050 Regulation Name: Medical Image Management And Processing System Regulatory Class: Class II Product Code: QKB, MUJ, LLZ Dated: December 28, 2022 Received: January 4, 2023 Dear Catherine Martineau-Huynh: We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database located at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading. If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register. Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801 and Part 809); medical device reporting of medical device-related adverse events) (21 CFR 803) for devices or postmarketing safety reporting (21 CFR 4, Subpart B) for combination products (see {1}------------------------------------------------ https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR 4, Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050. Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR Part 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems. For comprehensive regulatory information about medical devices and radiation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100). Sincerely, Image /page/1/Picture/5 description: The image shows a digital signature. The signature is from Lora D. Weidner - S. The date of the signature is 2023.04.19. The time of the signature is 18:00:58-04'00'. Lora D. Weidner -S 18:00:58 -04'00' Lora D. Weidner, Ph.D. Assistant Director Radiation Therapy Team DHT8C: Division of Radiological Imaging and Radiation Therapy Devices OHT8: Office of Radiological Health Office of Product Evaluation and Quality Center for Devices and Radiological Health Enclosure {2}------------------------------------------------ ## Indications for Use 510(k) Number (if known) K230023 Device Name ART-Plan ## Indications for Use (Describe) ART-Plan is indicated for cancer patients for whom radiation treatment has been planned. It is intended to be used by trained medical professionals including, but not limited to, radiation oncologists, dosimetrists, and medical physicists. ART-Plan is a software application intended to display and visualize 3D multi-modal medical image data. The user may mport, define, display, transform and store DICOM3.0 compliant datasets (including regions of interest structures). These images, contours and objects can subsequently be exported/distributed within the system, across computer networks and/or to radiation treatment planning systems. Supported modalities include CT, PET-CT, CBCT, 4D-CT and MR images. ART-Plan supports AI-based contouring on CT and MR images and offers semi-automatic and manual tools for segmentation. To help the user assess changes in image data and to obtain combined multi-modal image information, ART-Plan allows the registration of anatomical and functional images and display of fused and non-fused images to facilitate the comparison of patient image data by the user. With ART-Plan, users are also able to generate, visualize, evaluate and modify pseudo-CT from MRI images. | Type of Use (Select one or both, as applicable) | | |--------------------------------------------------------------------------------------------------|--| | <div> <span style="font-size:100%;">☑ Prescription Use (Part 21 CFR 801 Subpart D)</span> </div> | | | <div> <span style="font-size:100%;">☐ Over-The-Counter Use (21 CFR 801 Subpart C)</span> </div> | | ## CONTINUE ON A SEPARATE PAGE IF NEEDED. This section applies only to requirements of the Paperwork Reduction Act of 1995. #### *DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.* The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to: > Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff(@fda.hhs.gov "An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number." {3}------------------------------------------------ K230023 ## 510(k) Summary This 510(k) Summary is submitted in accordance with 21 CFR Part 807, Section 807.92. This summary of 510(k) safety and effectiveness information is being submitted in accordance with the requirement of 21 CFR 807.92 | Submitter Information: | TheraPanacea SAS | |------------------------------------|-------------------------------------| | Name: | 7 bis boulevard Bourdon 75004 Paris | | Address: | 3019834893 | | Establishment Registration Number: | 10082087 | | Owner/Operator Number: | +33 9 62 52 78 19 | | Phone: | Catherine Martineau-Huynh | | Contact: | c.huynh@therapanacea.eu | | E-mail: | 28th of December 2022 | | Date of Summary: | | #### Device Information: Below summarises the Device Classification information regarding the ART-Plan v1.10.1. | Device Proprietary Name | NA | |-------------------------|----------| | Common Name: | ART-Plan | | Trade Name: | ART-Plan | | Product Code(s): | NA | ## Primary Product Code | Regulation<br>Number | Device | Device Class | Product<br>Code | Classification<br>Panel | |----------------------|------------------------------------------------------|--------------|-----------------|-------------------------| | 892.2050 | Medical image<br>management and<br>processing system | Class II | QKB | Radiology | ## Secondary Product Codes | Regulation<br>Number | Device | Device Class | Product<br>Code | Classification<br>Panel | |----------------------|------------------------------------------------------------|--------------|-----------------|-------------------------| | 892.2050 | Medical image<br>management and<br>processing system | Class II | LLZ | Radiology | | 892.5050 | Medical<br>charged-particle<br>radiation therapy<br>system | Class II | MUJ | Radiology | {4}------------------------------------------------ ### Substantial Equivalence | Manufacturer | Trade Name | Product<br>Code | Regulation | 510(k) Number | |---------------------|------------|-----------------|------------|---------------| | TheraPanacea<br>SAS | ART-Plan | QKB | 892.2050 | K220813 | #### Submission Description This Special 510(k) covers a modification to add 48 new structures to existing localizations and 8 bug fixes to ART-Plan v1.10.0, as cleared in 510(k) (K220813). There are no significant changes presented to the other software components previously cleared in K220813 i.e., no change to the other modules such as Smartfuse, Home, Administration and to the other features such as generation of synthetic CT from MR. Well-established methods described in the previously 510(k)-cleared ART-Plan v1.10.0, have been used to evaluate the change is provided in a summary in this submission. This Special 510(k) presents the addition of 48 new structures to existing localizations (Annotate module). This modification extends the use of Annotate to other radiotherapy protocols, such as the SBRT for lung. It also includes 8 bug fixes. ## Device Description #### General Description . The ART-Plan application consists of two kev modules: SmartFuse and Annotate, allowing the user to display and visualize 3D multi-modal medical image data. The user may process, render, review, store, display and distribute DICOM 3.0 compliant datasets within the system and/or across computer networks. Supported modalities cover static and gated CT (computerized tomography including CBCT and 4D-CT), PET (positron emission tomography) and MR (magnetic resonance). The ART-Plan technical functionalities claimed by TheraPanacea are the following: - Proposing automatic solutions to the user, such as an automatic delineation, automatic . multimodal image fusion, etc. towards improving standardization of processes/ performance / reducing user tedious / time consuming involvement. - . Offering to the user a set of tools to assist semi-automatic delineation, semi-automatic reqistration towards modifying/editing manually automatically generated structures and adding/removing new/undesired structures or imposing user-provided correspondences constraints on the fusion of multimodal images. - . Presenting to the user a set of visualization methods of the delineated structures, and registration fusion maps. - . Saving the delineated structures / fusion results for use in the dosimetry process. - Enabling rigid and deformable registration of patients images sets to combine information contained in different or same modalities. - . Allowing the users to generate, visualize, evaluate and modify pseudo-CT from MRI images. ART-Plan offers deep-learning based automatic segmentation for the following localizations: {5}------------------------------------------------ - head and neck (on CT images) ● - thorax/breast (for male/female and on CT images) ● - abdomen (on CT images and MR images) ● - pelvis male(on CT images and MR images) ● - pelvis female (on CT images) ● - brain (on CT images and MR images) ART-Plan offers deep-learning based synthetic CT-generation from MR images for the following localizations: - . pelvis male - brain #### Intended/ Indications for Use #### Intended use : ART-Plan is a software for multi-modal visualization, contouring and processing of 3D images of cancer patients for whom radiotherapy treatment has been prescribed. It allows the user to view, create and modify contours for the regions of interest. It also allows to generate automatically, and based on medical practices, the contours for the organs at risk and healthy lymph nodes and to register combinations of anatomical and functional images. Contours and images require verifications, potential modifications, and subsequently the validation of a trained user with professional qualifications in anatomy and radiotherapy before their export to a Treatment Planning System. ART-Plan offers the following visualization, contouring and manipulation tools to aid in the preparation of radiotherapy treatment: - Multi-modal visualization and rigid- and deformable registration of anatomical and ● functional images such as CT, MR, PET-CT, 4D-CT and CBCT - Display of fused and non-fused images to facilitate the comparison and delineation of ● image data by the user - Manual modification and semi-automatic generation of contours for the regions of ● interest - Automatic generation of contours for organs at risk and healthy lymph nodes, based . on medical practices, on medical images such as CT and MR images. - Generation of pseudo-CT for supported anatomies The device is intended to be used in a radiation therapy clinical setting, by trained professionals only. #### Indications for use: ART-Plan is indicated for cancer patients for whom radiation treatment has been planned. It is intended to be used by trained medical professionals including, but not limited to, radiologists, radiation oncologists, dosimetrists, and medical physicists. ART-Plan is a software application intended to display and visualize 3D multi-modal medical image data. The user may import, define, display, transform and store DICOM3.0 compliant datasets (including regions of interest structures). These images, contours and objects can subsequently be exported/distributed within the system, across computer networks and/or to radiation treatment planning systems. Supported modalities include CT, PET-CT, CBCT, 4D-CT and MR images. {6}------------------------------------------------ ART-Plan supports Al-based contouring on CT and MR images and offers semi-automatic and manual tools for segmentation. To help the user assess changes in image data and to obtain combined multi-modal image information, ART-Plan allows the registration of anatomical and functional images and display of fused and non-fused images to facilitate the comparison of patient image data by the user. With ART-Plan, users are also able to generate, visualize, evaluate and modify pseudo-CT from MRI images. ## Comparison with the Predicate and Previously Cleared Device The candidate device TheraPanacea SAS ART-Plan 1.10.1 is substantially equivalent to the predicate, K220813, the TheraPanacea SAS ART-Plan 1.10.0 and a comparison of the key characteristics is summarised in Table 1. | Characteristic | ART-Plan v1.10.1 with Modification | ART-Plan v1.10.0 K220813<br>(Predicate) | Equivalence | |--------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | Device Name | ART-Plan v1.10.1 | ART-Plan v1.10.0 | Equivalent | | Manufacturer | TheraPanacea SAS | TheraPanacea SAS | Equivalent | | Device Classification | II | II | Equivalent | | Primary Product Code | QKB | QKB | Equivalent | | Secondary Product<br>Code | LLZ, MUJ | LLZ, MUJ | Equivalent | | Indications for Use | ART-Plan is indicated for cancer patients for whom radiation treatment has been planned. It is intended to be used by trained medical professionals including, but not limited to, radiologists, radiation oncologists, dosimetrists, and medical physicists.<br><br>ART-Plan is a software application intended to display and visualize 3D multi-modal medical image data. The user may import, define, display, transform and store DICOM 3.0 compliant datasets (including regions of interest structures). These images, contours and objects can subsequently be exported/distributed within the system, across computer networks and/or to radiation treatment planning systems. Supported modalities include CT, PET-CT, CBCT, 4D-CT and MR images.<br><br>ART-Plan supports Al-based contouring on CT and MR images and offers semi-automatic and manual tools for segmentation.<br><br>To help the user assess changes in image data and to obtain combined multi-modal image information, ART-Plan allows the registration of | ART-Plan is indicated for cancer patients for whom radiation treatment has been planned. It is intended to be used by trained medical professionals including, but not limited to, radiologists, radiation oncologists, dosimetrists, and medical physicists.<br><br>ART-Plan is a software application intended to display and visualize 3D multi-modal medical image data. The user may import, define, display, transform and store DICOM 3.0 compliant datasets (including regions of interest structures). These images, contours and objects can subsequently be exported/distributed within the system, across computer networks and/or to radiation treatment planning systems. Supported modalities include CT, PET-CT, CBCT, 4D-CT and MR images.<br><br>ART-Plan supports Al-based contouring on CT and MR images and offers semi-automatic and manual tools for segmentation.<br><br>To help the user assess changes in image data and to obtain combined multi-modal image information, ART-Plan allows the registration of | Equivalent | | Characteristic | ART-Plan v1.10.1 with Modification | ART-Plan v1.10.0 K220813<br>(Predicate) | Equivalence | | | anatomical and functional images and<br>display of fused and non-fused images<br>to facilitate the comparison of patient<br>image data by the user. | anatomical and functional images and<br>display of fused and non-fused images<br>to facilitate the comparison of patient<br>image data by the user. | | | | With ART-Plan, users are also able to<br>generate, visualize, evaluate and<br>modify pseudo-CT from MRI images | With ART-Plan, users are also able to<br>generate, visualize, evaluate and<br>modify pseudo-CT from MRI images | | | Intended<br>user/Location | It is intended to be used by trained<br>medical professionals including, but not<br>limited to, radiologists, radiation<br>oncologists, dosimetrists, and medical<br>physicists / Hospitals | It is intended to be used by trained<br>medical professionals including, but not<br>limited to, radiologists, radiation<br>oncologists, dosimetrists, and medical<br>physicists / Hospitals | Equivalent | | Segmentation features<br>(Annotate module) | Automatically delineates OARs and<br>healthy lymph nodes<br><br>Deep learning algorithm.<br><br>Automatic segmentation includes the<br>following localizations:<br>* head and neck (on CT images)<br>* thorax/breast (for male/female and on<br>CT images)<br>* abdomen (on CT images and MR<br>images)<br>* pelvis male(on CT images and MR<br>images)<br>* pelvis female (on CT images)<br>* brain (on CT images and MR images) | Automatically delineates OARs and<br>healthy lymph nodes<br><br>Deep learning algorithm.<br><br>Automatic segmentation includes the<br>following localizations:<br>* head and neck (on CT images)<br>* thorax/breast (for male/female and on<br>CT images)<br>* abdomen (on CT images and MR<br>images)<br>* pelvis male(on CT images and MR<br>images)<br>* pelvis female (on CT images)<br>* brain (on CT images and MR images) | Equivalent -<br>The candidate<br>device and<br>predicate are<br>capable of<br>automatically<br>contouring the<br>organ-at-risk<br>(OAR) and<br>healthy lymph<br>nodes using<br>Al (deep<br>learning)<br>algorithm.<br><br>The candidate<br>device<br>includes 48<br>additional<br>structures to<br>the already<br>existing<br>localizations | | Bugs | Correction of 8 bugs | NA | Equivalent<br>The bug fixes<br>introduced in<br>the candidate<br>device do not<br>affect the<br>safety or<br>performance<br>of the<br>predicate<br>device | {7}------------------------------------------------ Table 1: Comparison of characteristics between the Modified System and the Predicate System. {8}------------------------------------------------ In Table 2, structures included in ART-Plan v1.10.1 are presented. | Head & Neck (CT) - 47 structures | | | | | | | |--------------------------------------------------------------------|---------------------------------------|-----------------------------------------|-------------------------------------------|-----------------------------------------------------------|--------------------------------------------------------|----------------------------------------------------------| | Brainstem | Cerebellum | Chiasma | Encephalon | Esophagus | Hypophyse | Larynx | | Left Brachial<br>plexus | Left cervical lymph<br>node IB | Left cervical<br>lymph node II | Left cervical<br>lymph node III | Left cervical<br>lymph node IVA | Left cervical<br>lymph node IVB | Left cervical<br>lymph node V | | Left cervical lymph<br>node VIIA | Left cervical lymph<br>node VIIB | Left cochlea | Left eye | Left eye lens | Left optical<br>nerve | Left parotid | | Left submandible | Left<br>temporomandibular<br>r joints | Lips | Mandible | Medullar<br>canal | Mouth | Right brachial<br>plexus | | Right cervical<br>lymph node IB | Right cervical<br>lymph node II | Right<br>cervical<br>lymph node<br>III | Right cervical<br>lymph node<br>IVA | Right cervical<br>lymph node<br>IVB | Right cervical<br>lymph node V | Right cervical<br>lymph node<br>VIIA | | Right cervical<br>lymph node VIIB | Right cochlea | Right eye | Right eye lens | Right optical<br>nerve | Right parotid | Right<br>submandible | | Right<br>temporomandibular<br>r joints | Spinal Cord | Thyroid | Trachea | External<br>contour | | | | Thorax / Breast (CT) - 30 structures | | | | | | | | Esophagus | Heart | Larynx | Left brachial<br>plexus | Left breast | Left humeral<br>head | Left IMC<br>(internal<br>mammary<br>chain) lymph<br>node | | Left interpectoral<br>lymph node | Left lung | Left lymph<br>node L1 | Left lymph<br>node L2 | Left lymph<br>node L3 | Left<br>supraclavicular<br>r lymph nodes | Liver | | Medullar canal | Right brachial<br>plexus | Right breast | Right humeral<br>head | Right IMC<br>(internal<br>mammary<br>chain) lymph<br>node | Right<br>interpectoral<br>lymph node | Right lung | | Right lymph node<br>L1 | Right lymph node<br>L2 | Right lymph<br>node L3 | Right<br>supraclavicular<br>r lymph nodes | Spinal cord | Thoracic aorta | Thyroid | | Trachea | External Contour | | | | | | | Pelvis Male (CT) - 19 structures | | | | | | | | Anal canal | Bladder | Bowel bag | CTVn<br>prostate | Left femoral<br>head | Left iliac | Left kidney | | Liver | Medullar canal | Penile bulb | Prostate | Rectum | Right<br>femoral head | Right iliac | | Right kidney | Seminal vesicle | Sigmoid | Spinal cord | External<br>contour | | | | Pelvis Female (CT) - 25 structures | | | | | | | | Anal canal | Bladder | Bowel bag | Common<br>iliac gyneco<br>lymph node | CTVt<br>gyneco | Left femoral<br>head | Left iliac | | Left iliac gyneco<br>lymph node | Left inguinal<br>gyneco lymph<br>node | Left kidney | Liver | Lomboaortic<br>c lymph<br>node | Medullar<br>canal | Parametrium | | Presacral<br>gyneco lymph<br>node | Rectum | Right<br>femoral<br>head | Right iliac | Right<br>inguinal<br>gyneco<br>lymph node | Right kidney | | | Sigmoid | Spinal cord | Vagina | External<br>contour | | | | | Heart substructures (part of thorax / breast) (CT) - 13 structures | | | | | | | | Ascending aorta | Coronary sinus | Left atrium | Left main<br>coronary<br>artery | Left<br>ventricle | Left ventricle<br>anterior | Left ventricle<br>apical | | Left ventricle<br>inferior | Left ventricle<br>lateral | Left<br>ventricle<br>septal | Right atrium | Right<br>ventricle | Vena cava<br>superior | | | SBRT lung (part of thorax / breast) (CT) - 14 structures | | | | | | | | Bronchial tree | Carina | Left<br>anterior<br>descending<br>aorta | Left bronchia | Left<br>bronchus | Left chest<br>wall | Pericardium | | Pulmonary<br>arteries | Right bronchia | Right<br>bronchus | Right chest<br>wall | Spleen | Stomach | Vena cava<br>inferior | | Brain T1 (MR) - 28 structures | | | | | | | | Anterior<br>cerebellum | Chiasma | Encephalo<br>n | Hypophyse | Left cochlea | Left cornea | Left eye lens | | Left<br>hippocampus | Left<br>hypothalamus | Left<br>lacrimal<br>gland | Left optical<br>nerve | Left retina | Left<br>vestibular<br>semicircular<br>canals<br>(VSCC) | Medulla<br>oblongata | | Midbrain | Pons | Posterior<br>cerebellum | Right<br>cochlea | Right<br>cornea | Right eye<br>lens | Right<br>hippocampu<br>S | | Right<br>hypothalamus | Right lacrimal<br>gland | Right<br>optical<br>nerve | Right retina | Right<br>versibular<br>semicircular<br>canals<br>(VSCC) | Spinal cord | External<br>contour | | Pelvis T2 (male) (MR) - 12 structures | | | | | | | | Anal canal | Bladder | Left<br>femoral<br>head | Left pelvis | Penile bulb | Prostate | Rectum | | Right femoral<br>head | Right pelvis | Sacrum | Seminal<br>vesicle | External<br>contour | | | | Pelvis TF (male) (MR) - 19 structures | | | | | | | | Anal canal | Aorta | Bladder | Duodenum | Inferior<br>vena cava | Large bowel | Left femoral<br>head | | Left kidney | Liver | Pancreas | Penile bulb | Prostate | Rectum | Right<br>femoral head | | Right kidney | Seminal vesicle | Sigmoid | Stomach | External<br>contour | | | {9}------------------------------------------------ Table 2: Structures included in ART-Plan v1.10.1 {10}------------------------------------------------ #### Technological Characteristics The proposed modification to the Annotate module on the TheraPanacea ART-Plan v1.10.1 has identical indications for use, operating principles, performance, and technical specification as the predicate device, the TheraPanacea SAS ART-Plan 1.10.0. The proposed modification of the addition of 48 new structures to the existing localizations and the introduction of 8 bug fixes enables further help in the management of radiotherapy planning. Equivalence between both systems has been shown through the thorough performance testing performed. ## Summary of Non-Clinical Tests (Performance data) The TheraPanacea ART-Plan V1.10.1 was tested to ensure performance of the system, to verify and validate the product design and to characterise the performance and safety of TheraPanacea's ART-Plan v1.10.1. The performance of the Annotate modification is identical to the predicate previously cleared device in terms of technical specification and safety. The primary difference between the predicate and the candidate devices is the addition of 48 new structures to existing localizations (Annotate module). This modification extends the use of Annotate to other radiotherapy protocols, such as the SBRT for lung, All changes were verified and validated according to TheraPanacea SAS internal design control process and in accordance with special controls for software systems. This is demonstrated through the extensive testing carried out on the system with the modification, which passes all performance and verification tests that follow the same protocol and acceptance criteria as the ones submitted to the FDA under the clearance of the predicate device (K220813). It also demonstrated that the proposed modification performed according to its specification and has met the technological and performance criteria which have not changed from the predicate device. #### Information about our training dataset: A method generalizes well if the observed performance on training and validation sets remains stable. In the case of strong presence of expert's annotation variability (that is not necessarily because of erroneous annotations but because image quality/organ visibility can be interpreted differently amonq experts), a method that can demonstrate similar performance with respect to a given metric on training, validation and later on testing is considered to generalize well. In that process, both the loss function being optimization procedure (stochastic gradient descent) and the dice metric which is the main proxy of segmentation quality, are monitored over the train and validation sets. If the loss is non-increasing on the validation set and if the dice metrics follow similar in value trends in both the validation and training sets, it is considered that the model being trained does not overfit, and hence should generalize well, at least on input domains similar to ones in those sets. {11}------------------------------------------------ On the contrary, overfitting can be detected whenever the training loss keeps decreasing while the validation loss after a while increases. This means that the model is focusing on features that are specific to the training data and not present in the validation data. This implies that the capacity of the model to generalize is poor. In that respect, the independence of the train/validation/test sets is fundamental. We consider that a model is a good candidate for production when the following conditions are met: 1) the loss and dices have reached a plateau on the validation set, 2) there is no overfitting, i.e. training and validation curves are similar and 3) the level of the dice for the different organs are as good or above the clinical expectations according to well defined performance criteria. The learning curves of organs may be different depending on the sizes and shapes (difficulties) of structures (organs). Thus, the range of testing scores, Dice Similarity Coefficient (DSC), may vary. It is important to remember that smaller orqans might have smaller DSC and yet be still clinically relevant and acceptable, as the DSC is a relative metric that is heavily dependent on the volume of the organ. This is due to the fact that the DSC scores are normalized from the union of organ volume between the two sets (ground truth, automatic annotations) and therefore lower DSC could correspond to clinically acceptable values for small organs, since the proposed contours might take just a few editions to make them usable for planning, whilst still saving time from the users, i.e. that these contours would be judged "clinically acceptable after minor corrections" in a qualitative evaluation. Learning curves can have an average DSC and loss function for each epoch (which is an iteration of training where the whole training dataset has been passed to the network) over the training set and over the validation set. Our curves show that validation and training data are very close to each other, reaching convergence after some epochs (depending on the structure), demonstrating no overfitting of the training data. Once convergence is achieved, the model is considered ready to be tested and clinically validated on a different, yet representative data set, as described in the process that has already been submitted to and cleared by the FDA. Some limitations have been identified that correspond either to the sex or the age of patients. For instance, for the auto-segmentation model following limitations are disclosed to the user in the Instruction For Use (User Manual) based on the sex of the patient: - The Truefisp Pelvis MRI and T2 Elekta Pelvis MRI auto-contouring models only work on male anatomy. - -The patient sex of the patient (dicom tag (0010, 0040)) is taken into account for the auto-segmentation: - if the tag is "F" or "M", the sex specific organs (prostate, breast, etc.) are ' contoured according to the tag if the taq is empty or "O": - - if batch: no contour is delineated except external contour ' - if auto seqmentation on Annotate: only common contours to the 2 sexes are delineated - if the tag is incorrect, the generated contours may be inappropriate - The automatic contouring (including external contour) function may generate inappropriate {12}------------------------------------------------ contours in the following cases: - When the volume used is an image taken of a child – - -When the patient has a particular anatomy. - When the considered volume is that of a patient not positioned on his back at the time of acquisition. - -When the value entered in the Patient Position tag (0018, 5100) is erroneous. - -When the DICOM-CT contains an unusually high number of slices. - When the quality of the images used as input is not satisfying enough or the resolution is low such as CBCT. Therefore, the contours produced may have a low quality. - -When the primary volume is an MRI whose acquisition sequence is not compatible with the selected auto-contouring model. - -When the patient is unusually positioned on the image (image not centered on the patient, head rotated on the side ... ) Only some anatomies are covered by the automatic contouring: - Automatic contouring on CT images covers all anatomies (head, Head & Neck, thorax, breast, abdominal region and pelvis (M/F) - -Automatic contouring on MR images covers some sequences and anatomies: Brain T1, Abdo TF (TrueFisp), Pelvis T2, Pelvis TF. - -In order to suggest the most relevant structures to the user, a CT that does not include a chiasma but does include a liver, is not considered as Head and Neck case. In that case, no Head and Neck structures will be automatically segmented. All the above information on the limitations of some models is included in the Instruction For Use (User Manual) which is made available to all users of the software. #### Summary test statistics or other test results including acceptance criteria or ● other information supporting the appropriateness of the characterized performance: Acceptance criteria for performance of ART-Plan modules were established using performance ranges extracted from benchmark devices and alternative technologies in the literature. For an auto segmentation model to be judged acceptable, every organ included in the model must pass at least one acceptance criterion with success across the different testings it has been submitted to. These criteria are as follows: a) The Dice Similarity Coefficient (DSC) is equal to or superior to the acceptance criteria set by the AAPM: DSC (mean)≥ 0.8. Or b) The Dice Similarity Coefficient (DSC) is equal to or superior to inter-expert variability: DSC (mean)≥ 0.54 or DSC (mean) ≥ mean (DSC inter-expert) + 5% . Or c) The clinicians' s qualitative evaluation of the auto-segmentation is considered acceptable for clinical use without modifications (A) or with minor modifications / corrections (B) with a A+B % above or equal to 85% considering the following scale: A: the contour is acceptable for a clinical use without any modification B: the contour would be acceptable for clinical use after minor modifications/corrections C: the contour requires major modifications (e.g. it would be faster for the expert to manually delineate the structure)" For the synthetic-CT generation tool, the acceptance criteria are as follows: Page 10 of 22 {13}------------------------------------------------ a. A median 2%/2mm qamma passing criteria of ≥95% b. A median 3%/3mm gamma passing criteria of ≥99.0% c. A mean dose deviation (pseudo-CT compared to standard CT) of ≤2% in ≥88% of patients #### Total number of individual patients images in the reported auto segmentation . tools and independence of test data and training data Our training, validation and test cohorts are built from real-world retrospective data which were initially used for treatment of cancer patients. For the structures of a given anatomy for a given modality (MR or CT), two non-overlapping data sets were separated: the test patients (number selected based on thorough literature review and statistical power) and the train data. We make sure that those sets are non-overlapping and further split the train cases into train and validation sets and ensure enough train cases for the machine learning models to converge and achieve good performances of the validation set. | | Sample size | % | |------------|-------------|-----| | Training | 299 142 | 0.8 | | Validation | 75 018 | 0.2 | | Total | 274 160 | 1 | Table 3: Distribution of samples between training and validation data sets #### . Total number of cases and samples images in the reported auto segmentation results The total number of patients used for training (8736) is lower than the number of samples (374160). This is linked to the fact that one patient can be associated with more images (e.g. CT, MR) and that each image (anatomy) has the delineation of several structures (OARs and lymph nodes) which increases the number of samples used for training and validation. #### . Demographic distribution including gender, age and ethnicity All data used for training of the models have been pseudo-anonymised by the centers providing data before transfer. Around 80% of the data used for training contain information on gender and age of the patients. In terms of gender, around 44% and 56% of our data (that contains this information) are from female and male patients. respectively. In comparison, in 2020 according to the Global Cancer Observatory, 48% and 52% of the cancer patients were female and male, respectively. In terms of age, our data follows the same trend observed and reported in the US (SEER NIH), UK (Cancer Research UK) and worldwide (Global Cancer Observatory) for cancer incidence according to age, with more than 95% of the data coming from patients between 20 and 85 years old. Our data has a slight overrepresentation (8% points) for the ages between 54 and 60 years old, at the cost of a slight underrepresentation of patients in the age range between {14}------------------------------------------------ 20-34 (1.5% points) and above 85 (6.5% points) years old. In addition, following the general global (incl US) trend, our data also depicts a steep rise in the incidence rate from in the age group of 55-64 years old, with a median age of 63 years old (as compared to 66 years old in the US). Although this information is not exhaustive, this analysis shows that the demographic distribution in terms of age and gender of the data used for training and validation of the models are well aligned with the incidence cancer statistics found for instance in US, UK and globally. This comes from the fact that real clinical data provided by medical facilities without any selection criteria (i.e. no discrimination or selection has been applied to the cases retrieved), leading to the demographic distribution including gender and age across the data is representative of the distribution in the clinic and thus of the cancer patient population in general. An exception is noted for following models that are gender-dependent: - 100% of pelvis images for male pelvis model for automatic annotation are male patients - 100% of pelvis images for female pelvis model for automatic annotation are female patients - 100% of breast images for the breast automatic annotation are female patients - 100 % of pelvis images for automatic synthetic-CT generation are male patients The pseudo-anonymized data did not include any information on the ethnicity. In addition, autom…
Innolitics

Panel 1

/
Sort by
Ready

Predicate graph will load when search results are available.

Embedding visualization will load when search results are available.

PDF viewer will load when search results are available.

Loading panels...

Select an item from the tree

Click any panel, subpart, regulation, product code, or device to see details here.

Section Matches

Results will appear here.

Product Code Matches

Results will appear here.

Special Control Matches

Results will appear here.

Loading collections...