NCT03706534

Brief Summary

This study evaluates a second review of ultrasound images of breast lesions using an interactive "deep learning" (or artificial intelligence) program developed by Samsung Medical Imaging, to see if this artificial intelligence will help the Radiologist make more accurate diagnoses.

Trial Health

43
At Risk

Trial Health Score

Automated assessment based on enrollment pace, timeline, and geographic reach

Trial has exceeded expected completion date
Enrollment
300

participants targeted

Target at P75+ for not_applicable breast-cancer

Timeline
Completed

Started Sep 2018

Shorter than P25 for not_applicable breast-cancer

Geographic Reach
1 country

1 active site

Status
unknown

Health score is calculated from publicly available data and should be used for screening purposes only.

Trial Relationships

Click on a node to explore related trials.

Study Timeline

Key milestones and dates

Study Start

First participant enrolled

September 20, 2018

Completed
21 days until next milestone

First Submitted

Initial submission to the registry

October 11, 2018

Completed
5 days until next milestone

First Posted

Study publicly available on registry

October 16, 2018

Completed
1.1 years until next milestone

Primary Completion

Last participant's last visit for primary outcome

November 30, 2019

Completed
2 months until next milestone

Study Completion

Last participant's last visit for all outcomes

January 31, 2020

Completed
Last Updated

October 29, 2019

Status Verified

October 1, 2019

Enrollment Period

1.2 years

First QC Date

October 11, 2018

Last Update Submit

October 27, 2019

Conditions

Keywords

Breast cancerBreast Imaging

Outcome Measures

Primary Outcomes (1)

  • Concordance rate

    Breast Imaging Reporting and Data System descriptors suggested by S-Detect for Breast are in good agreement with those selected by experts. In other words, the Breast Imaging Reporting and Data System Lexicon values generated by S-Detect for Breast are not statistically different from the consensus of experts. Breast Imaging Reporting and Data System Assessment Category Score: The user makes the final decision on the Assessment Category Score. Using this Score, S-Detect displays the assessment description. Category 0: Incomplete - Need Additional Imaging Evaluation Category 1: Negative Category 2: Benign Category 3: Probably Benign Category 4a: Low suspicion for malignancy Category 4b: Moderate suspicion for malignancy Category 4c: High suspicion for Malignancy Category 5: Highly Suggestive of Malignancy Category 6: Known Biopsy-Proven Malignancy

    2 days

Secondary Outcomes (6)

  • Reporting time

    2 day

  • Consensus

    2 day

  • Accuracy

    7 day

  • Sensitivity

    7 day

  • Specificity

    7 day

  • +1 more secondary outcomes

Study Arms (3)

Manual review

ACTIVE COMPARATOR

The images will be reviewed by the radiologists using BIRADS scheme without any assistance of artificial assistance. This review will be done off-line using a separate program in entirely manual mode. During this review, BIRADS descriptor choices by each radiologist and the time it takes for the radiologist to make such decision will be stored. Radiologists also make assessment decision without any intervention from artificial intelligence. 10 radiologists review manually.

Device: Ultrasound Image review with CADeDevice: Ultrasound Image review with CADxDevice: Ultrasound Image manual reviewProcedure: Biopsy

Review by S-Detect for Breast

EXPERIMENTAL

The same images will be separately processed by the artificial intelligence system (S-Detect for Breast) by Samsung. The two results, one by the radiologists and the other by artificial intelligence system, will be compared to statistically quantify equivalence (CADe).

Device: Ultrasound Image review with CADeDevice: Ultrasound Image manual review

Review with assistance of S-Detect for Breast

EXPERIMENTAL

Second, the images will be reviewed by the radiologists with the help of artificial intelligence system, which is an interactive tool automatically providing recommendations on BIRADS descriptor choices that can be modified by the radiologists. The radiologists, after selecting all the descriptors of BIRADS, will decide the assessment categories. These decisions will be compared with the ground truths generated from the biopsy results or a 24-month follow-up (CADx).

Device: Ultrasound Image review with CADxDevice: Ultrasound Image manual reviewProcedure: Biopsy

Interventions

This software is a computer-aided detection (CADe) software application, designed to assist radiologist to analyze breast ultrasound images. S-Detect automatically segments and classifies shape, orientation, margin, lesion boundary, echo pattern, and posterior feature characteristics of user-selected region of interest. The device uses deep learning methods to perform tissue segmentation and classification of images.

Also known as: S-Detect, S-Detect for Breast, CADe, Computer-Assisted Detection Device
Manual reviewReview by S-Detect for Breast

This software is also a computer-assisted diagnostic(CADx) software application, designed to assist a medical doctor in determining diagnosis by presenting whether a lesion is malignant in a breast ultrasound image obtained from an ultrasound imaging device.

Also known as: S-Detect, S-Detect for Breast, CADx, Computer-Assisted Diagnostic Device
Manual reviewReview with assistance of S-Detect for Breast

The images will be reviewed by the radiologists using BIRADS scheme without any assistance of artificial assistance. This review will be done off-line using a separate program in entirely manual mode. During this review, BIRADS descriptor choices by each radiologist and the time it takes for the radiologist to make such decision will be stored.

Also known as: Convetional Ultrasound image
Manual reviewReview by S-Detect for BreastReview with assistance of S-Detect for Breast
BiopsyPROCEDURE

Suspicious lesions found on breast ultrasound are then followed either by ultrasound guided biopsy or ultrasound imaging every 6 months for two years. For those who undergo biopsy, ultrasound provides images which are used to localize the lesion and guide the placement of the biopsy needle. The sample is sent to pathology for diagnosis, while the ultrasound guidance images are stored. For those who have imaging follow-up, ultrasound images of the breast mass are obtained, digitally stored and interpreted by the radiologist typically using BIRADS scheme.

Manual reviewReview with assistance of S-Detect for Breast

Eligibility Criteria

Age19 Years+
Sexall
Healthy VolunteersYes
Age GroupsAdult (18-64), Older Adult (65+)

You may qualify if:

  • Adult females or males recommended for ultrasound-guided breast lesion biopsy or ultrasound follow-up with at least one suspicious lesion
  • Age \> 18 years
  • Able to provide informed consent

You may not qualify if:

  • Unable to read and understand English
  • Unable or unwilling to provide informed consent
  • A patient with current or previous diagnosis of breast cancer in the same quadrant
  • Unable or unwilling to undergo study procedures
  • Subject Characteristics
  • Number of Subjects: 300 subjects from 300 separate breast lesions can be acquired. If a subject has more than 1 suspicious lesion, each may be chosen by the radiologist attending as suitable for "second review".
  • Vulnerable Subjects: It is unlikely that any UR students or employees will be enrolled unless their primary physician refers them to UR Medicine Breast Imaging at Red Creek for breast ultrasound and a suspicious lesion is found. We do not expect any of these referrals to be from staffs who work directly with the PIs.

Contact the study team to confirm eligibility.

Sponsors & Collaborators

Study Sites (1)

University of Rochester

Rochester, New York, 14642, United States

Location

MeSH Terms

Conditions

Breast Neoplasms

Interventions

Biopsy

Condition Hierarchy (Ancestors)

Neoplasms by SiteNeoplasmsBreast DiseasesSkin DiseasesSkin and Connective Tissue Diseases

Intervention Hierarchy (Ancestors)

CytodiagnosisCytological TechniquesClinical Laboratory TechniquesDiagnostic Techniques and ProceduresDiagnosisSpecimen HandlingDiagnostic Techniques, SurgicalSurgical Procedures, OperativeInvestigative Techniques

Study Officials

  • Avice O'Connell

    Department of Imaging Sciences, University of Rochester

    PRINCIPAL INVESTIGATOR
  • Kevin Parker

    Department of Electrical & Computer Engineering, University of Rochester

    PRINCIPAL INVESTIGATOR

Study Design

Study Type
interventional
Phase
not applicable
Allocation
RANDOMIZED
Masking
SINGLE
Who Masked
OUTCOMES ASSESSOR
Masking Details
The study consisted of 10 readers with varying levels of training and experience providing analysis on a randomized set of 300 patients' breast ultrasound data with and without S-Detect for Breast. Two reading periods separated by at least 3-week washout, totaling 600 cases analyzed per reader. PI and her associate have knowledge about patients diagnosis and other information. So, they are exclueded in readers for "reviewing". And all breast US images are de-indentified.
Purpose
DEVICE FEASIBILITY
Intervention Model
CROSSOVER
Model Details: This clinical study performed by multiple reader multiple case (MRMC) study design, where as set of clinical readers evaulate under multiple reading condition. All Interpreting physician(reader) independently read all of the cases. (fully-crossed design).
Sponsor Type
INDUSTRY
Responsible Party
SPONSOR

Study Record Dates

First Submitted

October 11, 2018

First Posted

October 16, 2018

Study Start

September 20, 2018

Primary Completion

November 30, 2019

Study Completion

January 31, 2020

Last Updated

October 29, 2019

Record last verified: 2019-10

Data Sharing

IPD Sharing
Will not share

Locations