Prospective Validation of an EHR-based Pancreatic Cancer Risk Model
1 other identifier
observational
6,134,060
1 country
1
Brief Summary
The goal of this prospective observational cohort study is to validate a previously developed pancreatic cancer risk prediction algorith (the PRISM model) using electronic health records from the general population. The main questions it aims to answer are:
- Will a pancreatic cancer risk model, developed on routine EHR data, reliably and accurately predict pancreatic cancer in real-time?
- What is the average time from model deployment and risk prediction, to the date of pancreatic cancer development and what is the stage of pancreatic cancer at diagnosis? The risk model will be deployed on data from individuals eligible for the study. Each individual will be assigned a risk score and tracked over time to assess the model's discriminatory performance and calibration.
Trial Health
Trial Health Score
Automated assessment based on enrollment pace, timeline, and geographic reach
participants targeted
Target at P75+ for all trials
Started Apr 2023
Typical duration for all trials
1 active site
Health score is calculated from publicly available data and should be used for screening purposes only.
Trial Relationships
Click on a node to explore related trials.
Study Timeline
Key milestones and dates
Study Start
First participant enrolled
April 21, 2023
CompletedFirst Submitted
Initial submission to the registry
July 17, 2023
CompletedFirst Posted
Study publicly available on registry
August 2, 2023
CompletedPrimary Completion
Last participant's last visit for primary outcome
July 1, 2026
ExpectedStudy Completion
Last participant's last visit for all outcomes
September 1, 2026
April 22, 2026
April 1, 2026
3.2 years
July 17, 2023
April 17, 2026
Conditions
Outcome Measures
Primary Outcomes (16)
Area under the receiver operating characteristic curve (AUROC) of PRISM for all groups stratified
To assess the discriminatory performance of PRISM for prospective identification of high-risk individuals for PDAC development. ROCs and AUROC numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location.
6 months from index date
Area under the receiver operating characteristic curve (AUROC) of PRISM for all groups stratified
To assess the discriminatory performance of PRISM for prospective identification of high-risk individuals for PDAC development. ROCs and AUROC numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location.
at 1 year
Area under the receiver operating characteristic curve (AUROC) of PRISM for all groups stratified
To assess the discriminatory performance of PRISM for prospective identification of high-risk individuals for PDAC development. ROCs and AUROC numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location.
at 2 years
Area under the receiver operating characteristic curve (AUROC) of PRISM for all groups stratified
To assess the discriminatory performance of PRISM for prospective identification of high-risk individuals for PDAC development. ROCs and AUROC numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location.
at 3 years
Calibration of PRISM for all groups stratified
To access how well the risk prediction by PRISM aligns with observed risk without recalibration. Calibration plots will be created for the whole population and groups stratified by age, sex, race, and geographical location.
6 months from index date
Calibration of PRISM for all groups stratified
To access how well the risk prediction by PRISM aligns with observed risk without recalibration. Calibration plots will be created for the whole population and groups stratified by age, sex, race, and geographical location.
at 1 year
Calibration of PRISM for all groups stratified
To access how well the risk prediction by PRISM aligns with observed risk without recalibration. Calibration plots will be created for the whole population and groups stratified by age, sex, race, and geographical location.
at 2 years
Calibration of PRISM for all groups stratified
To access how well the risk prediction by PRISM aligns with observed risk without recalibration. Calibration plots will be created for the whole population and groups stratified by age, sex, race, and geographical location.
at 3 years
PRISM performance metrics of high-risk group for direct screening
To evaluate sensitivity, specificity, PPV, and SIR for patients identified as high-risk by PRISM. Numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location. Risk threshold determined based on Standardized Incidence Ratio of 5 or greater. The absolute one-year risk thresholds are 0.1834% for PrismNN and 0.2048% risk for PrismLR. SIR 5 or greater was chosen because it is comparable to the current screening inclusion threshold for individuals with an inherited predisposition.
6 months from index date
PRISM performance metrics of high-risk group for direct screening
To evaluate sensitivity, specificity, PPV, and SIR for patients identified as high-risk by PRISM. Numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location. Risk threshold determined based on Standardized Incidence Ratio of 5 or greater. The absolute one-year risk thresholds are 0.1834% for PrismNN and 0.2048% risk for PrismLR. SIR 5 or greater was chosen because it is comparable to the current screening inclusion threshold for individuals with an inherited predisposition.
at 1 year
PRISM performance metrics of high-risk group for direct screening
To evaluate sensitivity, specificity, PPV, and SIR for patients identified as high-risk by PRISM. Numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location. Risk threshold determined based on Standardized Incidence Ratio of 5 or greater. The absolute one-year risk thresholds are 0.1834% for PrismNN and 0.2048% risk for PrismLR. SIR 5 or greater was chosen because it is comparable to the current screening inclusion threshold for individuals with an inherited predisposition.
at 2 years
PRISM performance metrics of high-risk group for direct screening
To evaluate sensitivity, specificity, PPV, and SIR for patients identified as high-risk by PRISM. Numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location. Risk threshold determined based on Standardized Incidence Ratio of 5 or greater. The absolute one-year risk thresholds are 0.1834% for PrismNN and 0.2048% risk for PrismLR. SIR 5 or greater was chosen because it is comparable to the current screening inclusion threshold for individuals with an inherited predisposition.
at 3 years
PRISM performance metrics of medium-risk group for biomarker testing
To evaluate sensitivity, specificity, PPV, and SIR for patients identified as medium-risk by PRISM. Numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location. Risk threshold determined by specificity 85%, with sensitivity around 46%. The absolute one-year risk thresholds are 0.0574% for PrismNN and 0.0564% for PrismLR. Prism operates as a tiered system for identifying individuals in need of screening with this lower risk threshold.
6 months from index date
PRISM performance metrics of medium-risk group for biomarker testing
To evaluate sensitivity, specificity, PPV, and SIR for patients identified as medium-risk by PRISM. Numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location. Risk threshold determined by specificity 85%, with sensitivity around 46%. The absolute one-year risk thresholds are 0.0574% for PrismNN and 0.0564% for PrismLR. Prism operates as a tiered system for identifying individuals in need of screening with this lower risk threshold.
at 1 year
PRISM performance metrics of medium-risk group for biomarker testing
To evaluate sensitivity, specificity, PPV, and SIR for patients identified as medium-risk by PRISM. Numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location. Risk threshold determined by specificity 85%, with sensitivity around 46%. The absolute one-year risk thresholds are 0.0574% for PrismNN and 0.0564% for PrismLR. Prism operates as a tiered system for identifying individuals in need of screening with this lower risk threshold.
at 2 years
PRISM performance metrics of medium-risk group for biomarker testing
To evaluate sensitivity, specificity, PPV, and SIR for patients identified as medium-risk by PRISM. Numbers will be calculated for the whole population and groups stratified by age, sex, race, and geographical location. Risk threshold determined by specificity 85%, with sensitivity around 46%. The absolute one-year risk thresholds are 0.0574% for PrismNN and 0.0564% for PrismLR. Prism operates as a tiered system for identifying individuals in need of screening with this lower risk threshold.
at 3 years
Secondary Outcomes (8)
Timing of incident PDAC occurrence
6 months from index date
Timing of incident PDAC occurrence
at 1 year
Timing of incident PDAC occurrence
at 2 years
Timing of incident PDAC occurrence
at 3 years
Tumor stage at PDAC diagnosis
6 months from index date
- +3 more secondary outcomes
Study Arms (1)
prospective general opulation cohort
Males and females age \>= 40 years, without a personal history of PDAC or current PDAC, with at least 2 clinical encounters to the HCO within the year prior to the study start date.
Interventions
A neural network model (PrismNN) and a logistic regression model (PrismLR) that use routinely collected EHR data to stratify individuals from the general population into PDAC risk groups
Eligibility Criteria
The cohort will be selected from 44 eligible HCOs comprised of community hospitals, outpatient clinics and academic medical centers from across the US.
You may qualify if:
- Male and females age \>= 40 years from 44 US HCOs from the TriNetX platform
- at least 2 clinical encounters to the HCO, within the last year, before the study start date
You may not qualify if:
- Personal history of PDAC or current PDAC
- Age below 40
- Notes on sampling method: no sampling was performed. All eligible individuals are included in this study.
Contact the study team to confirm eligibility.
Sponsors & Collaborators
- Massachusetts Institute of Technologycollaborator
- Beth Israel Deaconess Medical Centerlead
- TriNetX, LLCcollaborator
Study Sites (1)
Beth Israel Deaconess Medical Center
Boston, Massachusetts, 02115, United States
Study Officials
- PRINCIPAL INVESTIGATOR
Limor Appelbaum, MD
Beth Israel Deaconess Medical Center
Study Design
- Study Type
- observational
- Observational Model
- COHORT
- Time Perspective
- PROSPECTIVE
- Sponsor Type
- OTHER
- Responsible Party
- PRINCIPAL INVESTIGATOR
- PI Title
- Staff Scientist
Study Record Dates
First Submitted
July 17, 2023
First Posted
August 2, 2023
Study Start
April 21, 2023
Primary Completion (Estimated)
July 1, 2026
Study Completion (Estimated)
September 1, 2026
Last Updated
April 22, 2026
Record last verified: 2026-04
Data Sharing
- IPD Sharing
- Will not share