Assess the Clinical Effectiveness in AI Prioritising CT Heads
ACCEPT
A Mixed Methods Study to Assess the Clinical Effectiveness and Acceptability of qER Artificial Intelligence Software to Prioritise CT Head Interpretation.
1 other identifier
observational
16,800
1 country
4
Brief Summary
Non-Contrast Computed Tomography (NCCT) of the head is the most common imaging method used to assess patients attending the Emergency Department (ED) with a wide range of significant neurological presentations including trauma, stroke, seizure and reduced consciousness. Rapid review of the images supports clinical decision-making including treatment and onward referral. Radiologists, those reporting scans, often have significant backlogs and are unable to prioritise abnormal images of patients with time critical abnormalities. Similarly, identification of normal scans would support patient turnover in ED with significant waits and pressure on resources. To address this problem, Qure.AI has worked to develop the market approved qER algorithm, which is a software program that can analyse CT head to identify presence of abnormalities supporting workflow prioritisation. This study will trial the software in 4 NHS hospitals across the UK to evaluate the ability of the software to reduce the turnaround time of reporting scans with abnormalities that need to be prioritised.
Trial Health
Trial Health Score
Automated assessment based on enrollment pace, timeline, and geographic reach
participants targeted
Target at P75+ for all trials
Started Mar 2024
Shorter than P25 for all trials
4 active sites
Health score is calculated from publicly available data and should be used for screening purposes only.
Trial Relationships
Click on a node to explore related trials.
Study Timeline
Key milestones and dates
First Submitted
Initial submission to the registry
August 11, 2023
CompletedFirst Posted
Study publicly available on registry
September 7, 2023
CompletedStudy Start
First participant enrolled
March 27, 2024
CompletedPrimary Completion
Last participant's last visit for primary outcome
August 1, 2024
CompletedStudy Completion
Last participant's last visit for all outcomes
August 1, 2024
CompletedMarch 21, 2024
March 1, 2024
4 months
August 11, 2023
March 19, 2024
Conditions
Outcome Measures
Primary Outcomes (1)
Reporting turnaround time with qER prioritisation
Time taken to report NCCT head from acquisition for patients with prioritised findings in Emergency Department compared to standard of care. Measured as time in minutes from the scan acquisition to the final radiology report of prioritised scans.
1 year
Secondary Outcomes (14)
Reporting turnaround time with qER prioritisation for scans without prioritised findings in Emergency Department compared to standard of care.
1 year
Reporting turnaround time with qER prioritisation for scans with an absence of findings in Emergency Department compared to standard of care.
1 year
Assess the impact of qER on radiology reporting workflow on other requests for CT scans.
1 year
Impact of qER supported reporting on teleradiology.
1 year
Assess utility of qER to support clinical decision making of the patients from the emergency department requiring an NCCT.
1 year
- +9 more secondary outcomes
Study Arms (2)
Pre-implementation of qER
Baseline data: During the pre-implementation phase, we will be gathering data around the technical requirements for integrating qER into the radiology workflow. A random sample of 500 scans per site will be sent for the ground-truthing process for the purpose of technical evaluation. We will also be collecting data on the baseline status of all the endpoints including TAT. The reporting of NCCT scans will follow the same workflow as the current standard of care (i.e., the images/cases will appear in the RIS chronologically and the radiologist either follows this order or prioritises some cases based on communication from ED).
Post-implementation of qER
Post-implementation (Trial Intervention) In the post-implementation phase, there will be a notification (prioritised flag) in RIS. The order of the cases in RIS will not be altered. When the radiologist clicks a case in RIS, a secondary capture of qER along with the original images will be available in PACS. This secondary capture will have a contour showing the algorithm's attention point for a specific abnormality. The radiologist can then choose to agree with qER findings as it is or modify or ignore it according to their clinical judgement, writing and finally signing off the report. For scans which were not processed by qER the radiologist can prioritise and report as per the standard of care.
Interventions
Qure.ai's emergency room software solution qER (qER EU 2.0) is an AI medical device, developed by training a deep-learning algorithm using over 300,000 scans labelled by expert radiologists. qER has been shown to be accurate in identifying a range of abnormalities in NCCT head scans as well as prioritising them for urgent review and radiologist reporting. It is designated as a clinical support tool and, when used with original scans, can assist the clinician to improve efficiency, accuracy, and turnaround time in reading head CTs.
Eligibility Criteria
At each of the four participating sites, we will identify all patients referred through the Emergency Department NCCT requests.
You may qualify if:
- Individuals undergoing Head CT scan at the ED / A\&E (Accident and Emergency Services).
- Non-contrast axial CT scan series with consistently spaced axial slices.
- Soft reconstruction kernel covering the complete Brain.
- Maximum slice thickness of 6mm.
Contact the study team to confirm eligibility.
Sponsors & Collaborators
- Guy's and St Thomas' NHS Foundation Trustlead
- Qure.aicollaborator
- NHS Greater Glasgow and Clydecollaborator
- Northumbria Healthcare NHS Foundation Trustcollaborator
- Oxford University Hospitals NHS Trustcollaborator
Study Sites (4)
NHS Greater Glasgow and Clyde
Glasgow, United Kingdom
Guy's and St.Thomas Trusts
London, SE1 7EH, United Kingdom
Northumbria Healthcare NHS Foundation Trust
Northumberland, NE27 0QJ, United Kingdom
Oxford University Hospitals
Oxford, OX3 9DU, United Kingdom
Related Publications (1)
Vimalesvaran K, Robert D, Kumar S, Kumar A, Narbone M, Dharmadhikari R, Harrison M, Ather S, Novak A, Grzeda M, Gooch J, Woznitza N, Hall M, Shuaib H, Lowe DJ. Assessing the effectiveness of artificial intelligence (AI) in prioritising CT head interpretation: study protocol for a stepped-wedge cluster randomised trial (ACCEPT-AI). BMJ Open. 2024 Jun 16;14(6):e078227. doi: 10.1136/bmjopen-2023-078227.
PMID: 38885990DERIVED
MeSH Terms
Conditions
Condition Hierarchy (Ancestors)
Study Officials
- STUDY CHAIR
Haris Shuaib, MSc
Guy's and St.Thomas' Hospitals
Central Study Contacts
Study Design
- Study Type
- observational
- Observational Model
- COHORT
- Time Perspective
- PROSPECTIVE
- Target Duration
- 28 Days
- Sponsor Type
- OTHER
- Responsible Party
- SPONSOR
Study Record Dates
First Submitted
August 11, 2023
First Posted
September 7, 2023
Study Start
March 27, 2024
Primary Completion
August 1, 2024
Study Completion
August 1, 2024
Last Updated
March 21, 2024
Record last verified: 2024-03
Data Sharing
- IPD Sharing
- Will not share