Evaluating an AI-Generated Health Podcast

NCT06891495 | Recruiting

• 1 other identifier: QassimU5
• Study Type: observational
• Target: 30
• Locations: 1 country
• Sites: 1

Brief Summary

This study aims to explore a new way of delivering health information using an AI-generated podcast. The podcast, created with Google NotebookLM, uses verified content from the American Academy of Periodontology website to provide easy-to-understand information on gum health and prevention. The goal is to determine whether this AI-generated podcast is a useful, engaging, and clear tool for educating the general public about health topics. Traditional health podcasts often feature expert interviews and can be lengthy, which sometimes limits their appeal and accessibility. By using AI to generate the podcast, investigator hope to offer a more standardized and concise presentation that avoids technical jargon. To evaluate the podcast, investigator developed a questionnaire based on the Questionnaire for Assessing Educational Podcasts (QAEP). This questionnaire was adapted to better suit a non-specialist audience and covers four key areas: how easy the podcast is to access and use, the design and structure of the podcast, the clarity and completeness of the content, and the podcast's value as a learning tool. Before using this questionnaire with the general public, investigator sent it to 10 experts in dentistry, public health, and communication for their review and feedback. Their input helped us make minor modifications to ensure the questionnaire is both clear and scientifically sound. After these revisions, investigator conducted a pilot study with 30 members of the general public who listened to the podcast and completed the questionnaire. This study will assess the feasibility and validity of using an AI-generated podcast as a health education tool. The results will help determine if this approach can effectively improve public understanding of health information and may guide the future design of digital health communication strategies.

Conditions

Public Health; Artificial Intelligence; Feasibility Studies

Outcome Measures

Primary Outcomes (4)

• Content Validity Index (CVI) of the Adapted Questionnaire

  Description: This outcome measure evaluates the content validity of the questionnaire adapted from QAEP, as determined by expert ratings. The Content Validity Index (CVI) quantifies the proportion of experts who rate questionnaire items as relevant or highly relevant. Unit of Measure: Score on a scale from 0 to 1, where scores above 0.78 indicate acceptable content validity

  From 7th February 2025 to 25th February 2025

• Internal Consistency Reliability of the Adapted Questionnaire

  Description: This outcome measure assesses the internal consistency reliability of the adapted questionnaire using Cronbach's Alpha coefficient, which measures how closely related the items are as a group. Unit of Measure: Cronbach's Alpha coefficient on a scale from 0 to 1, where values above 0.7 indicate acceptable reliability

  From 7th February 2025 to 25th February 2025

• Public Perception Score of the AI-Generated Health Podcast

  Description: This outcome measure assesses the general public's overall perception of the AI-generated health podcast using the validated questionnaire. Unit of Measure: Composite score on a 5-point Likert scale (1-5), where 1 represents "Strongly Disagree" and 5 represents "Strongly Agree"

  From 27th February 2025 to 15th April 2025

• Domain-Specific Evaluation Scores of the AI-Generated Health Podcast

  Description: This outcome measure assesses the general public's evaluation of specific domains of the AI-generated health podcast, including accessibility, design, content adequacy, and educational value. Unit of Measure: Mean scores for each domain on a 5-point Likert scale (1-5), where 1 represents "Strongly Disagree" and 5 represents "Strongly Agree"

  From 27th February 2025 to 15th April 2025

Study Arms (2)

Expert Validation Group

This group comprises approximately 10 subject matter experts-including dental specialists, public health professionals, and communication experts-who are engaged in evaluating and refining the adapted questionnaire. Their feedback on clarity, relevance, and content validity is used to ensure that the measurement tool is scientifically robust before its deployment in the subsequent phase of the study.

Other: Expert Evaluation of Adapted Questionnaire; Other: AI-Generated Health Podcast Evaluation

General Public Cohort

This group includes approximately 30 participants from the general public representing diverse ages, genders, and educational backgrounds. Participants in this cohort will listen to the AI-generated health podcast (focused on gum health and prevention) and then complete the validated questionnaire to assess the podcast's accessibility, design, content adequacy, and educational value.

Other: Expert Evaluation of Adapted Questionnaire; Other: AI-Generated Health Podcast Evaluation

Interventions

Expert Evaluation of Adapted Questionnaire OTHER

This intervention involves inviting a group of subject matter experts-including dental specialists, public health professionals, and communication experts-to evaluate the adapted questionnaire. The questionnaire, derived from the Questionnaire for Assessing Educational Podcasts (QAEP) and tailored for assessing an AI-generated health podcast, covers four dimensions: Access and Use, Design and Structure, Content Adequacy, and Value as an Aid to Learning. Experts will complete a structured online survey (via Google Form) to rate each item's clarity, relevance, and necessity. Their feedback is integral to refining and validating the instrument prior to its use with the general public.

Expert Validation Group; General Public Cohort

AI-Generated Health Podcast Evaluation OTHER

Participants in this group will first listen to a 4-minute AI-generated health podcast on gum health and prevention. The podcast was produced using Google NotebookLM and is based on publicly available information from the American Academy of Periodontology, with appropriate source credit. After listening, participants will complete a validated questionnaire (administered via Google Form) that assesses the podcast's accessibility, design, content adequacy, and educational value. This intervention is designed to measure public perception, engagement, and overall feasibility of using AI-generated podcasts as an educational tool for health communication.

Expert Validation Group; General Public Cohort

Eligibility Criteria

• Age: 18 Years+
• Sex: all
• Healthy Volunteers: Yes
• Age Groups: Adult (18-64), Older Adult (65+)
• Sampling Method: Non-Probability Sample

Study Population

Expert Group: Approximately 10 professionals from fields such as dentistry, public health, and health communication. Their extensive experience and academic backgrounds ensure rigorous content and reliability validation of the questionnaire, making it scientifically robust for assessing AI-generated health podcasts. General Public Group: Around 30 individuals from diverse demographic backgrounds (age, gender, education) representing the target audience. They will evaluate the AI-generated podcast on gum health and prevention using the validated questionnaire, providing insights into the podcast's accessibility, clarity, and educational impact.

You may qualify if:

• Licensed professionals and recognized experts in relevant fields such as dentistry, public health, and health communication
• Minimum of 5 years of professional experience in their respective fields
• Prior involvement in healthcare education, research, or digital health communication
• Willingness to review and provide detailed feedback on the adapted questionnaire
• Ability to complete the survey in English

You may not qualify if:

• Professionals without formal training or relevant expertise in the specified fields
• Individuals with conflicts of interest that might compromise the objectivity of their evaluations
• Experts who are unable to commit the necessary time to provide thorough feedback
• General Public Group
• Adults aged 18 years or older
• Individuals fluent in English
• Access to a digital audio device and an internet connection to listen to the podcast and complete the survey
• Consent to participate in the study
• Individuals with significant hearing impairments that might hinder the ability to comprehend the audio content
• Healthcare professionals or individuals with advanced training in dentistry or health communication
• Persons who have participated in similar educational podcast studies previously

Sponsors & Collaborators

• Qassim University: lead

Study Sites (1)

College of Applied Medical Sciences

Al Kharj, Al Qassim, 58883, Saudi Arabia

RECRUITING

Related Publications (3)

• Loeb S, Sanchez Nolasco T, Siu K, Byrne N, Giri VN. Usefulness of podcasts to provide public education on prostate cancer genetics. Prostate Cancer Prostatic Dis. 2023 Dec;26(4):772-777. doi: 10.1038/s41391-023-00648-4. Epub 2023 Jan 21.

  PMID: 36681741 BACKGROUND

• Alarcon R, Blanca MJ. Development and Psychometric Properties of the Questionnaire for Assessing Educational Podcasts (QAEP). Front Psychol. 2020 Nov 23;11:579454. doi: 10.3389/fpsyg.2020.579454. eCollection 2020.

  PMID: 33329233 RESULT

• Leite PL, Torres FAF, Pereira LM, Bezerra AM, Machado LDS, Silva MRFD. Construction and validation of podcast for teen sexual and reproductive health education. Rev Lat Am Enfermagem. 2022 Oct 3;30(spe):e3706. doi: 10.1590/1518-8345.6263.3706. eCollection 2022.

  PMID: 36197393 RESULT

Study Officials

• Shiva Shankar Bugude, MDS

  Qassim University

  PRINCIPAL INVESTIGATOR

Central Study Contacts

Shiva Shankar Bugude, MDS

CONTACT

+966531476028; S.ggg@qu.edu.sa

Varadharajula Venkata Ramaiah, MDS

CONTACT

+966530781575; V.Vardharajula@qu.edu.sa

Study Design

• Study Type: observational
• Observational Model: OTHER
• Time Perspective: OTHER
• Sponsor Type: OTHER
• Responsible Party: PRINCIPAL INVESTIGATOR
• PI Title: Assistant Professor

Study Record Dates

• First Submitted: March 17, 2025
• First Posted: March 24, 2025
• Study Start: February 7, 2025
• Primary Completion: April 15, 2025
• Study Completion: May 20, 2025
• Last Updated: March 26, 2025

Record last verified: 2025-03

Locations

SA (1)