2022 Multilevel Intervention Training Institute Course Calendar

Introduction and welcome

• Goals of MLTI
• MLTI fit with the National Cancer Institute’s (NCI’s) mission

Programmatic perspective of MLIs

• MLIs as an integral part of the broader NCI’s Healthcare Delivery Research Program’s (HDRP) mission

Current attention to multilevel intervention research

• History of MLI research
• Definitions
• Why NCI is taking the lead to strengthen MLI research

Scope of MLI research in healthcare and public health

• What are MLIs?
• Why they are needed now
• How MLIs differ from single level interventions
• How MLIs differ from Implementation Science (IS) and Complex Health Interventions (CHI)

Questions and Answers

Exemplary case studies of MLI research (Confronting and overcoming MLI research challenges)

• Case Study 1. Community-Focused Multilevel Interventions (Single vs. multilevel levels)
• Case Study 2. Distinctive features and requirements for conducting MLI research within healthcare and community settings
• Case Study 3. Evaluation issues

Discussant 1: Observations on the case studies and how theory was employed

• What do the case studies tell us about the importance of theory and challenges in MLI use?
• Importance of the theory-related content of the MLI institute

Discussant 2: Observations on the designs, methods, and evaluation approaches employed in the case studies

• How MLI research aims differ from common single-level intervention research aims
• What are the design and methods challenges in studying MLIs?
• Importance of the design and methods-related content of the MLTI

Questions and Answers

Introduction to MLTI advanced learning

• Agenda review, training expectations and deliverables
• Curriculum Objectives
• Requirements for distance learning format
• Deliverables:
  • Small Group Projects
  • Capstone Project
  • Evaluation

Pre-MLTI evaluation

Plenary: Delivery of MLIs in public health

• Coordination at different levels
• Challenges in the delivery of MLIs in the real world
• Real time evaluation

Questions and Answers

Wrap-up

Welcome and introduction to Module 2

Overview and the importance of theory in multilevel research

Organizational theory

Team and group behavior theory

Individual behavior theory

Panel discussion: What makes theory valuable yet practical?

Role and use of theory: Discussion with Module 2 faculty

Small group discussion, Capstone project, and PPW overview

• Small group expectations
• Competency review
• Project Planning Worksheet
• Capstone Project

Individual small group discussion:

• Introduction to small group members
• Lightning presentation of trainee projects

Welcome and introduction to Module 4

Use of theory: practical guidance

• Overview: use of theory in intervention studies
• Combining theories at multiple levels
• Examples of theory application in MLI research

Intervention Mapping

• Theory and content
• Examples of applied Intervention Mapping

Application of theory: Discussion with Module 4 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of projects

Welcome and Introduction to Module 6

Part I: Quantitative Analytical Techniques

• Recap of key MLI research aims and questions
• Designs and methods challenges when studying MLIs
• Role of quantitative methods in addressing aims and challenges
• Data collection issues

Quantitative analytic techniques

• Multilevel, hierarchical modeling

Part I. Quantitative analytic techniques: Discussion with Module 5 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of projects

Welcome and introduction to Module 8

Part II: Quantitative Analytical Techniques

• Challenges to internal and external validity
• Foundations for statistical inference and the role of randomization
• Strategies for enhancing precision of inferences
• Statistical issues arising from clustering/nesting of sub-units within units

Configurational comparative methods

Part II. Quantitative analytic techniques: Discussion with Module 8 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of projects

Welcome and introduction to Module 10

Part III. Quantitative Analytic Techniques

• Mediation analysis
• Context, moderators

Part III. Quantitative analytic techniques: Discussion with Module 10 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of projects

Welcome and introduction to Module 12

Part I. Qualitative and mixed methods techniques

• Principles and practice of qualitative methods
• Application of qualitative methods to research on multilevel interventions
• Principles and practice of mixed methods
• Application of mixed methods to research on multilevel interventions

• Deborah Cohen
• Deborah Cohen
• Lawrence Palinkas
• Lawrence Palinkas

Part I. Qualitative and mixed methods techniques. Discussion with Module 12 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of projects

Welcome and introduction to Module 14

Part II. Qualitative and mixed methods techniques
Grant Writing 1:

• Rationale for qualitative and mixed methods

Project Planning 1:

• Use of qualitative and mixed methods for summative evaluation

Project Planning 2:

• Use of qualitative and mixed methods for formative/process evaluation

Part II. Qualitative and mixed methods techniques. Discussion with Module 14 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of projects

Welcome and introduction to Module 16

Measures and Measurement

• Identification of constructs and measures by level
• Data Collection
• Integrating measures from different levels
• Interactions within and across levels

Measures and Measurement. Discussion with Module 16 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of projects
• Capstone projects

Welcome and introduction to Module 18

• Capstone project refresher and guidance

Round table discussion:

• Linking the study question, theory and intervention
• Developing a multilevel / complex health intervention function / form matrix
• Combining study designs
• Developing a quantitative analysis plan for impact and process evaluation
• Developing a measurement plan

Putting it all together: Discussion with Module 18 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of Capstone projects

Welcome and introduction to Module 20

• Economic Analysis of MLIs

• Sustainability and Spread of MLIs

Application of MLIs: Discussion with Module 20 faculty

Individual small group discussion:

• Competency review
• Project Planning Worksheet (homework)
• Trainee discussion of Capstone projects
• MLTI Post-Test Evaluation

Welcome and introduction to the Capstone Presentations

Evaluation of MLTI

Capstone Presentations (5 minutes each)

Group 1 - Clinical

Implementation of Evidence-Based HPV Vaccine Guidelines into Dental Settings

A Multilevel Intervention to Increase Participation in Cancer Treatment Clinical Trials

Engaging Providers in Lung Cancer Prevention

Development of a technology-based multilevel intervention to treat neuropsychological symptoms for patients with colorectal cancer receiving chemotherapy

Optimizing cervical cancer screening guideline adherence and adoption

Panel Discussion (15 minutes)

Group 4 - Survivorship

Implementing a multilevel intervention to reduce financial toxicity and ensure successful HCTs from pediatric/oncology to adult/primary healthcare settings for oncology patients

Earlier goals of care conversations for improved gynecologic cancer care

CAREPlan: A Multilevel Intervention to Improve Cancer Care

Utilizing Necessary Information To Make End-of-Life Care Decisions (UNITED): A Multilevel Intervention to Improve Latinx Advanced Cancer Patients’ Engagement in Advance Care Planning (ACP)

Panel Discussion (15 minutes)

Group 2 - Prevention

Exploring the Feasibility of Multilevel Strategies to Promote HPV Vaccination in Independent Provider Practices in Brooklyn

Multilevel Interventions to deimplement over screening for colorectal cancer among patients with prior low-risk adenomas

Multilevel Interventions to Address Adolescent Tobacco Use

Optimization of a Multilevel Mentored Community Gardening Intervention for Melanoma Patients

Panel Discussion (15 minutes)

Group 3 - Screening

Leveraging Explainable Artificial Intelligence (XAI) to Promote Shared Decision Making in Lung Cancer Screening Through a Multilevel Intervention (LEAPS-LCS)

A Multilevel Intervention to Address Disparities in Lung Cancer Screening

Panel Discussion (15 minutes)

MLTI Graduation and Closing Remarks

Welcome and introduction to the Capstone Presentations

Evaluation of MLTI

Capstone Presentations (5 minutes each)

Group 4 - Survivorship

Collaborative Oncology: Radiation and Radiology Evaluation of Contoured Targets (CORRECT): Facilitating Radiology Input During the Creation of Lung Cancer Radiation Treatment Plans

Leveraging Community Organizations to Alleviate Financial Toxicity among AYA Cancer Survivors

Developing a multilevel intervention to address disparities in adherence to endocrine therapy for breast cancer

Improving the Implementation of Self-Management Support in Cancer Care: Development of an Implementation Intervention

Panel Discussion (15 minutes)

Group 3 - Screening

Using Predicted Adherence of Lung Cancer Screening Among Underserved and Minority Communities to Intervene at Multiple Levels

Developing and testing the efficacy of a multi-level intervention to increase breast health awareness and uptake of Breast Examination as an approach to early diagnosis of breast cancer among women 40-65 years in a rural Ileje District, Tanzania

Improving lung cancer screening for people with HIV (PWH)

Population based screening for hereditary cancer syndromes

Panel Discussion (15 minutes)

Group 2 - Prevention

A Multilevel Intervention to Promote Concurrent Colorectal Cancer and Hepatitis C Virus Screening Behaviors

A Multilevel Intervention to Increase Lung Cancer Screening Attendance in Emergency Department Patients

A Culturally-Targeted, Community Health Worker-Led Intervention to Increase U.S. Vietnamese Adolescents’ HPV Vaccine Uptake

Panel discussion (15 minutes)

Group 1 -Clinical

Strategies for Breast Cancer Screening and Early Detection in Northern Tanzania: A Multi Level Intervention

A Multilevel Intervention for Persons at High Risk for Delayed Lung Cancer Treatment

Disparities in Access to Cancer Clinical Trials

Panel Discussion (15 minutes)

MLTI Graduation and Closing Remarks