Frequently Asked Questions

How was the PRO-CTCAE Measurement System developed?

Visit the Development, Testing, and Implementation page for more information.

When PRO-CTCAE or Ped-PRO-CTCAE will be included in a trial how should I decide which symptomatic adverse events to measure and at what time points?

Selecting which symptomatic adverse events to assess and determining the time points for measurement are critical trial design decisions. In trials developed to date, items from the PRO-CTCAE or from Ped-PRO-CTCAE and the time points of measurement have generally been specified using an approach similar to that used to define the adverse event surveillance plan for the trial more broadly. That is, the study team reviews published data, as well as data from earlier phase trials or animal models, if available, and incorporates information about the known or anticipated on- and off-target effects of agents in a similar mechanistic class, to identify those symptomatic adverse events likely to be associated with the regimens in the trial.

After establishing a pre-treatment baseline, more frequent PRO-CTCAE or Ped-PRO-CTCAE administration is generally warranted during the first few cycles of therapy (e.g., weekly reporting during the initial several months of therapy). Thereafter, the assessment intervals may be extended (e.g., monthly or quarterly, depending on the regimen under study), particularly in trial contexts where the duration of investigational treatment is prolonged or where toxicities are anticipated to have stabilized. In summary, the time points of measurement should reflect the anticipated pattern of toxicity, and the scientific objectives of the trial.

Can I change the recall period from ‘over the past 7 days’ to ‘in the past month’?

At this time, we cannot recommend use of longer or shorter PRO-CTCAE or Ped-PRO-CTCAE recall periods. The standard PRO-CTCAE recall period is “the past 7 days”. A recent study suggests that longer recall periods (2-, 3- or 4- week recall) are associated with small but successively increasing measurement error. This must be considered if recall periods longer than 1 week are going to be used in a trial for logistical reasons.

On average, how long does it take a respondent to complete PRO-CTCAE?

Based on our findings, PRO-CTCAE items are completed rapidly by adults. We estimate that a 20-item PRO-CTCAE survey would take on average 3.4 minutes by paper, 3.7 minutes by web, and 5.4 minutes by interactive voice response system (IVRS).

Research in adults also indicates that there is no evidence of clinically meaningful variation in completion times by participant characteristics, including impairments in physical or cognitive functioning (Mode equivalence and acceptability of tablet computer-, interactive voice response system-, and paper-based administration of the U.S. National Cancer Institute's Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE).External Web Site Policy). These findings suggest that completion of PRO-CTCAE items by adults is generally not laborious, even for those respondents who may have some degree of functional limitation.

Estimates of the total time for adults to complete a survey by each mode depend upon the number of items presented to the respondent. As an additional consideration, because paper surveys do not incorporate conditional branching patterns, as do web-based and IVRS surveys, a participant completing a paper survey would likely have to complete more PRO-CTCAE items, compared to the same participant completing PRO-CTCAE using an electronic version of the questions.

As an example of an estimate of respondent burden in adults for human subjects research applications, 75% of respondents would be able to complete twenty items in 3.8 minutes by web, in 6.1 minutes by IVRS, and in 4.3 minutes by paper.

How is PRO-CTCAE scored?

At the present time, PRO-CTCAE responses are scored from 0 to 4 (or 0/1 for absent/present), and there are no guidelines yet established for how to combine attributes into a single score or how best to analyze PRO-CTCAE data longitudinally. These are topics of ongoing studies. PRO-CTCAE scores for each attribute (frequency, severity and/or interference) should be presented descriptively (eg. summary statistics or graphical presentations).

CTCAE grades for the corresponding time period should be presented alongside PRO-CTCAE scores. The proportion of missing data should also be summarized to aid interpretation.

How is Ped-PRO-CTCAE scored?

Ped-PRO-CTCAE responses are scored from 0 to 3 (or 0/1 for absent/present), and there are no established guidelines for how to combine attributes into a single score or how best to analyze Ped-PRO-CTCAE data longitudinally. These are topics of ongoing studies. Ped-PRO-CTCAE scores for each attribute (frequency, severity and/or interference) should be presented descriptively (eg. summary statistics or graphical presentations).

CTCAE grades for the corresponding time period should be presented alongside PRO-CTCAE scores. The proportion of missing data should also be summarized to aid interpretation.

Is there, and should there be, a perfect correspondence between PRO-CTCAE or Ped-PRO-CTCAE scores and clinicians’ CTCAE grades?

No there is not, nor should there be. One should expect this for many reasons, including:

  • Clinicians and patients providing their reports at differing time points
  • Clinicians and patients reporting on slightly different phenomena (eg. sadness vs. depression)
  • Frequent management of severe toxicity by clinicians may skew clinician perceptions of symptom severity
  • Patients may under-report symptoms to their clinicians due to time constraints, a desire to avoid an appearance that they are complaining or bothering their clinician, as well as concerns about not qualifying for continued treatment, and/or being removed from a study protocol or receiving a lower dose of treatment, if they report toxicities.

Disagreement between patient-reported and clinician-reported symptomatic toxicity has been extensively described. Research has shown a varying relationship between self-report of symptoms and clinician-based CTCAE grades (See: Xiao C, Polomano R, Bruner DW. Comparison between patient-reported and clinician-observed symptoms in oncology.External Web Site Policy Policy Cancer Nurs 2013 Nov-Dec;36(6):E1-E16. Review).

Several additional key points:

  • Criteria for grading on the CTCAE scale vary by toxicity, however by convention, grade 1 typically refers to asymptomatic or mild symptoms not requiring intervention, grade 2 refers to moderate symptoms that interfere somewhat with daily function and where some intervention may be indicated, and grade 3 refers to severe symptoms that interfere with daily activities or require more significant intervention. Grade 4 toxicity (life-threatening, with urgent intervention indicated) and Grade 5 (death) are indicative of significantly higher levels of toxicity, and are rarely applied for symptomatic toxicities such as fatigue, tinnitus, hoarseness or xerostomia. Thus, a patient-reported symptom of 'severe' or 'very severe' may not therefore correspond to CTCAE grade 4 or 5 toxicity. In addition many of the symptomatic toxicities in the CTCAE do not permit assignment of a grade higher than grade 3.
  • While there is apparent similarity between grading scales for PRO-CTCAE or Ped-PRO-CTCAE and CTCAE, differences between CTCAE grades and PRO-CTCAE or Ped-PRO-CTCAE derived scores should not be over-interpreted. Disagreement between PRO-CTCAE or Ped-PRO-CTCAE scores and CTCAE grades may not represent 'under-ascertainment' by clinicians or 'over-reporting' by patients. For example, a patient may meet CTCAE criteria for grade 1 vomiting (1-2 episodes separated by 5 minutes in a 24 hour period), but to the patient, two daily episodes of vomiting constitutes a severe symptom.
  • There are unique challenges when attempting to directly compare CTCAE grades and PRO-CTCAE or Ped-PRO-CTCAE scores. These toxicity scoring instruments were not developed for direct comparison but rather were designed to be complementary strategies for capturing symptomatic adverse events. The NCI is leading an effort to determine the best approaches to scoring PRO-CTCAE, and ultimately to using the PRO-CTCAE scores to assign a CTCAE grade.

What is the conditional branching logic that should be employed when PRO-CTCAE or Ped-PRO-CTCAE is used on an electronic platform?

PRO-CTCAE has been developed and tested with a conditional branching logic that helps to reduce respondent burden. Conditional branching should be employed for electronic administration of PRO-CTCAE symptom terms that have two or more items. The logic branches from frequency, then to severity, then to interference. For example, if frequency is > (greater than) never, you next pose the severity question, and if severity>none, you pose the interference question.

Is there any other guidance that a developer of an electronic PRO administration instance should consider when using PRO-CTCAE?

PRO-CTCAE questions were developed and tested using a ‘wide’ layout (see below for an example), and have been shown to be equivalent when administered on tablet computer, interactive voice response system (IVRS), or paper. Equivalence using other layouts (eg. vertical response choices) or other devices (eg. smartphone) has not been studied.

PRO-CTCAE and Ped-PRO-CTCAE questions should be grouped in bundles (eg. frequency, severity and interference) so as to preserve the sequencing of the cognitive task patients are completing when answering (ie. reflecting on the different attributes of a single symptom). For an example, please see below.

Mouth and Throat Sores

What was the severity of your mouth and throat sores at their worst?

  • None
  • Mild
  • Moderate
  • Severe
  • Very severe

How much did mouth and throat sores interfere with your usual or daily activities?

  • Not at all
  • A little bit
  • Somewhat
  • Quite a bit
  • Very much

In our studies in adults older than age 18, the whole group of questions about a particular symptom has been presented on a single screen, although because of conditional branching, questions only appear on the screen if the answer to the first question is greater than never (frequency) or none (severity).

A PRO-CTCAE mode equivalence study in adults older than age 18 has been performed examining psychometric equivalence of responses gathered using web-enabled tablets (screen size ranging from 10-12 inches), IVRS and paper. Participants were drawn from one of 6 clinical sites, and included older respondents and those with poor performance status. All respondents were currently undergoing cancer treatment.

There is psychometric evidence in adults older than age 18 to justify comparison of results and pooled analyses across studies that employ different PRO-CTCAE modes of administration (Mode equivalence and acceptability of tablet computer-, interactive voice response system-, and paper-based administration of the U.S. National Cancer Institute's Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE).External Web Site Policy). Administration of PRO-CTCAE via different modes including desk top computers, web-enabled tablet computers, IVRS, and paper offers flexibility for patients and for study operations personnel.

Can I reprint items from the PRO-CTCAE Measurement System in a publication?

PRO-CTCAE items should not be reprinted in a publication. Instead, please cite the appropriate reference to our PRO-CTCAE web site (https://healthcaredelivery.cancer.gov/pro-ctcae/) in the reference list.

I am interested to develop and test additional reflecting symptom terms not currently included in the PRO-CTCAE or Ped-PRO-CTCAE Item Libraries. Who should I contact to discuss that further?

We have several early adopters testing additional or revised items that may one day be included in the PRO-CTCAE Measurement System.

To protect the integrity of the PRO-CTCAE Measurement System, the US National Cancer Institute holds the trademark for PRO-CTCAE, all translations, and all related documents. To assure standardization, users of the PRO-CTCAE Measurement System are not permitted to adapt or otherwise modify the PRO-CTCAE instruments (including symptom terms, item phrasing, response choices and recall period) as specified on the PRO-CTCAE Instrument page without prior written consent of the National Cancer Institute.

If you have interest in developing and testing additional or revised PRO-CTCAE items, please be in touch with us by e-mail to discuss this interest and your planned approach.

Has PRO-CTCAE or Ped-PRO-CTCAE been translated for use in other languages?

Please visit the Language Translation page for more information.

Last Updated: 22 Apr, 2020