Is Shorter Always Better? Relative Importance of Questionnaire Length and Cognitive Ease on Response Rates and Data Quality for Two Dietary Questionnaires

Abstract In this study, the authors sought to determine the effects of length and clarity on response rates and data quality for two food frequency questionnaires (FFQs): the newly developed 36-page Diet History Questionnaire (DHQ), designed to be cognitively easier for respondents, and a 16-page FFQ developed earlier for the Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial. The PLCO Trial is a 23-year randomized controlled clinical trial begun in 1992. The sample for this substudy, which was conducted from January to April of 1998, consisted of 900 control and 450 screened PLCO participants aged 55–74 years. Controls received either the DHQ or the PLCO FFQ by mail. Screenees, who had previously completed the PLCO FFQ at baseline, were administered the DHQ. Among controls, the response rate for both FFQs was 82%. Average amounts of time needed by controls to complete the DHQ and the PLCO FFQ were 68 minutes and 39 minutes, respectively. Percentages of missing or uninterpretable responses were similar between instruments for questions on frequency of intake but were approximately 3 and 9 percentage points lower (p ≤ 0.001) in the DHQ for questions on portion size and use of vitamin/mineral supplements, respectively. Among screenees, response rates for the DHQ and the PLCO FFQ were 84% and 89%, respectively, and analyses of questions on portion size and supplement use showed few differences. These data indicated that the shorter FFQ was not better from the perspective of response rate and data quality, and that clarity and ease of administration may compensate for questionnaire length.