Abstract A predictive P‐value is proposed to measure the difference between an actual and predicted outcome in assessing the validity of an hypothesized prediction model. The concept is illustrated by applications to multiple regression prediction and to the validation of forecast models.