Efficacy of AD04, an aluminum-based vaccine adjuvant, in patients with early Alzheimer's disease: Post hoc analysis of AFF006 (NCT01117818), a proof-of-concept, phase 2 randomized controlled trial

BackgroundThe AFF006 trial (NCT01117818) provided unexpected evidence of benefits of the vaccine adjuvant AD04 (aluminum oxyhydroxide) in patients with early Alzheimer's disease (AD), compared with AD02, a vaccine consisting of a peptide that mimics the N-terminal region of human amyloid-β (Aβ) conjugated with keyhole limpet hemocyanin.ObjectiveThe objective of this post hoc analysis was to assess whether this unexpected benefit of AD04 was an artifact of multiple testing (i.e., type I error inflation) or a robust result.MethodsIn this post hoc assessment, we used permutation testing to estimate type I error inflation due to the evaluation of multiple outcomes in AFF006. Efficacy was assessed using a patient-level global statistical test combining composite endpoints of cognition, function, and global AD. In addition, we examined the observed treatment benefits of AD04 in the context of effects observed in trials of aducanumab, donanemab, and lecanemab, monoclonal anti-Aβ antibodies that received regulatory approval for AD.ResultsThe global statistical test suggested a treatment benefit of AD04 versus ineffective AD02 arms, even after accounting for multiplicity (primary methodology p-value, 0.03; permutation test p-value, 0.02). The observed effect estimates for AD04 compared favorably with approved monoclonal antibodies.ConclusionsPost-hoc analyses are hypothesis generating rather than confirmatory. Adjusting for multiplicity using permutation testing can determine whether post-hoc effects are worth pursuing, or unlikely to be confirmed. These analyses have motivated a follow-up prospective randomized controlled trial, ADVANCE (EudraCT 2022-003532-73), in which optimized AD04 dosing will be compared to placebo in early AD.