Crop rotation is a critical management tool to diversify and enhance the sustainability of cropping systems. Although it is well established that rotating crops can break disease cycles, reduce reliance on synthetic fertilizers, and improve soil health, the legacy effects of specific rotation crops on plant-associated microbial communities are poorly understood. In this work, we used a multi-year crop rotation experiment that included winter wheat, winter triticale, or winter canola as rotation crops integrated into a continuous spring wheat monoculture. Rhizosphere and root microbiomes of spring wheat following each crop were characterized using bacterial and fungal amplicon sequencing (16S and ITS1 regions, respectively). Additionally, the abundance of soil and rhizosphere microbiota was quantified using PLFA.Although sampling year and plant compartment were the strongest drivers of microbial community composition and diversity, the identity of the previous crop resulted in legacies in both rhizosphere and root communities. Core wheat rhizosphere taxa were reduced in spring wheat following canola, such as Rhizobium,Mucilaginibacter, Sphingomonas. Burkholderia and Oxalobacteraceae. Notably, many Actinobacteria (eg. Streptomyces) were relatively enriched in wheat roots following canola versus other crops, which may be related to reduced soil moisture recharge. Similarly, among fungi we observed reductions in relative abundances of arbuscular mycorrhizal taxa (Glomeromycota) as well as enrichment of potential root pathogens (eg. Waitea) following canola. Taken together, these results suggest that interactions among soil environmental characteristics and plant-associated microbiomes should be carefully considered when designing crop rotation strategies to promote crop yields.