The effects of Mg substitution by Al on the specific heat of ${\mathrm{MgB}}_{2}$ have been studied in the normal and in the superconducting state. The Sommerfeld coefficient, evaluated by measurements in magnetic field up to 7 T, progressively decreases from $\ensuremath{\gamma}=3.0\ifmmode\pm\else\textpm\fi{}0.2{\mathrm{m}\mathrm{J}/\mathrm{m}\mathrm{o}\mathrm{l}\mathrm{}\mathrm{K}}^{2}$ for undoped ${\mathrm{MgB}}_{2}$ down to $\ensuremath{\gamma}=1.9\ifmmode\pm\else\textpm\fi{}0.2{\mathrm{m}\mathrm{J}/\mathrm{m}\mathrm{o}\mathrm{l}\mathrm{}\mathrm{K}}^{2}$ for ${\mathrm{Mg}}_{0.6}{\mathrm{Al}}_{0.4}{\mathrm{B}}_{2}$ as a result of the change of the density of states and of the electron-phonon coupling constants. The superconducting contribution to the specific heat ${c}_{\mathrm{sc}}$ clearly shows an excess at low temperature compared with conventional single-gap BCS behavior also for doped samples with x up to 0.3. The two-band model has been used to fit the temperature dependence of ${c}_{\mathrm{sc}}$ and the amplitude of the two gaps has been evaluated for different Al concentrations. The changes of the energy gaps are in a rather poor agreement with those predicted by taking into account changes in the electronic and phononic structure only. We suggest that disorder also plays an important role when Al substitutes Mg.