A protocol or guiding principle for the toughening of cross-linked polymers by rotaxane cross-linking is proposed. Rotaxane-cross-linked polymers (RCPs), which use rotaxane structures at the cross-linking points, have attracted great interest due to their unique properties as, e.g., extremely tough elastomers. To investigate the influence of coexisting covalent cross-linking points on the properties of RCPs, several hybrid cross-linked polymers (HCPs) with different ratios between rotaxane- and covalent cross-links were synthesized using the radical polymerization of n -butyl acrylate in the presence of a mixture of rotaxane- (RC) and covalent cross-linkers (CC). The difference in thermal and swelling properties among the HCPs, RCPs, and covalently cross-linked polymers (CCPs) was small, whereas the coexistence of a small amount of CCs in the HCPs severely reduced the fracture energy of the resulting polymers relative to that of the RCP, thus suggesting a suitable protocol for the molecular design of tough cross-linked polymers.