Topological magnetism in low-dimensional systems is of fundamental and practical importance in condensed-matter physics and material science. Here, using first-principles and Monte-Carlo simulations, we present that multiple topological magnetism (i.e., skyrmion and bimeron) can survive in van der Waals Heterostructure of MnTe2ZrS2. Arising from interlayer coupling, MnTe2ZrS2 can harbor a large Dzyaloshinskii-Moriya interaction. This, combined with ferromagnetic exchange interaction, yields an intriguing skyrmion phase consisting of sub-10 nm magnetic skyrmions under a tiny magnetic field of 75 mT. Meanwhile, upon harnessing a small electric field, magnetic bimeron can be observed in MnTe2ZrS2 as well, suggesting the existence of multiple topological magnetism. Through interlayer sliding, both topological spin textures can be switched on-off, suggesting their stacking-dependent character. In addition, the impacts of d and Keff on these spin textures are revealed, and a dimensionless parameter is utilized to describe their joint effect. These explored phenomena and insights not only are useful for fundamental research in topological magnetism, but also enable novel applications in nanodevices.