Simulations predict that a pendulum immersed in an active fluid oscillates faster than in a passive fluid due to a reduction of the fluid inertia. The decrease in inertia is mediated by topological defects in the stress field, which can effectively decouple the bulk flow dynamics from the pendulum.