The combat capabilities development command (DEVCOM) ground vehicle systems centre (GVSC) is supporting unmanned ground vehicle (UGV) development. Past experimentations of a military UGV demonstrated that its autonomous mode performed worse than the tele-operated mode. To address this, a systematic investigation into path planners for military vehicles in off-road environments was executed. A UGV simulator was used to evaluate vehicle and planner performance through a range of obstacle avoidance scenarios in deformable soil to capture the effects of vehicle-terrain interactions across multiple soil types. Monte Carlo methods were used to evaluate the robustness of five path planners ranging from classical to state-of-the-art planners, with normally-distributed variability in environmental and vehicle initial conditions. After running thousands of simulations, results show how each algorithm compares to one another in several key metrics including overall success rates. These results will help inform decisions in future military UGV path planner selection.