This study investigated the occupational hazard effects of heavy metal(loid)s (HMs) from soil in several critical mining activity areas at the Majdanpek copper mine in Serbia. Soil contamination and associated ecological and health risks to workers were evaluated through an apportionment of sources and a quantitative evaluation of ecological and health risks. The majority of soil samples had increased concentrations of Cd, Cu, Pb, Zn, Hg, As, Mo, and Sb. The results of the multivariate statistical analysis suggested the existence of multiple sources. The positive matrix factorization further explained these associations between HMs and defined three main pollution sources: natural (Factor 1), mixed source (Factor 2), and mining pollution (Factor 3). According to the RI, the average value was 1215, with more than half of the samples (57.4%) showing very high pollution levels, while 3.3% of the samples had an RI lower than 150. The ecological risk was dominated by Cd, Cu, and Hg, with Factor 3 contributing the most to the RI values. Assessment of worker exposure to soil revealed that outdoor workers had a higher potential for adverse health effects, with mean HI and TCR being 0.18 and 2.9 × 10−5, respectively. The identified sources had similar impacts on non-carcinogenic and carcinogenic risks, with a decreasing trend: Factor 3 > Factor 2 > Factor 1. Indoor workers were exposed to neither non-carcinogenic or carcinogenic risks, whereas outdoor workers suffered from possible health issues regarding TCR. Source-specific health risk assessment indicated mining pollution as the only risk contributing factor. A Monte Carlo simulation of risks revealed that the probability of developing carcinogenic issues for outdoor workers was within the safety threshold (TCR < 10−4). The findings of this study emphasize the need for regulation and control strategies for worker health risks from HM-contaminated soil in mining areas.