Fish mycobacteriosis, a chronic progressive disease caused by nontuberculous mycobacteria (NTM), affects marine, brackish, and freshwater fish. Mycobacterium marinum (M. marinum), the most important of the NTM, infects fresh and marine water fish causing necrotizing granulomas and associated morbidity and mortality. M. marinum causes disease in zebrafish in a dose-dependent fashion. The M. marinum-induced disease in the zebrafish is associated with the development of necrotizing granulomas with abundant bacteria in the necrotic areas. Acute infection with high infectious doses of M. marinum infection in zebrafish was characterized by uncontrolled replication of the pathogen and death of all fish within 16 days, while chronic infections were marked by the formation of granulomas in different organs and longer survival in the range of 4–8 weeks. This review therefore synthesizes recent advances in our understanding of M. marinum’s infection of zebrafish, molecular pathogenesis, virulence mechanisms, and immune evasion strategies in zebrafish, while also highlighting the host immune effector responses and the virulence mechanisms of M. marinum.