Multimodal sentiment analysis (MSA) aims to comprehend human sentiment by integrating heterogeneous multisource information on social media. The challenge of MSA lies in representation learning and multimodal fusion. Existing disentangled methods rely on global information while neglecting fine-grained critical cues, amplifying representation distribution bias in disentangled spaces. Meanwhile, current fusion approaches heavily depend on text modality while disregarding informative cues from other modalities, exacerbating the contribution imbalance across modalities. To tackle these limitations, we propose a multi-task framework that collaborates with fine-grained disentanglement and modal-agnostic fusion. It extracts sentiment attributes at a fine granularity based on the multi-head property of the Transformer, and dynamically exploits the contribution of each modality while enhancing the reliability of cross-modal representations through fuzzy logic. We evaluate FDMA on two renowned multimodal benchmark datasets, CMU-MOSI and CMU-MOSEI. Experiments show that our method surpasses state-of-the-art methods on CMU-MOSI and CMU-MOSEI datasets. Further analysis demonstrates that our model also exhibits superior reliability and stability.