Halide perovskite has emerged as a promising candidate for optical applications owing to its exceptional photophysical properties. However, inherited toxicity and instability of the materials against heat, moisture, light, and solvent retard their commercialization. To address this issue, in this work, we report the synthesis of lead-free halide double perovskite composite with the covalent organic framework (COF). Here, COF behaves as a protective layer for perovskite from external stimuli forming a Cs2AgBiCl6@COF composite. The composite maintains its structural integrity when exposed to ambient conditions, elevated temperature for a long time, prolonged UV irradiation, and polar solvent. The composite also remains stable when it is in contact with water. We have performed several characterization techniques to validate the formation and stability of the Cs2AgBiCl6@COF composite in various conditions. Our work is not only removing the toxicity of lead but simultaneously improving the stability of perovskite materials against different environmental conditions.