Whole Life Cycle Management Model of Welds Based on Data Lake

Oil and gas are the key pillars and safety cornerstones of China’s energy strategic system, and in the key link of oil and gas pipeline transportation, the quality and reliability of welds are directly related to whether the pipeline can achieve long-term, safe and efficient transportation operations. Therefore, by studying the development process of data lakes, analyzing the technical characteristics, advantages and disadvantages of data lakes and data warehouses (DWs) and combining the characteristics of large data volume, diverse data types and various data forms in the whole life cycle of oil and gas pipelines, this paper studies a data management model for the whole life cycle of girth welds based on data lakes, which uses the technical advantages of data lakes to build a complete data management architecture, which can realize the intelligent capture, exchange and storage of pipeline life cycle data. The automatic growth function of girth weld data and the work of “collection, management, update and maintenance” are further realized, and the utilization rate of data are improved. In order to achieve the goal of data management of the whole life cycle of oil and gas pipelines with welds as the index center, and further lay a reliable data foundation for the quality risk assessment of girth welds.