Intelligent generation of combat simulation scenarios based on UML diagram recognition

The traditional generation of combat simulation scenarios often requires a manual understanding of conceptual scenarios and transformation into simulation scenarios. This method has the problems of long development time and high development threshold. Conceptual scenarios are usually visual Unified Modeling Language (UML) diagrams, so we can use artificial intelligence technology to extract key semantics from them, and automatically map the extracted semantics to simulation scenarios. This method is called the intelligent generation of combat simulation scenarios. To extract the key semantics from conceptual scenarios in UML form, we propose the UML diagram recognition method based on Keypoint Region-based Convolutional Neural Network (R-CNN). This method includes three parts: image character recognizer, primitive object detector, and image semantic extractor. First, we use optical character recognition (OCR) technology to achieve image character recognition. Second, we manually annotate the primitive target-detection dataset and propose a new primitive target-detection model—Keypoint R-CNN. This model considers the direction of connecting lines and realizes the detection of symbols and connecting lines. Third, we propose a targeted combined primitive detection and primitive relationship extraction method to extract the high-level semantics of UML diagrams. Then, we carried out experiments and evaluations on the self-made dataset. Compared with other methods, the F1 score of our method is improved by about 7%, and the Jaccard coefficient is improved by about 10%. Finally, we use a case study to implement the intelligent generation process of combat simulation scenarios using the UML recognition method we proposed. This case shows the operability and efficiency of our method. Our method greatly reduces the labor cost and development threshold of combat simulation scenario generation and improves the development efficiency of the combat simulation system.