计算机科学
进化计算
变压器
人工智能
计算机视觉
工程类
电气工程
电压
作者
Suvipa Sacheewapasuk,Yutana Jewajinda,Kata Praditwong
标识
DOI:10.1109/incit63192.2024.10810639
摘要
This paper presents an evolutionary multi-objective optimization of vision transformer architecture and the effect of two genetic crossover operators, two-point and uniform crossover, on the quality of the solutions. The proposed method employs the multi-objective genetic algorithm (NSGA-II) and uses a block-based encoding for visual transformer models. By adopting configurable blocks, the encoding method allows the search for various ViT architectures. The paper comprehensively analyzes the effect of genetic operators on the quality of the solution, providing practical insights for future research. The experimental results, which are reported on the Cifar-10 dataset, demonstrate a trade-off between model size and accuracy and are compared to the state-of-the-art models, providing solid evidence of the findings.
科研通智能强力驱动
Strongly Powered by AbleSci AI