In image-based plant diagnosis, clues related to diagnosis are often unclear,\nand the other factors such as image backgrounds often have a significant impact\non the final decision. As a result, overfitting due to latent similarities in\nthe dataset often occurs, and the diagnostic performance on real unseen data\n(e,g. images from other farms) is usually dropped significantly. However, this\nproblem has not been sufficiently explored, since many systems have shown\nexcellent diagnostic performance due to the bias caused by the similarities in\nthe dataset. In this study, we investigate this problem with experiments using\nmore than 50,000 images of cucumber leaves, and propose an anti-overfitting\npretreatment (AOP) for realizing practical image-based plant diagnosis systems.\nThe AOP detects the area of interest (leaf, fruit etc.) and performs brightness\ncalibration as a preprocessing step. The experimental results demonstrate that\nour AOP can improve the accuracy of diagnosis for unknown test images from\ndifferent farms by 12.2% in a practical setting.\n