Softmax函数
计算机科学
人工智能
卷积神经网络
提取器
直觉
人工神经网络
机器学习
集合(抽象数据类型)
深层神经网络
特征(语言学)
模式识别(心理学)
工程类
哲学
语言学
认识论
工艺工程
程序设计语言
作者
Jaeyeon Jang,Chang Ouk Kim
出处
期刊:IEEE transactions on neural networks and learning systems
[Institute of Electrical and Electronics Engineers]
日期:2024-02-01
卷期号:35 (2): 2327-2338
被引量:13
标识
DOI:10.1109/tnnls.2022.3189996
摘要
Unknown examples that are unseen during training often appear in real-world pattern recognition tasks, and an intelligent self-learning system should be able to distinguish between known examples and unknown examples. Accordingly, open-set recognition (OSR), which addresses the problem of classifying knowns and identifying unknowns, has recently been highlighted. However, conventional deep neural networks (DNNs) using a softmax layer are vulnerable to overgeneralization, producing high confidence scores for unknowns. In this article, we propose a simple OSR method that is based on the intuition that the OSR performance can be maximized by setting strict and sophisticated decision boundaries that reject unknowns while maintaining satisfactory classification performance for knowns. For this purpose, a novel network structure, in which multiple one-vs-rest networks (OVRNs) follow a convolutional neural network (CNN) feature extractor, is proposed. Here, an OVRN is a simple feedforward neural network that is designed to assign confidence scores that are lower than those in the softmax layer to unknown samples so that unknown samples can be more effectively separated from known classes. Furthermore, the collective decision score is modeled by combining the multiple decisions reached by the OVRNs to alleviate overgeneralization. Extensive experiments were conducted on various datasets, and the experimental results show that the proposed method performs significantly better than the state-of-the-art methods by effectively reducing overgeneralization. The code is available at https://github.com/JaeyeonJang/Openset-collective-decision.
科研通智能强力驱动
Strongly Powered by AbleSci AI