计算机科学
可扩展性
分类器(UML)
图形
数据挖掘
加速
掉期(金融)
模式识别(心理学)
算法
人工智能
理论计算机科学
财务
数据库
操作系统
经济
作者
Stanislav Protasov,Adil Khan
出处
期刊:Complexity
[Hindawi Publishing Corporation]
日期:2021-01-01
卷期号:2021 (1)
被引量:2
摘要
K‐nearest neighbours (kNN) is a very popular instance‐based classifier due to its simplicity and good empirical performance. However, large‐scale datasets are a big problem for building fast and compact neighbourhood‐based classifiers. This work presents the design and implementation of a classification algorithm with index data structures, which would allow us to build fast and scalable solutions for large multidimensional datasets. We propose a novel approach that uses navigable small‐world (NSW) proximity graph representation of large‐scale datasets. Our approach shows 2–4 times classification speedup for both average and 99th percentile time with asymptotically close classification accuracy compared to the 1‐NN method. We observe two orders of magnitude better classification time in cases when method uses swap memory. We show that NSW graph used in our method outperforms other proximity graphs in classification accuracy. Our results suggest that the algorithm can be used in large‐scale applications for fast and robust classification, especially when the search index is already constructed for the data.
科研通智能强力驱动
Strongly Powered by AbleSci AI