Faster Parallel Exact Density Peaks Clustering

聚类分析 计算机科学 统计物理学 并行计算 物理 人工智能
作者
Yihao Huang,Shangdi Yu,Julian Shun
出处
期刊:Society for Industrial and Applied Mathematics eBooks [Society for Industrial and Applied Mathematics]
卷期号:: 49-62 被引量:1
标识
DOI:10.1137/1.9781611977714.5
摘要

Clustering multidimensional points is a fundamental data mining task, with applications in many fields, such as astronomy, neuroscience, bioinformatics, and computer vision.The goal of clustering algorithms is to group similar objects together.Density-based clustering is a clustering approach that defines clusters as dense regions of points.It has the advantage of being able to detect clusters of arbitrary shapes, rendering it useful in many applications.In this paper, we propose fast parallel algorithms for Density Peaks Clustering (DPC), a popular version of density-based clustering.Existing exact DPC algorithms suffer from low parallelism both in theory and in practice, which limits their application to largescale data sets.Our most performant algorithm, which is based on priority search kd-trees, achieves O(log n log log n) span (parallel time complexity) for a data set of n points.Our algorithm is also work-efficient, achieving a work complexity matching the best existing sequential exact DPC algorithm.In addition, we present another DPC algorithm based on a Fenwick tree that makes fewer assumptions for its average-case complexity to hold.We provide optimized implementations of our algorithms and evaluate their performance via extensive experiments.On a 30core machine with two-way hyperthreading, we find that our best algorithm achieves a 10.8-13169x speedup over the previous best parallel exact DPC algorithm.Compared to the state-of-the-art parallel approximate DPC algorithm, our best algorithm achieves a 1.5-4206x speedup, while being exact. 1 The span is the length of the longest chain of sequential dependencies in the algorithm.2 Amagata and Hara [3]'s implementation has a O(n 2 ) span complexity, but it can be trivially reduced to a O(n log n) span by parallelizing the kd-tree nearest neighbor search.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Poisomber完成签到,获得积分10
刚刚
整齐的飞兰完成签到 ,获得积分10
1秒前
忧郁的芳完成签到,获得积分10
2秒前
驴肉丸完成签到,获得积分10
2秒前
董ww关注了科研通微信公众号
2秒前
wzt完成签到,获得积分10
2秒前
哈哈发布了新的文献求助10
3秒前
3秒前
凶狠的璎完成签到,获得积分10
3秒前
水煮电吹风应助YIZHIZOU采纳,获得10
4秒前
微笑芯完成签到 ,获得积分10
4秒前
科研通AI6.2应助少卿采纳,获得10
6秒前
今后应助少卿采纳,获得10
6秒前
鸣蜩阿六完成签到,获得积分10
6秒前
酷波er应助少卿采纳,获得10
6秒前
希望天下0贩的0应助少卿采纳,获得10
6秒前
ERIC完成签到,获得积分10
6秒前
慕青应助少卿采纳,获得10
6秒前
无敌通完成签到,获得积分10
7秒前
英俊的铭应助少卿采纳,获得10
7秒前
7秒前
7秒前
鱼莉完成签到,获得积分10
7秒前
梦梦完成签到 ,获得积分10
8秒前
Ty1ng完成签到,获得积分10
8秒前
8秒前
孤独的甜瓜完成签到 ,获得积分10
9秒前
小伟跑位完成签到,获得积分10
9秒前
怡然的以柳完成签到,获得积分10
11秒前
Jasper应助laogao采纳,获得10
12秒前
霸气雯完成签到,获得积分10
12秒前
江瘾完成签到 ,获得积分10
14秒前
科研小白完成签到 ,获得积分10
14秒前
ledawang完成签到 ,获得积分10
15秒前
YMY完成签到,获得积分10
15秒前
林夕完成签到,获得积分10
16秒前
tgliu完成签到,获得积分10
16秒前
牛牛完成签到,获得积分10
16秒前
reubenxq完成签到 ,获得积分10
17秒前
跳跃的秋凌完成签到,获得积分10
18秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Essentials of Carbohydrate Chemistry and Biochemistry, 4th Edition 800
Navigating Normative Orders. Interdisciplinary Perspectives 800
1 Peter and Christ's Descent to the Dead in Its Early Christian Reception 700
Organizational Behavior 510
Management and the Arts 510
Matrix Methods in Data Mining and Pattern Recognition Second Edition 510
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7750111
求助须知:如何正确求助?哪些是违规求助? 9297674
关于积分的说明 20242093
捐赠科研通 7331661
什么是DOI,文献DOI怎么找? 3309515
关于科研通互助平台的介绍 2461118
邀请新用户注册赠送积分活动 2321857