计算机科学
SPARK(编程语言)
大数据
分拆(数论)
数据处理
数据挖掘
数据检索
过程(计算)
计算机数据存储
数据库
操作系统
数学
组合数学
程序设计语言
作者
Zhiguo Gou,Yizhou Zeng
标识
DOI:10.1016/j.procs.2023.11.056
摘要
There are still many defects in the process of data processing, storage and analysis, which cannot adapt to the needs of big data processing and analysis. In order to more fully reflect the value of big data processing, it is necessary to realize efficient data processing. Therefore, people invented the Spark operating system and integrated the idea of SIMBA, built a big data analysis system, and searched the information through the database query method. In Spark operating system can import search mechanism, in order to improve the search effect of information, through the establishment of segment tree storage method can improve the retrieval effect, in big data analysis can use partition strategy method for big data partition, and adopted the global filtering and local search method, make in information retrieval can achieve high throughput and low delay performance.
科研通智能强力驱动
Strongly Powered by AbleSci AI