计算机科学
可扩展性
计算
张量(固有定义)
大数据
维数之咒
数据挖掘
人工智能
算法
机器学习
数学
数据库
纯数学
作者
Huazhong Liu,Laurence T. Yang,Jihong Ding,Yimu Guo,Stephen S. Yau
标识
DOI:10.1109/tem.2019.2912928
摘要
By leveraging neoteric analytical techniques associated with big data, numerous new data-focused computation and service models have flourished in service computing systems. Accurate future predictions based on tensor-based multivariate Markov models can vigorously support enterprise decisions. However, the computation efficiency and quick response of tensor-based multimodal prediction approach are seriously restricted by the curse of dimensionality arising from high-order tensor. Therefore, to alleviate the problem, this paper focuses on proposing a tensor-train (TT)-based computation approach with its scalable implementation for high-order dominant eigen decomposition (HODED) in multivariate Markov models. First, we present a TT-based Einstein product directly based on decomposed TT cores and guarantee that the result remains TT format. Then, we put forward a scalable implementation for TT-based Einstein product in a distributed or parallel manner. Afterwards, we propose a scalable TT-based HODED (TT-HODED) algorithm and a multimodal accurate prediction algorithm. Furthermore, a TT-based big data processing and services framework is presented to provide accurate proactive services. Experimental results based on real-world GPS trajectory dataset demonstrate that TT-HODED algorithm can significantly improve the computation efficiency and reduce the running memory on the premise of guaranteeing the almost consistent prediction accuracy compared to the original HODED algorithm.
科研通智能强力驱动
Strongly Powered by AbleSci AI