大数据
SPARK(编程语言)
上传
计算机科学
网络爬虫
数据库
数据预处理
数据仓库
预处理器
万维网
操作系统
数据挖掘
人工智能
程序设计语言
作者
Dianwei Chi,Chunhua Tang,Chen Yin
出处
期刊:Journal of physics
[IOP Publishing]
日期:2021-09-01
卷期号:2010 (1): 012079-012079
被引量:4
标识
DOI:10.1088/1742-6596/2010/1/012079
摘要
Abstract In order to provide decision support for user travel and hotel management planning, this paper proposes the design and implementation of a hotel big data analysis platform based on Hadoop and Spark technology, using hotel basic data and user comment data as data sources. First, we design a crawler program to collect basic data and user comment data of city hotels in Qingdao, Shandong Province, and upload them to the hadoop storage platform, use Spark for big data preprocessing, use Hive to build a big data platform data warehouse, and finally use echarts to analyze the results and make decisions perform a visual display.
科研通智能强力驱动
Strongly Powered by AbleSci AI