插值(计算机图形学)
量化(信号处理)
索引(排版)
计算机科学
气体压缩机
人工智能
数据挖掘
算法
工程类
运动(物理)
万维网
机械工程
作者
Pu Jiao,Sheng Di,Mingze Xia,Xuan Wu,Jinyang Liu,Xin Liang,Franck Cappello
出处
期刊:Proceedings
[Institute of Electrical and Electronics Engineers]
日期:2025-06-03
卷期号:: 974-986
被引量:2
标识
DOI:10.1109/ipdps64566.2025.00091
摘要
Large-scale scientific simulations produce unprecedented amounts of data using high-performance computing systems, leading to severe problems in data storage, I/O, and communication. To address the data movement challenge, errorcontrolled lossy compression has been proposed to significantly reduce the data size while retaining the data quality. Recently, interpolation-based compressors, including MGARD, SZ3, QoZ, and HPEZ, have stood out due to their efficiency in obtaining relatively high compression ratios with decent compression and decompression throughput. Nevertheless, these methods focus on data decorrelation in the compression pipeline yet overlook the correlation of the quantization indices generated after decorrelation. In this paper, we develop a generic framework that can use the correlation of quantization indices to significantly improve the compression ratios for state-of-the-art interpolation-based error-bounded lossy compressors. Our contributions are threefold: (1) We carefully characterized the quantization index array produced by the interpolation-based compressors and identified the unused correlation; (2) We designed a generic quantization index prediction method to exploit such correlation, which leads to improved compression ratio with only minor degradation in throughput; (3) We integrate our method into 4 state-of-theart interpolation-based compressors and evaluate them using 5 real-world datasets. Experimental results demonstrate that the proposed method improves the compression ratios of the base compressors by up to 95% while keeping the same quality. It also leads to 16% improvement in end-to-end data transfer performance under a parallel setting.
科研通智能强力驱动
Strongly Powered by AbleSci AI