DaDe: A Study of Chunking Algorithm and Hashing Function in Block Level Chunk based Data Deduplication

As the amount of storage employment grows vaster and vaster, people havebeen strived to observe the efficient technique to protect storage space. Data deduplication (DaDe) grows intact in storage administration as it can bring down the storage space powerfully when there are occurred duplicated data. This paper presents data deduplication methodology that can be used in a few methods for optimized storage system. Data deduplication is one of the best strategies which removes duplicate data, shortenbandwidth and also reduces the disk usage. This paper ventures to synopsis deduplication with the interspersed use of file chunking algorithm and hash function, storage optimization concepts. Additionally, an Asymmetric Extremum content defined chunking algorithm (AE) and Message Digest algorithm (MD5) are includedin depth [1].