Prague Stringology Conference 2013
Michael Hirsch, Ariel Ish-Shalom and Shmuel Tomi Klein
Optimal Partitioning of Data Chunks in Deduplication Systems
| Abstract: |
| Deduplication is a special case of data compression in which repeated chunks of data are stored only once. For very large chunks, this process may be applied even if the chunks are similar and not necessarily identical, and then the encoding of duplicate data consists of a sequence of pointers to matching parts. However, not all the pointers are worth being kept, as they incur some storage overhead. A linear, sub-optimal solution of this partition problem is presented, followed by an optimal solution with cubic time complexity and requiring quadratic space. |
| Download paper: |  |
 |
 |
| PostScript | BibTeX reference |
| Download presentation: |  |