iExplain the chunker a bit in the DESIGN document - dedup - deduplicating backup program	Err	bitreich.org	70
hgit clone git://bitreich.org/dedup/ git://enlrupgkhuxnvlhsf6lc3fziv5h2hhfrinws65d7roiv6bfj7d652fid.onion/dedup/	URL:git://bitreich.org/dedup/ git://enlrupgkhuxnvlhsf6lc3fziv5h2hhfrinws65d7roiv6bfj7d652fid.onion/dedup/	bitreich.org	70
1Log	/scm/dedup/log.gph	bitreich.org	70
1Files	/scm/dedup/files.gph	bitreich.org	70
1Refs	/scm/dedup/refs.gph	bitreich.org	70
1Tags	/scm/dedup/tag	bitreich.org	70
1README	/scm/dedup/file/README.gph	bitreich.org	70
1LICENSE	/scm/dedup/file/LICENSE.gph	bitreich.org	70
i---	Err	bitreich.org	70
1commit 08600b08eec99d0c6fce2749ade192cadd4a0ba5	/scm/dedup/commit/08600b08eec99d0c6fce2749ade192cadd4a0ba5.gph	bitreich.org	70
1parent af4f203b687f0d19bb16036c882fbf2dad994393	/scm/dedup/commit/af4f203b687f0d19bb16036c882fbf2dad994393.gph	bitreich.org	70
hAuthor: sin <sin@2f30.org>	URL:mailto:sin@2f30.org	bitreich.org	70
iDate:   Thu, 16 May 2019 16:43:35 +0300	Err	bitreich.org	70
i	Err	bitreich.org	70
iExplain the chunker a bit in the DESIGN document	Err	bitreich.org	70
i	Err	bitreich.org	70
iDiffstat:	Err	bitreich.org	70
i  M DESIGN                              |      10 +++++++++-	Err	bitreich.org	70
i	Err	bitreich.org	70
i1 file changed, 9 insertions(+), 1 deletion(-)	Err	bitreich.org	70
i---	Err	bitreich.org	70
1diff --git a/DESIGN b/DESIGN	/scm/dedup/file/DESIGN.gph	bitreich.org	70
i@@ -51,4 +51,12 @@ block hashes of the data stored in the snapshot.	Err	bitreich.org	70
i The chunker interface	Err	bitreich.org	70
i ---------------------	Err	bitreich.org	70
i 	Err	bitreich.org	70
i-TBD	Err	bitreich.org	70
i+The chunker issues variable length blocks.  The minimum block size is	Err	bitreich.org	70
i+512KB, the maximum block size is 8MB and the average block size is	Err	bitreich.org	70
i+2MB.  These configuration parameters can be modified by editing	Err	bitreich.org	70
i+config.h but it can be tricky to tune it properly.	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+The buzhash[0] rolling hash algorithm is used to fingerprint the input	Err	bitreich.org	70
i+stream.	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+[0] http://www.serve.net/buz/Notes.1st.year/HTML/C6/rand.012.html	Err	bitreich.org	70
.