iAdd README - dedup - deduplicating backup program	Err	bitreich.org	70
hgit clone git://bitreich.org/dedup/ git://enlrupgkhuxnvlhsf6lc3fziv5h2hhfrinws65d7roiv6bfj7d652fid.onion/dedup/	URL:git://bitreich.org/dedup/ git://enlrupgkhuxnvlhsf6lc3fziv5h2hhfrinws65d7roiv6bfj7d652fid.onion/dedup/	bitreich.org	70
1Log	/scm/dedup/log.gph	bitreich.org	70
1Files	/scm/dedup/files.gph	bitreich.org	70
1Refs	/scm/dedup/refs.gph	bitreich.org	70
1Tags	/scm/dedup/tag	bitreich.org	70
1README	/scm/dedup/file/README.gph	bitreich.org	70
1LICENSE	/scm/dedup/file/LICENSE.gph	bitreich.org	70
i---	Err	bitreich.org	70
1commit 2c954112417c5101887d3a789cfd97f44d875390	/scm/dedup/commit/2c954112417c5101887d3a789cfd97f44d875390.gph	bitreich.org	70
1parent 4590e214c6140e6d71896c8133120ebc2af287a1	/scm/dedup/commit/4590e214c6140e6d71896c8133120ebc2af287a1.gph	bitreich.org	70
hAuthor: sin <sin@2f30.org>	URL:mailto:sin@2f30.org	bitreich.org	70
iDate:   Wed, 21 Mar 2018 15:20:07 +0000	Err	bitreich.org	70
i	Err	bitreich.org	70
iAdd README	Err	bitreich.org	70
i	Err	bitreich.org	70
iDiffstat:	Err	bitreich.org	70
i  M Makefile                            |       2 +-	Err	bitreich.org	70
i  A README                              |      32 +++++++++++++++++++++++++++++++	Err	bitreich.org	70
i	Err	bitreich.org	70
i2 files changed, 33 insertions(+), 1 deletion(-)	Err	bitreich.org	70
i---	Err	bitreich.org	70
1diff --git a/Makefile b/Makefile	/scm/dedup/file/Makefile.gph	bitreich.org	70
i@@ -3,7 +3,7 @@ PREFIX = /usr/local	Err	bitreich.org	70
i SRC = dedup.c	Err	bitreich.org	70
i OBJ = dedup.o	Err	bitreich.org	70
i BIN = dedup	Err	bitreich.org	70
i-DISTFILES = $(SRC) LICENSE Makefile arg.h tree.h	Err	bitreich.org	70
i+DISTFILES = $(SRC) LICENSE Makefile README arg.h tree.h	Err	bitreich.org	70
i 	Err	bitreich.org	70
i CFLAGS = -g -Wall	Err	bitreich.org	70
i CPPFLAGS = -I/usr/local/include	Err	bitreich.org	70
1diff --git a/README b/README	/scm/dedup/file/README.gph	bitreich.org	70
i@@ -0,0 +1,32 @@	Err	bitreich.org	70
i+dedup is a simple data deduplication program.  It is designed to be	Err	bitreich.org	70
i+used in a pipeline with tar/gpg etc.	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+dedup only handles a single file at a time, so using tar is advised.	Err	bitreich.org	70
i+For example, to dedup a tar file you can invoked dedup as follows:	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+    tar cf - ~/bak | dedup	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+This will create a .{cache,index,store} in the current directory.  The	Err	bitreich.org	70
i+store file contains all the unique blocks.  The index file contains	Err	bitreich.org	70
i+all the revisions of files that have been deduplicated.  Each revision	Err	bitreich.org	70
i+is identified by its SHA256 hash.  The cache file is only used to	Err	bitreich.org	70
i+speed up block comparison.	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+To list all known revisions run:	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+    dedup -l	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+You will get a list of hashes.  Each hash corresponds to a single file	Err	bitreich.org	70
i+(in this case, a tar archive).	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+To extract a file from the deduplicated store run:	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+    dedup -e <hash> > bak.tar	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+You can mix dedup with other programs like gpg(1).  For example to	Err	bitreich.org	70
i+perform a remote backup you can use the following command:	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+    tar cf - ~/bak | gpg -c | ssh user@host dedup	Err	bitreich.org	70
i+	Err	bitreich.org	70
i+Cheers,	Err	bitreich.org	70
i+sin	Err	bitreich.org	70
.