Re: Alternative (raw) message store (i.e. instead of maildir)

diff --git a/af/1b677fb25de1d4156f5583f1d7369643f09645 b/af/1b677fb25de1d4156f5583f1d7369643f09645
new file mode 100644 (file)
index 0000000..bffff9f
--- /dev/null
+++ b/af/1b677fb25de1d4156f5583f1d7369643f09645
@@ -0,0 +1,116 @@
+Return-Path: <stewart@flamingspork.com>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 9A35F431FB6\r
+       for <notmuch@notmuchmail.org>; Mon, 13 Aug 2012 21:47:28 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: 0.01\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=0.01 tagged_above=-999 required=5\r
+       tests=[T_MIME_NO_TEXT=0.01] autolearn=disabled\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id rg+WkSJiGIYj for <notmuch@notmuchmail.org>;\r
+       Mon, 13 Aug 2012 21:47:27 -0700 (PDT)\r
+Received: from kaylee.flamingspork.com (kaylee.flamingspork.com\r
+       [74.207.245.61])\r
+       by olra.theworths.org (Postfix) with ESMTP id F31F0431FAE\r
+       for <notmuch@notmuchmail.org>; Mon, 13 Aug 2012 21:47:26 -0700 (PDT)\r
+Received: from willster (localhost [127.0.0.1])\r
+       by kaylee.flamingspork.com (Postfix) with ESMTPS id B59386065;\r
+       Tue, 14 Aug 2012 04:49:14 +0000 (UTC)\r
+Received: by willster (Postfix, from userid 1000)\r
+       id C4A703081A36; Tue, 14 Aug 2012 14:47:23 +1000 (EST)\r
+From: Stewart Smith <stewart@flamingspork.com>\r
+To: Vladimir Marek <Vladimir.Marek@Oracle.COM>,\r
+       Ciprian Dorin Craciun <ciprian.craciun@gmail.com>\r
+Subject: Re: Alternative (raw) message store (i.e. instead of maildir)\r
+In-Reply-To: <20120811094635.GY28321@pub.cz.oracle.com>\r
+References:\r
+ <CA+Tk8fwq2thNeKHgfG-EX0hgR7uyqrSce0ZMOhEJBsz1RVtRqg@mail.gmail.com>\r
+       <20120811094635.GY28321@pub.cz.oracle.com>\r
+User-Agent: Notmuch/0.13.2+60~g7ecf77d (http://notmuchmail.org) Emacs/23.3.1\r
+       (x86_64-pc-linux-gnu)\r
+Date: Tue, 14 Aug 2012 14:47:23 +1000\r
+Message-ID: <874no613ms.fsf@flamingspork.com>\r
+MIME-Version: 1.0\r
+Content-Type: multipart/signed; boundary="=-=-=";\r
+       micalg=pgp-sha1; protocol="application/pgp-signature"\r
+Cc: notmuch@notmuchmail.org\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Tue, 14 Aug 2012 04:47:28 -0000\r
+\r
+--=-=-=\r
+Content-Transfer-Encoding: quoted-printable\r
+\r
+Vladimir Marek <Vladimir.Marek@Oracle.COM> writes:\r
+> Hi,\r
+>\r
+> I have objections against maildir too, but I tried to tackle it from\r
+> different perspective. Store the maildir in zip file and use fuse-zip to\r
+> manage it. It works sort of but it has two major disadvantages:\r
+\r
+huh... this is fairly interesting.... one of the downsides of a million\r
+odd files for mail is that filesystem dump and restore takes a *LOT*\r
+longer than if it's just giant files on disk. Combined with afuse (fuse\r
+automounter) this could be a pretty elegant solution to the problem of\r
+storing archival Maildirs.\r
+\r
+One large archival maildir here went from 6.5GB (du -sh on XFS) to a\r
+2.3GB ZIP archive.... that will never, ever change. Think about the\r
+performance difference between creating 560,000 files for backup/restore\r
+versus copying a single 2.3GB file.\r
+\r
+>  - fuse zip stores all changes in memory until unmounted\r
+>  - fuse zip (and libzip for that matter) creates new temporary file when\r
+>    updating archive, which takes considerable time when the archive is\r
+>    very big.\r
+\r
+This isn't much of a hastle if you have maildir per time period and\r
+archive off. Maybe if you sync flags it may be...\r
+\r
+> Of course this solution would have some disadvantages too, but for me\r
+> the advantages would win. At the moment I'm not sure if I want to\r
+> continue working on that. Maybe if there would be more interested guys\r
+\r
+I'm *really* tempted to investigate making this work for archived\r
+mail. Of course, the list of mounted file systems could get insane\r
+depending on granularity I guess...\r
+\r
+=2D-=20\r
+Stewart Smith\r
+\r
+--=-=-=\r
+Content-Type: application/pgp-signature\r
+\r
+-----BEGIN PGP SIGNATURE-----\r
+Version: GnuPG v1.4.11 (GNU/Linux)\r
+\r
+iQIcBAEBAgAGBQJQKdhbAAoJEP08notdpDyvrmoP/3Fvn1sLGF94eA+UoFa9+MVR\r
+7XDwVcYGFo/w7WqOFRJDT7lIiYSicN5tYZ5MFwmxngVd7gsKG0J9ZcmN3XCBJ/jw\r
+pTR4H/T2nH3dP00dXujvYGZQ5clm/cXfbDLF2TiPIfL6jFgie6x6NFejdfEtfG1H\r
+QiJJbfwhsL1we6nAd8/HpNA+cYBtXw65oz2qWcrpkBQiTgpo9x9RC5yOG0YZjJFY\r
+1V9ubOUnTYgingMoMTfLuBv4ztmKa2uWyXi+ZSGeLIJlXCFhU/Bcdb5mw6OgHrZX\r
+Jz96/rquDCwYgp5s+KAqZJj11qYVQc8eneYZn3We2/6/mW7moD+36rmmaIMp7H3k\r
+nGJBnRl4BHVKEvwlpNeJNbzxyAwSYbveGOOv3tS0Hhax5uyChcbt168RoiGrdLIE\r
++DV9Byfv2JtOb5OYi2uumKvsPRWFqHIMq1UcGUIV07M0+6uNjdCpV5/bwGEsZbhU\r
+Ewm7j4iyR7TYduWxUtrpydN4BSFJC5ACIoDmyr3Rzn5/vA1bYlBCnQkWOzIdofG7\r
+vsTR0Sjk9x9wNfxp7f+DSigkRm4zHe/JliKOQgPx9oYkL0nJ6q7mjFp6NRtlkJ4L\r
+P2lIZAsR0jiVE0x1DKOaHTISkS+bIyWKd9NSycDjeFjBheMOPrgDKOyYlbYMWTC6\r
+plqF8wQrR7D3Bjw82Ptv\r
+=+dDD\r
+-----END PGP SIGNATURE-----\r
+--=-=-=--\r