From: Stewart Smith <stewart@flamingspork.com>
To: Vladimir Marek <Vladimir.Marek@Oracle.COM>,
	Ciprian Dorin Craciun <ciprian.craciun@gmail.com>
Subject: Re: Alternative (raw) message store (i.e. instead of maildir)
In-Reply-To: <20120811094635.GY28321@pub.cz.oracle.com>
References:
 <CA+Tk8fwq2thNeKHgfG-EX0hgR7uyqrSce0ZMOhEJBsz1RVtRqg@mail.gmail.com>
	<20120811094635.GY28321@pub.cz.oracle.com>
User-Agent: Notmuch/0.13.2+60~g7ecf77d (http://notmuchmail.org) Emacs/23.3.1
	(x86_64-pc-linux-gnu)
Date: Tue, 14 Aug 2012 14:47:23 +1000
Message-ID: <874no613ms.fsf@flamingspork.com>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
	micalg=pgp-sha1; protocol="application/pgp-signature"
Cc: notmuch@notmuchmail.org
Precedence: list

--=-=-=
Content-Transfer-Encoding: quoted-printable

Vladimir Marek <Vladimir.Marek@Oracle.COM> writes:
> Hi,
>
> I have objections against maildir too, but I tried to tackle it from
> different perspective. Store the maildir in zip file and use fuse-zip to
> manage it. It works sort of but it has two major disadvantages:

huh... this is fairly interesting.... one of the downsides of a million
odd files for mail is that filesystem dump and restore takes a *LOT*
longer than if it's just giant files on disk. Combined with afuse (fuse
automounter) this could be a pretty elegant solution to the problem of
storing archival Maildirs.

One large archival maildir here went from 6.5GB (du -sh on XFS) to a
2.3GB ZIP archive.... that will never, ever change. Think about the
performance difference between creating 560,000 files for backup/restore
versus copying a single 2.3GB file.

>  - fuse zip stores all changes in memory until unmounted
>  - fuse zip (and libzip for that matter) creates new temporary file when
>    updating archive, which takes considerable time when the archive is
>    very big.

This isn't much of a hastle if you have maildir per time period and
archive off. Maybe if you sync flags it may be...

> Of course this solution would have some disadvantages too, but for me
> the advantages would win. At the moment I'm not sure if I want to
> continue working on that. Maybe if there would be more interested guys

I'm *really* tempted to investigate making this work for archived
mail. Of course, the list of mounted file systems could get insane
depending on granularity I guess...

=2D-=20
Stewart Smith

--=-=-=
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)

iQIcBAEBAgAGBQJQKdhbAAoJEP08notdpDyvrmoP/3Fvn1sLGF94eA+UoFa9+MVR
7XDwVcYGFo/w7WqOFRJDT7lIiYSicN5tYZ5MFwmxngVd7gsKG0J9ZcmN3XCBJ/jw
pTR4H/T2nH3dP00dXujvYGZQ5clm/cXfbDLF2TiPIfL6jFgie6x6NFejdfEtfG1H
QiJJbfwhsL1we6nAd8/HpNA+cYBtXw65oz2qWcrpkBQiTgpo9x9RC5yOG0YZjJFY
1V9ubOUnTYgingMoMTfLuBv4ztmKa2uWyXi+ZSGeLIJlXCFhU/Bcdb5mw6OgHrZX
Jz96/rquDCwYgp5s+KAqZJj11qYVQc8eneYZn3We2/6/mW7moD+36rmmaIMp7H3k
nGJBnRl4BHVKEvwlpNeJNbzxyAwSYbveGOOv3tS0Hhax5uyChcbt168RoiGrdLIE
+DV9Byfv2JtOb5OYi2uumKvsPRWFqHIMq1UcGUIV07M0+6uNjdCpV5/bwGEsZbhU
Ewm7j4iyR7TYduWxUtrpydN4BSFJC5ACIoDmyr3Rzn5/vA1bYlBCnQkWOzIdofG7
vsTR0Sjk9x9wNfxp7f+DSigkRm4zHe/JliKOQgPx9oYkL0nJ6q7mjFp6NRtlkJ4L
P2lIZAsR0jiVE0x1DKOaHTISkS+bIyWKd9NSycDjeFjBheMOPrgDKOyYlbYMWTC6
plqF8wQrR7D3Bjw82Ptv
=+dDD
-----END PGP SIGNATURE-----
--=-=-=--