Re: [notmuch] Notmuch performance (literally, in my case)

diff --git a/09/2129d28c8f06e7111626e315811a4a23ad54c6 b/09/2129d28c8f06e7111626e315811a4a23ad54c6
new file mode 100644 (file)
index 0000000..94258a2
--- /dev/null
+++ b/09/2129d28c8f06e7111626e315811a4a23ad54c6
@@ -0,0 +1,117 @@
+Return-Path: <madduck@piper.oerlikon.madduck.net>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 63AF1404945\r
+       for <notmuch@notmuchmail.org>; Tue, 16 Mar 2010 11:01:10 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: -2.447\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=-2.447 tagged_above=-999 required=5 tests=[AWL=0.152,\r
+       BAYES_00=-2.599] autolearn=ham\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id t54SgscV7nRa for <notmuch@notmuchmail.org>;\r
+       Tue, 16 Mar 2010 11:01:09 -0700 (PDT)\r
+Received: from clegg.madduck.net (clegg.madduck.net [193.242.105.96])\r
+       by olra.theworths.org (Postfix) with ESMTP id 0071D404944\r
+       for <notmuch@notmuchmail.org>; Tue, 16 Mar 2010 11:01:08 -0700 (PDT)\r
+Received: from piper.oerlikon.madduck.net (piper.oerlikon.madduck.net\r
+       [IPv6:2001:1620:f02:0:211:2fff:fe6b:c869])\r
+       (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))\r
+       (Client CN "piper.oerlikon.madduck.net",\r
+       Issuer "CAcert Class 3 Root" (verified OK))\r
+       by clegg.madduck.net (postfix) with ESMTPS id 4C4591D4004;\r
+       Tue, 16 Mar 2010 19:00:53 +0100 (CET)\r
+Received: by piper.oerlikon.madduck.net (Postfix, from userid 1000)\r
+       id 5289F8B; Tue, 16 Mar 2010 19:00:52 +0100 (CET)\r
+Date: Tue, 16 Mar 2010 19:00:52 +0100\r
+From: martin f krafft <madduck@madduck.net>\r
+To: "Aneesh Kumar K. V" <aneesh.kumar@linux.vnet.ibm.com>\r
+Message-ID: <20100316180052.GA6600@piper.oerlikon.madduck.net>\r
+Mail-Followup-To: "Aneesh Kumar K. V" <aneesh.kumar@linux.vnet.ibm.com>,\r
+       Ben Gamari <bgamari.foss@gmail.com>, Olly Betts <olly@survex.com>,\r
+       notmuch@notmuchmail.org\r
+References: <4b9dccc0.c6c1f10a.3671.44ec@mx.google.com>\r
+       <20100315090401.GA29891@glaive.weftsoar.net>\r
+       <slrnhprvfv.hu6.olly@msgid.survex.com>\r
+       <4b9e6e80.09b6660a.6769.6832@mx.google.com>\r
+       <20100316110846.GK10323@survex.com>\r
+       <4b9fa5d2.0a4d5e0a.0c0b.ffffdcbb@mx.google.com>\r
+       <87mxy8chvq.fsf@linux.vnet.ibm.com>\r
+MIME-Version: 1.0\r
+Content-Type: multipart/signed; micalg=pgp-ripemd160;\r
+       protocol="application/pgp-signature"; boundary="LQksG6bCIzRHxTLp"\r
+Content-Disposition: inline\r
+In-Reply-To: <87mxy8chvq.fsf@linux.vnet.ibm.com>\r
+X-Motto: Keep the good times rollin'\r
+X-OS: Debian GNU/Linux squeeze/sid kernel 2.6.33-2-amd64 x86_64\r
+X-Spamtrap: madduck.bogus@madduck.net\r
+X-Subliminal-Message: debian/rules!\r
+User-Agent: Mutt/1.5.20 (2009-06-14)\r
+X-Virus-Scanned: clamav-milter 0.95.3 at clegg\r
+X-Virus-Status: Clean\r
+Cc: Olly Betts <olly@survex.com>, notmuch@notmuchmail.org\r
+Subject: Re: [notmuch] Notmuch performance (literally, in my case)\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Tue, 16 Mar 2010 18:01:10 -0000\r
+\r
+\r
+--LQksG6bCIzRHxTLp\r
+Content-Type: text/plain; charset=us-ascii\r
+Content-Disposition: inline\r
+Content-Transfer-Encoding: quoted-printable\r
+\r
+also sprach Aneesh Kumar K. V <aneesh.kumar@linux.vnet.ibm.com> [2010.03.16=\r
+=2E1810 +0100]:\r
+> Ext3 fsync related issue is a know problem due to the way journalling is\r
+> handled in ext3. The solution for that would be data=3Dwriteback ( with\r
+> its loss of data integrity ) or not yet upstreamed data=3Dguarded. Another\r
+> option would be to try ext4 which should not be impacted that badly by\r
+> the data=3Dordered journalled mode\r
+\r
+I use ext4 with data=3Dordered, and while notmuch is writing the\r
+Xapian database, most I/O stalls on the machine:\r
+\r
+  - Firefox does not get any mouse events\r
+  - Vim blocks writing the viminfo file\r
+  - All disk operations queue for multiple seconds.\r
+\r
+So no, ext4 is not a solution. Is it just me, or should no\r
+filesystem of this world be able to hog a system this badly? I think\r
+the culprit is the IO-scheduler.\r
+\r
+--=20\r
+martin | http://madduck.net/ | http://two.sentenc.es/\r
+=20\r
+"vulgarity is simply the conduct of other people."\r
+                                                        -- oscar wilde\r
+=20\r
+spamtraps: madduck.bogus@madduck.net\r
+\r
+--LQksG6bCIzRHxTLp\r
+Content-Type: application/pgp-signature; name="digital_signature_gpg.asc"\r
+Content-Description: Digital signature (see http://martin-krafft.net/gpg/)\r
+Content-Disposition: inline\r
+\r
+-----BEGIN PGP SIGNATURE-----\r
+Version: GnuPG v1.4.10 (GNU/Linux)\r
+\r
+iEYEAREDAAYFAkufx1AACgkQIgvIgzMMSnVsrwCcCzqYh/fKqrL/YSZ3CxW/n7Lr\r
+Mu0AoMrsbJMm4Bv/OHfG8fNaXG8TqqTm\r
+=Ax/x\r
+-----END PGP SIGNATURE-----\r
+\r
+--LQksG6bCIzRHxTLp--\r