Re: Slowness (search opens every email file?)

diff --git a/46/459067980ff327e00684f0576b7cefb2dc3ab2 b/46/459067980ff327e00684f0576b7cefb2dc3ab2
new file mode 100644 (file)
index 0000000..f49064a
--- /dev/null
+++ b/46/459067980ff327e00684f0576b7cefb2dc3ab2
@@ -0,0 +1,90 @@
+Return-Path: <jason@jasonwoof.com>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 1AD3A431FD0\r
+       for <notmuch@notmuchmail.org>; Tue, 12 Jul 2011 13:25:07 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: -0.7\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=-0.7 tagged_above=-999 required=5\r
+       tests=[RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id Rmlsv3evIpbX for <notmuch@notmuchmail.org>;\r
+       Tue, 12 Jul 2011 13:25:05 -0700 (PDT)\r
+Received: from mail-vw0-f53.google.com (mail-vw0-f53.google.com\r
+       [209.85.212.53]) (using TLSv1 with cipher RC4-SHA (128/128 bits))\r
+       (No client certificate requested)\r
+       by olra.theworths.org (Postfix) with ESMTPS id 909CD431FB6\r
+       for <notmuch@notmuchmail.org>; Tue, 12 Jul 2011 13:25:05 -0700 (PDT)\r
+Received: by vws13 with SMTP id 13so4150272vws.26\r
+       for <notmuch@notmuchmail.org>; Tue, 12 Jul 2011 13:25:05 -0700 (PDT)\r
+Received: by 10.220.8.193 with SMTP id i1mr117404vci.108.1310502304759;\r
+       Tue, 12 Jul 2011 13:25:04 -0700 (PDT)\r
+Received: from compy.jasonwoof.org (c-98-216-100-90.hsd1.ma.comcast.net\r
+       [98.216.100.90])\r
+       by mx.google.com with ESMTPS id w16sm2364435vco.29.2011.07.12.13.25.02\r
+       (version=TLSv1/SSLv3 cipher=OTHER);\r
+       Tue, 12 Jul 2011 13:25:02 -0700 (PDT)\r
+Date: Tue, 12 Jul 2011 16:24:59 -0400\r
+From: Jason Woofenden <jason@jasonwoof.com>\r
+To: Notmuch Mail <notmuch@notmuchmail.org>\r
+Subject: Re: Slowness (search opens every email file?)\r
+Message-ID: <20110712202459.GB15019@compy.jasonwoof.org>\r
+Mail-Followup-To: Notmuch Mail <notmuch@notmuchmail.org>\r
+References: <20110711190721.GA5386@compy.jasonwoof.org>\r
+       <CAH-f9WtBHJ8bL6eWoSNrTs=jkrOYYCuWEVVPDUt_iCw0dKcZbw@mail.gmail.com>\r
+MIME-Version: 1.0\r
+Content-Type: text/plain; charset=us-ascii\r
+Content-Disposition: inline\r
+In-Reply-To:\r
+ <CAH-f9WtBHJ8bL6eWoSNrTs=jkrOYYCuWEVVPDUt_iCw0dKcZbw@mail.gmail.com>\r
+User-Agent: Mutt/1.5.21 (2010-09-15)\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Tue, 12 Jul 2011 20:25:07 -0000\r
+\r
+On 2011-07-11 06:13PM, Austin Clements wrote:\r
+> On Mon, Jul 11, 2011 at 3:07 PM, Jason Woofenden <jason@jasonwoof.com> wrote:\r
+> > notmuch search tag:foo is slow!\r
+> >\r
+> > (when my e-mail files are not already in the disk cache)\r
+> >\r
+> > I saw on my activity monitor applet that it was using mostly i/o,\r
+> > and started to wonder if it was opening every e-mail. I little work\r
+> > with strace and searching revealed that this command was opening\r
+> > many many e-mail files from my maildir(s). I spent a little while\r
+> > digging around in the notmuch source, and didn't see where it was\r
+> > opening the email files.\r
+> \r
+> It is opening every file to get a few headers to display in the search\r
+> output.  Istvan Marko sent an experimental patch to store these\r
+> headers in the database a while ago, though as far as I know there\r
+> hasn't been any progress cleaning it up for inclusion:\r
+> id:"m3sjsv2kw2.fsf@zsu.kismala.com" .\r
+\r
+Cool. I suspected it was reading for header files.\r
+\r
+I googled the id and found this patchwork link:\r
+\r
+http://patchwork.notmuchmail.org/patch/947/\r
+\r
+(I didn't see any way to ask mailman for a message id.)\r
+\r
+Does someone want to work at this soon or should I try my hand at\r
+it?\r
+\r
+\r
+Thanks,     - Jason\r