Return-Path: <amdragon@gmail.com>
X-Original-To: notmuch@notmuchmail.org
Delivered-To: notmuch@notmuchmail.org
Received: from localhost (localhost [127.0.0.1])
	by olra.theworths.org (Postfix) with ESMTP id BBDE8431FD0
	for <notmuch@notmuchmail.org>; Mon, 11 Jul 2011 15:13:48 -0700 (PDT)
X-Virus-Scanned: Debian amavisd-new at olra.theworths.org
X-Spam-Flag: NO
X-Spam-Score: -0.699
X-Spam-Level: 
X-Spam-Status: No, score=-0.699 tagged_above=-999 required=5
	tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001,
	RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled
Received: from olra.theworths.org ([127.0.0.1])
	by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id FqrRb5L+hpii for <notmuch@notmuchmail.org>;
	Mon, 11 Jul 2011 15:13:47 -0700 (PDT)
Received: from mail-qw0-f53.google.com (mail-qw0-f53.google.com
	[209.85.216.53]) (using TLSv1 with cipher RC4-SHA (128/128 bits))
	(No client certificate requested)
	by olra.theworths.org (Postfix) with ESMTPS id BBB76431FB6
	for <notmuch@notmuchmail.org>; Mon, 11 Jul 2011 15:13:47 -0700 (PDT)
Received: by qwb7 with SMTP id 7so2437325qwb.26
	for <notmuch@notmuchmail.org>; Mon, 11 Jul 2011 15:13:47 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=mime-version:sender:in-reply-to:references:date
	:x-google-sender-auth:message-id:subject:from:to:cc:content-type;
	bh=+rVCnQqAKt8r3PRny+Dfm/Sj/9yBEj4fh3SqHtxQ9GM=;
	b=fyvNl5IePTx5HFjsyb+MRrImC9a3UinRdZzuOtddPzqNLZTBH9tMQ1obiCfe6SWsk9
	ETKX1GozCuSMpkfwCZRl2e8mlt0b7BThVNRzMSySRjyU83IkJDgYwCaAwCTpQ00LKCAI
	olYt+XAAmMFq/XthdlDb6qgjfCMqDg0AF6n84=
MIME-Version: 1.0
Received: by 10.229.118.72 with SMTP id u8mr3943015qcq.1.1310422426963; Mon,
	11 Jul 2011 15:13:46 -0700 (PDT)
Sender: amdragon@gmail.com
Received: by 10.229.229.211 with HTTP; Mon, 11 Jul 2011 15:13:46 -0700 (PDT)
In-Reply-To: <20110711190721.GA5386@compy.jasonwoof.org>
References: <20110711190721.GA5386@compy.jasonwoof.org>
Date: Mon, 11 Jul 2011 18:13:46 -0400
X-Google-Sender-Auth: mYwwKDXwFcSCmd8F2OYBPbA3Ilo
Message-ID:
 <CAH-f9WtBHJ8bL6eWoSNrTs=jkrOYYCuWEVVPDUt_iCw0dKcZbw@mail.gmail.com>
Subject: Re: Slowness (search opens every email file?)
From: Austin Clements <amdragon@mit.edu>
To: Jason Woofenden <jason@jasonwoof.com>
Content-Type: text/plain; charset=ISO-8859-1
Cc: Notmuch Mail <notmuch@notmuchmail.org>
X-BeenThere: notmuch@notmuchmail.org
X-Mailman-Version: 2.1.13
Precedence: list
List-Id: "Use and development of the notmuch mail system."
	<notmuch.notmuchmail.org>
List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,
	<mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>
List-Archive: <http://notmuchmail.org/pipermail/notmuch>
List-Post: <mailto:notmuch@notmuchmail.org>
List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>
List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,
	<mailto:notmuch-request@notmuchmail.org?subject=subscribe>
X-List-Received-Date: Mon, 11 Jul 2011 22:13:49 -0000

On Mon, Jul 11, 2011 at 3:07 PM, Jason Woofenden <jason@jasonwoof.com> wrote:
> notmuch search tag:foo is slow!
>
> (when my e-mail files are not already in the disk cache)
>
> I saw on my activity monitor applet that it was using mostly i/o,
> and started to wonder if it was opening every e-mail. I little work
> with strace and searching revealed that this command was opening
> many many e-mail files from my maildir(s). I spent a little while
> digging around in the notmuch source, and didn't see where it was
> opening the email files.

It is opening every file to get a few headers to display in the search
output.  Istvan Marko sent an experimental patch to store these
headers in the database a while ago, though as far as I know there
hasn't been any progress cleaning it up for inclusion:
id:"m3sjsv2kw2.fsf@zsu.kismala.com" .