Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id 1AD3A431FD0 for ; Tue, 12 Jul 2011 13:25:07 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -0.7 X-Spam-Level: X-Spam-Status: No, score=-0.7 tagged_above=-999 required=5 tests=[RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Rmlsv3evIpbX for ; Tue, 12 Jul 2011 13:25:05 -0700 (PDT) Received: from mail-vw0-f53.google.com (mail-vw0-f53.google.com [209.85.212.53]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by olra.theworths.org (Postfix) with ESMTPS id 909CD431FB6 for ; Tue, 12 Jul 2011 13:25:05 -0700 (PDT) Received: by vws13 with SMTP id 13so4150272vws.26 for ; Tue, 12 Jul 2011 13:25:05 -0700 (PDT) Received: by 10.220.8.193 with SMTP id i1mr117404vci.108.1310502304759; Tue, 12 Jul 2011 13:25:04 -0700 (PDT) Received: from compy.jasonwoof.org (c-98-216-100-90.hsd1.ma.comcast.net [98.216.100.90]) by mx.google.com with ESMTPS id w16sm2364435vco.29.2011.07.12.13.25.02 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 12 Jul 2011 13:25:02 -0700 (PDT) Date: Tue, 12 Jul 2011 16:24:59 -0400 From: Jason Woofenden To: Notmuch Mail Subject: Re: Slowness (search opens every email file?) Message-ID: <20110712202459.GB15019@compy.jasonwoof.org> Mail-Followup-To: Notmuch Mail References: <20110711190721.GA5386@compy.jasonwoof.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jul 2011 20:25:07 -0000 On 2011-07-11 06:13PM, Austin Clements wrote: > On Mon, Jul 11, 2011 at 3:07 PM, Jason Woofenden wrote: > > notmuch search tag:foo is slow! > > > > (when my e-mail files are not already in the disk cache) > > > > I saw on my activity monitor applet that it was using mostly i/o, > > and started to wonder if it was opening every e-mail. I little work > > with strace and searching revealed that this command was opening > > many many e-mail files from my maildir(s). I spent a little while > > digging around in the notmuch source, and didn't see where it was > > opening the email files. > > It is opening every file to get a few headers to display in the search > output. Istvan Marko sent an experimental patch to store these > headers in the database a while ago, though as far as I know there > hasn't been any progress cleaning it up for inclusion: > id:"m3sjsv2kw2.fsf@zsu.kismala.com" . Cool. I suspected it was reading for header files. I googled the id and found this patchwork link: http://patchwork.notmuchmail.org/patch/947/ (I didn't see any way to ask mailman for a message id.) Does someone want to work at this soon or should I try my hand at it? Thanks, - Jason