DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma;
	h=mime-version:in-reply-to:references:date:message-id:subject:from:to
	:cc:content-type:content-transfer-encoding;
	b=XrLGXNnSC4zlzoG5Dw3ib4UWSz4M1emlbgPCbUEwoTbknRikhR7Kgfu92AjL95/5YY
	vyBdRXPteJx/1ZVSqF1OJNbOQQ3+vRWggZYyvo6VT5Crdd3dEF2oo37Yn5BYzDi2coxK
	eruGrZQhO30mcVv2X4FL9xniDH0RC2bvws8FU=
MIME-Version: 1.0
In-Reply-To: <87d41ce0qf.fsf@yoom.home.cworth.org>
References: <5641883d1001140730l22832715ld6bdc95c9938d314@mail.gmail.com>
	<87d41ce0qf.fsf@yoom.home.cworth.org>
Date: Mon, 18 Jan 2010 18:35:11 +0000
Message-ID: <5641883d1001181035j534d8f5cxc3b5b0db315ff290@mail.gmail.com>
From: Oliver Charles <oliver.g.charles@googlemail.com>
To: Carl Worth <cworth@cworth.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Cc: notmuch@notmuchmail.org
Subject: Re: [notmuch] Notmuch performance problems on OSX
Precedence: list

On Thu, Jan 14, 2010 at 11:16 PM, Carl Worth <cworth@cworth.org> wrote:
> Hi Oliver, welcome to notmuch!
>
> On Thu, 14 Jan 2010 15:30:48 +0000, Oliver Charles <oliver.g.charles@goog=
lemail.com> wrote:
>> I've installed the latest notmuch from Git at this time of writing,
>> along with Xapian from SVN head. However, just tagging a single thread
>> with only one message seems to take too long:
>>
>> $ time notmuch tag +dissertation thread:7dc536441e6deade4256a46d46451221
>>
>> real =A00m0.812s
>> user =A00m0.022s
>> sys =A0 0m0.037s
>
> Things work quite a bit faster than that on my machine:
>
> $ time notmuch tag +foo id:5641883d1001140730l22832715ld6bdc95c9938d314@m=
ail.gmail.com
>
> real =A0 =A00m0.024s
> user =A0 =A00m0.012s
> sys =A0 =A0 0m0.004s
>
> But that could just be system differences.

Possibly, though my machine is more than capable of what it's doing -
a Q6600 with 4gb RAM

>> And tagging all my messages is really horrible:
>>
>> $ time notmuch tag +foobar tag:inbox
>>
>> real =A00m5.076s
>> user =A00m3.688s
>> sys =A0 0m0.105s
>
> For this operation, I can't really compare. How many messages are you
> tagging? Here's that operation for me with 525 messages in my inbox:

A few thousand (4k, I believe)

>> That xapian-svn was built from svn HEAD right now, so I'm assuming it
>> contains the #250 fix (http://trac.xapian.org/changeset/13808)
>
> Which I think means that things could have been even *much* slower
> before. ;-)
>
> The Xapian defect #250 was just one, initial (and obvious) performance
> problem. [Though, as I mentioned in a previous thread, if you're using a
> Xapian flint database, (look for .notmuch/xapian/iamflint), then you
> won't get the benefit of the Xapian fix until you rebuild your notmuch
> database from scratch with a current notmuch.]

I didn't know about this need to rebuild, but I tried that and didn't
have any more success sadly.

> Once you've verified that you've got the #250 fix functional, there
> could still be lots of performance bugs. And it would be time to start
> profiling.
>
> [...]

I'm pressed for time at the moment, but in a few weeks I might have
some time to investigate here...

--=20
    Oliver Charles / aCiD2