From: Sebastien Binet <binet@cern.ch>
To: Jameson Graef Rollins <jrollins@finestructure.net>, Notmuch developer list
	<notmuch@notmuchmail.org>
Subject: Re: query on a subset of messages ?
In-Reply-To: <87ehol2aku.fsf@servo.finestructure.net>
References: <871ukl5oj7.fsf@cern.ch> <87ehol2aku.fsf@servo.finestructure.net>
User-Agent: Notmuch/0.13.2+60~g7ecf77d (http://notmuchmail.org) Emacs/24.1.1
	(x86_64-unknown-linux-gnu)
Date: Mon, 9 Jul 2012 18:45:44 +0200
Message-ID: <87wr2c3mtj.fsf@cern.ch>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha1;
	protocol="application/pgp-signature"
Keywords: CERN SpamKiller Note: -50
Precedence: list

--=-=-=
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable

Jamie,

Jameson Graef Rollins <jrollins@finestructure.net> writes:

> On Mon, Jul 09 2012, Sebastien Binet <binet@cern.ch> wrote:
>> I was trying to reduce the I/O stress during my usual email
>> fetching+tagging by writing a little program using the go bindings to
>> notmuch.
>>
>> ie:
>> db, status :=3D notmuch.OpenDatabase(db_path,
>>     		notmuch.DATABASE_MODE_READ_WRITE)
>> query :=3D db.CreateQuery("(tag:new AND tag:inbox)")
>> msgs :=3D query.SearchMessages()
>> for _,msg :=3D range msgs {
>>   tag_msg(msg, tagqueries)
>> }
>>
>>
>> where tagqueries is a subquery of the form:
>> [
>>     {
>>         "Cmd": "+to-me",
>>         "Query": "(to:sebastien.binet@cern.ch and not tag:to-me)"
>>     },
>>     {
>>         "Cmd": "+sci-notmuch",
>>         "Query": "from:notmuch@notmuchmail.org or to:notmuch@notmuchmail=
.org or subject:notmuch"
>>     }
>> ]
>
>
> Hi, Sebastian.  It's really hard for me to believe that this is much
> faster than simply making the two tagging calls in full:
>
> notmuch tag +to-me -- tag:new and tag:inbox and (to:sebastien.binet@cern.=
ch and not tag:to-me)
> notmuch tag +sci-notmuch -- tag:new and tag:inbox and from:notmuch@notmuc=
hmail.org or to:notmuch@notmuchmail.org or subject:notmuch"
>
> After the first call the cache will be fresh, so the overhead should be
> minimal.  It looks to me you're looking in to this as a post-new hook.
> I do pretty much the same thing, and with the above properly constructed
> searches the tagging is super fast.

well, of course I don't have just those two:

$ grep -He "^tag_new " emacs/notmuch-lib/notmuch-tag.sh | wc -l
54

also:
$ du -hs mail-notmuch/.notmuch=20
2.9G	mail-notmuch/.notmuch

that said, most of the I/O wait seem to come from 'notmuch new' (after
having dropped all fs caches.)

ok, post-new hook it is then :)

(but there is probably something to do to speed-up a 'notmuch new' after
having dropped all fs caches... ?)

=2Ds

--=-=-=
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)

iEYEARECAAYFAk/7Cr4ACgkQPj4AVbsZCCYJhwCbBQdX5QsFjL2g43C3sDdUseNO
6sgAn09SDXMqJoAQgbHoXKMvEObt60yM
=Ey0V
-----END PGP SIGNATURE-----
--=-=-=--