MIME-Version: 1.0
Sender: dmitrij.ledkov@surgut.co.uk
In-Reply-To:
 <CACXwgK8Any3Cd+eO21Frz2X8P1kcOkw9XDTN5jj1Nu-DQdHRUg@mail.gmail.com>
References:
 <CACXwgK9bmyqUMmw9LNhqc7o86_LXx8agQByusBiQt_wRbQ8O=w@mail.gmail.com>
	<20121001154309.GE26662@mit.edu>
	<CACXwgK8Any3Cd+eO21Frz2X8P1kcOkw9XDTN5jj1Nu-DQdHRUg@mail.gmail.com>
Date: Thu, 4 Oct 2012 09:17:59 +0100
Message-ID:
 <CANBHLUjqa67roFmQBMuO_5vpmWPD-j7XR7X5jMhc1UDnC3aEHw@mail.gmail.com>
Subject: Re: How to index arbitrary headers?
From: Dmitrijs Ledkovs <xnox@debian.org>
To: Petri Savolainen <petri@koodaamo.fi>
Content-Type: text/plain; charset=UTF-8
Cc: notmuch@notmuchmail.org
Precedence: list

On 3 October 2012 19:32, Petri Savolainen <petri@koodaamo.fi> wrote:
> Hi,
>
> thanks for your response. I am evaluating notmuch / xapian for building an
> application for analyzing in various ways a fairly large number of emails
> accumulated over several years. I am afraid the number of headers that would
> ultimately need to be indexed is therefore quite a lot larger than what
> notmuch currently indexes.
>
>  Petri
>
> 2012/10/1 Austin Clements <amdragon@mit.edu>
>>
>> Quoth Petri Savolainen on Oct 01 at  3:39 pm:
>> >    Hello,
>> >    I could not find information anywhere in notmuch docs about what is
>> >    actually indexed - specifically, what email headers are indexed and
>> >    searchable? If a header is not indexed, does searching for its value
>> > still
>> >    result in a search hit?
>> >    It would be nice if one could just provide the list of headers to be
>> >    indexed in some configuration file or something.
>> >    Thanks,
>> >     Petri
>>
>> notmuch doesn't currently implement this, though it is an
>> oft-requested feature.  One (not insurmountable) difficulty is that
>> the database would have to be rebuilt if a user-configured list of
>> headers changed and there are technical limitations that prevent us
>> from simply indexing all headers.  Out of curiosity, what headers are
>> you interested in indexing?
>>
>> The currently indexed headers are described in man
>> notmuch-search-terms.
>

Use mapreduce instead: hadoop or discoproject or haddop with dumbo
should be faster.

Regards,

Dmitrijs.