Re: How to index arbitrary headers?

diff --git a/75/32c05dfa93ce0dc5c48312acb7e086be97e1f5 b/75/32c05dfa93ce0dc5c48312acb7e086be97e1f5
new file mode 100644 (file)
index 0000000..f6b955a
--- /dev/null
+++ b/75/32c05dfa93ce0dc5c48312acb7e086be97e1f5
@@ -0,0 +1,114 @@
+Return-Path: <dmitrij.ledkov@surgut.co.uk>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id D728F431FB6\r
+       for <notmuch@notmuchmail.org>; Thu,  4 Oct 2012 01:18:02 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: -0.7\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=-0.7 tagged_above=-999 required=5\r
+       tests=[RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id lfUsalZBqIi9 for <notmuch@notmuchmail.org>;\r
+       Thu,  4 Oct 2012 01:18:01 -0700 (PDT)\r
+Received: from mail-bk0-f53.google.com (mail-bk0-f53.google.com\r
+       [209.85.214.53]) (using TLSv1 with cipher RC4-SHA (128/128 bits))\r
+       (No client certificate requested)\r
+       by olra.theworths.org (Postfix) with ESMTPS id 01E4B431FAE\r
+       for <notmuch@notmuchmail.org>; Thu,  4 Oct 2012 01:18:00 -0700 (PDT)\r
+Received: by mail-bk0-f53.google.com with SMTP id jg15so121917bkc.26\r
+       for <notmuch@notmuchmail.org>; Thu, 04 Oct 2012 01:17:59 -0700 (PDT)\r
+X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;\r
+       d=google.com; s=20120113;\r
+       h=mime-version:sender:x-originating-ip:in-reply-to:references:date\r
+       :x-google-sender-auth:message-id:subject:from:to:cc:content-type\r
+       :x-gm-message-state;\r
+       bh=HpT/K4LKWhKYQe/SGk/v7kRw45V/trWUFZRad66VnI8=;\r
+       b=IfXFjEdhGlRfpE0erhNPNU5wQqEvD+4jwHnCHg/dp1+kdBoiamv9uG9qxZTJmXCflp\r
+       xjl2TojaS7kUbMqxNlSRpFhZe2WQ8qg2ckXGVE+NJd/pgjnY5ioBwKxeXGA9PQ1oyam/\r
+       NjM06iIX6tXYq5QVx3kEOAej32nkiKrX1X5FyBBvYx2CtWctCz8ipBm9HwmXwVzQSoSV\r
+       n6bOsAr27K7jwuqA86zkCnLUrVuRRcYaU1n+wT9l7CkhJ8ReuzFV6jphRTCiZiZClMa2\r
+       58T3E0lh4qu5VmslN0rINkzgjqcgq3pknFWsgafosMO/u5YBEquK9XFlG5si+Rd1u7qc\r
+       4FVQ==\r
+MIME-Version: 1.0\r
+Received: by 10.204.152.211 with SMTP id h19mr1303392bkw.45.1349338679258;\r
+       Thu, 04 Oct 2012 01:17:59 -0700 (PDT)\r
+Sender: dmitrij.ledkov@surgut.co.uk\r
+Received: by 10.205.45.4 with HTTP; Thu, 4 Oct 2012 01:17:59 -0700 (PDT)\r
+X-Originating-IP: [86.26.160.15]\r
+In-Reply-To:\r
+ <CACXwgK8Any3Cd+eO21Frz2X8P1kcOkw9XDTN5jj1Nu-DQdHRUg@mail.gmail.com>\r
+References:\r
+ <CACXwgK9bmyqUMmw9LNhqc7o86_LXx8agQByusBiQt_wRbQ8O=w@mail.gmail.com>\r
+       <20121001154309.GE26662@mit.edu>\r
+       <CACXwgK8Any3Cd+eO21Frz2X8P1kcOkw9XDTN5jj1Nu-DQdHRUg@mail.gmail.com>\r
+Date: Thu, 4 Oct 2012 09:17:59 +0100\r
+X-Google-Sender-Auth: jNoVKmyRDED0iYv3bXyIBs00dMk\r
+Message-ID:\r
+ <CANBHLUjqa67roFmQBMuO_5vpmWPD-j7XR7X5jMhc1UDnC3aEHw@mail.gmail.com>\r
+Subject: Re: How to index arbitrary headers?\r
+From: Dmitrijs Ledkovs <xnox@debian.org>\r
+To: Petri Savolainen <petri@koodaamo.fi>\r
+Content-Type: text/plain; charset=UTF-8\r
+X-Gm-Message-State:\r
+ ALoCoQkEt0N1GzLzMv1SdyxlpT7azR88CY/UOlld5+cxOB/vVWlFywjit5lvcHipM2hyMz5btTSs\r
+Cc: notmuch@notmuchmail.org\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Thu, 04 Oct 2012 08:18:03 -0000\r
+\r
+On 3 October 2012 19:32, Petri Savolainen <petri@koodaamo.fi> wrote:\r
+> Hi,\r
+>\r
+> thanks for your response. I am evaluating notmuch / xapian for building an\r
+> application for analyzing in various ways a fairly large number of emails\r
+> accumulated over several years. I am afraid the number of headers that would\r
+> ultimately need to be indexed is therefore quite a lot larger than what\r
+> notmuch currently indexes.\r
+>\r
+>  Petri\r
+>\r
+> 2012/10/1 Austin Clements <amdragon@mit.edu>\r
+>>\r
+>> Quoth Petri Savolainen on Oct 01 at  3:39 pm:\r
+>> >    Hello,\r
+>> >    I could not find information anywhere in notmuch docs about what is\r
+>> >    actually indexed - specifically, what email headers are indexed and\r
+>> >    searchable? If a header is not indexed, does searching for its value\r
+>> > still\r
+>> >    result in a search hit?\r
+>> >    It would be nice if one could just provide the list of headers to be\r
+>> >    indexed in some configuration file or something.\r
+>> >    Thanks,\r
+>> >     Petri\r
+>>\r
+>> notmuch doesn't currently implement this, though it is an\r
+>> oft-requested feature.  One (not insurmountable) difficulty is that\r
+>> the database would have to be rebuilt if a user-configured list of\r
+>> headers changed and there are technical limitations that prevent us\r
+>> from simply indexing all headers.  Out of curiosity, what headers are\r
+>> you interested in indexing?\r
+>>\r
+>> The currently indexed headers are described in man\r
+>> notmuch-search-terms.\r
+>\r
+\r
+Use mapreduce instead: hadoop or discoproject or haddop with dumbo\r
+should be faster.\r
+\r
+Regards,\r
+\r
+Dmitrijs.\r