Re: [notmuch] Some Xapian tips and thoughts on rebuilding

diff --git a/69/307b5137ab7cca30c4440b3872c396b8b473dc b/69/307b5137ab7cca30c4440b3872c396b8b473dc
new file mode 100644 (file)
index 0000000..fbba147
--- /dev/null
+++ b/69/307b5137ab7cca30c4440b3872c396b8b473dc
@@ -0,0 +1,100 @@
+Return-Path: <kanru@kanru.info>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 197C540B973\r
+       for <notmuch@notmuchmail.org>; Tue, 27 Jul 2010 08:43:43 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: 1.801\r
+X-Spam-Level: *\r
+X-Spam-Status: No, score=1.801 tagged_above=-999 required=5\r
+       tests=[BAYES_50=0.8, FSL_HELO_NON_FQDN_1=0.001, HELO_NO_DOMAIN=1]\r
+       autolearn=no\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id 2GPhbcE3lLpN for <notmuch@notmuchmail.org>;\r
+       Tue, 27 Jul 2010 08:43:31 -0700 (PDT)\r
+Received: from cp20 (cp20.secserverpros.com [67.220.217.187])\r
+       by olra.theworths.org (Postfix) with ESMTP id 0E82C4196F2\r
+       for <notmuch@notmuchmail.org>; Tue, 27 Jul 2010 08:43:31 -0700 (PDT)\r
+Received: from 118-160-160-73.dynamic.hinet.net ([118.160.160.73]\r
+       helo=anar.kanru.info) by cp20 with esmtpsa (TLSv1:AES256-SHA:256)\r
+       (Exim 4.69) (envelope-from <kanru@kanru.info>)\r
+       id 1OdmJU-0003Vi-5V; Tue, 27 Jul 2010 15:43:28 +0000\r
+Received: from kanru by anar.kanru.info with local (Exim 4.72)\r
+       (envelope-from <kanru@kanru.info>)\r
+       id 1OdmJP-0008Hq-EV; Tue, 27 Jul 2010 23:43:23 +0800\r
+From: Kan-Ru Chen <kanru@kanru.info>\r
+To: Carl Worth <cworth@cworth.org>, notmuch@notmuchmail.org\r
+Subject: Re: [notmuch] Some Xapian tips and thoughts on rebuilding\r
+In-Reply-To: <87eilvgick.fsf@yoom.home.cworth.org>\r
+References: <87ocl1lut1.fsf@yoom.home.cworth.org>\r
+       <87wrzoaye1.fsf@anar.kanru.info>\r
+       <87eilvgick.fsf@yoom.home.cworth.org>\r
+User-Agent: Notmuch/0.3.1-59-g676d251 (http://notmuchmail.org) Emacs/24.0.50.1\r
+       (x86_64-pc-linux-gnu)\r
+Date: Tue, 27 Jul 2010 23:43:23 +0800\r
+Message-ID: <87hbjlue04.fsf@anar.kanru.info>\r
+MIME-Version: 1.0\r
+Content-Type: text/plain; charset=us-ascii\r
+X-AntiAbuse: This header was added to track abuse,\r
+       please include it with any abuse report\r
+X-AntiAbuse: Primary Hostname - cp20\r
+X-AntiAbuse: Original Domain - notmuchmail.org\r
+X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]\r
+X-AntiAbuse: Sender Address Domain - kanru.info\r
+X-Source: \r
+X-Source-Args: \r
+X-Source-Dir: \r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Tue, 27 Jul 2010 15:43:43 -0000\r
+\r
+On Tue, 12 Jan 2010 12:48:27 -0800, Carl Worth <cworth@cworth.org> wrote:\r
+> On Tue, 12 Jan 2010 09:46:14 +0800, Kan-Ru Chen <kanru@kanru.info> wrote:\r
+> > After compacting my database, the size shrunk significantly, but the\r
+> > number of messages also changed. Beware that you might lose messages\r
+> > after compacting if you are trying this.\r
+> > \r
+> > run on xapian-svn r13824\r
+> \r
+> Yikes. That's very discouraging. I'll try to do some more testing to see\r
+> if I can replicate that, and if so, look closer into what is happening.\r
+> \r
+> -Carl\r
+\r
+Seems this still does not work as expected.\r
+\r
+With the new `notmuch count' command:\r
+\r
+     % notmuch count\r
+     131720\r
+\r
+After xapian-compact-1.1\r
+\r
+     % notmuch count\r
+     1001\r
+\r
+And a subsequent `notmuch new'\r
+\r
+     % notmuch new\r
+     Processed 6 total files in almost no time.                    \r
+     Added 6 new messages to the database.\r
+\r
+     % notmuch count\r
+     A Xapian exception occurred: Value in posting list too large.\r
+     Query string was: \r
+     0\r
+\r
+- Kanru\r