Re: [notmuch] notmuch new: Memory problem

diff --git a/b5/3557789e8306f522a02df27aeefd141c29cb7e b/b5/3557789e8306f522a02df27aeefd141c29cb7e
new file mode 100644 (file)
index 0000000..bbf4964
--- /dev/null
+++ b/b5/3557789e8306f522a02df27aeefd141c29cb7e
@@ -0,0 +1,87 @@
+Return-Path: <dominik.epple@googlemail.com>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 0F63B431FC0\r
+       for <notmuch@notmuchmail.org>; Mon, 23 Nov 2009 07:30:31 -0800 (PST)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id n8yfeTYoljsi for <notmuch@notmuchmail.org>;\r
+       Mon, 23 Nov 2009 07:30:30 -0800 (PST)\r
+Received: from mail-yw0-f200.google.com (mail-yw0-f200.google.com\r
+       [209.85.211.200])\r
+       by olra.theworths.org (Postfix) with ESMTP id 667B6431FAE\r
+       for <notmuch@notmuchmail.org>; Mon, 23 Nov 2009 07:30:30 -0800 (PST)\r
+Received: by ywh38 with SMTP id 38so4945617ywh.6\r
+       for <notmuch@notmuchmail.org>; Mon, 23 Nov 2009 07:30:30 -0800 (PST)\r
+DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;\r
+       d=googlemail.com; s=gamma;\r
+       h=domainkey-signature:mime-version:received:in-reply-to:references\r
+       :date:message-id:subject:from:to:cc:content-type;\r
+       bh=EzpUNdpNvUz1kIRvLOZ4zE7eJTx7Bu6vD0LLchJSUck=;\r
+       b=AMip8UgGsV9fnYnmd9qjv5swcKBnYUV0uvb2MMqzMcI40JJYIXi94oRKi+otLU/a/t\r
+       aEcB8XZfUp/bNVO56hUGRoZ/pmlJFfMo5+XxGQDfM4b3A+Q235xP3sT5LkNCe6Abm3av\r
+       ZAnhISX5fgyIY4QxP7vBFOLtMAYn4flGqu9uU=\r
+DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma;\r
+       h=mime-version:in-reply-to:references:date:message-id:subject:from:to\r
+       :cc:content-type;\r
+       b=QWe1ww+yjei2TCGNiLcD5ZNATB267YdOmnNDhReWEnK76rOdySGy2N2ypQxsNsIZgs\r
+       VtEHWTMLvgt87/hCE6NEROM2Rrz6wSN1D/xPrysVcsne4C/1UWOnGh6J8a8ki7DBPY92\r
+       Jhb6kpDgcFpLmWkn8aaVcC/xAi6z5ZhjtT1FY=\r
+MIME-Version: 1.0\r
+Received: by 10.90.12.19 with SMTP id 19mr6640983agl.96.1258990229878; Mon, 23\r
+       Nov 2009 07:30:29 -0800 (PST)\r
+In-Reply-To: <877htlmbhu.fsf@yoom.home.cworth.org>\r
+References: <123554aa0911200056h73def158pb0db64a2a78ed687@mail.gmail.com>\r
+       <877htlmbhu.fsf@yoom.home.cworth.org>\r
+Date: Mon, 23 Nov 2009 16:30:29 +0100\r
+Message-ID: <123554aa0911230730t72d36378rd45459462496034a@mail.gmail.com>\r
+From: Dominik Epple <dominik.epple@googlemail.com>\r
+To: Carl Worth <cworth@cworth.org>\r
+Content-Type: text/plain; charset=ISO-8859-1\r
+Cc: notmuch@notmuchmail.org\r
+Subject: Re: [notmuch] notmuch new: Memory problem\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.12\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Mon, 23 Nov 2009 15:30:31 -0000\r
+\r
+Hi,\r
+\r
+Thanks for your help. Here is the information you requested:\r
+\r
+2009/11/20 Carl Worth <cworth@cworth.org>:\r
+> I'm curious how big your .notmuch directory ended up after this\r
+> operation. (And how that compares in size to the total size of your\r
+> collection of mail.)\r
+\r
+I guess you mean these directories:\r
+\r
+$ du -sh Maildir\r
+2,8G   Maildir\r
+$ cd Maildir\r
+$ du -sh .notmuch\r
+1,1G   .notmuch\r
+\r
+> That's definitely not too much mail. I think you should expect "notmuch\r
+> new" currently to index on the order of 10 - 100 messages/sec.\r
+>\r
+> Your "notmuch new" process should have been reporting a count once per\r
+> second as it progressed, (at least until things went wrong). How far did\r
+> you see that go?\r
+\r
+It started quickly, but its speed decreased, and I interrupted it at\r
+some 4000 messages, if I remember correctly.\r
+\r
+Regards\r
+Dominik\r