notmuch killed due to out of memory - how to move forward

diff --git a/63/c180d34d1b83f9e005597519e27e4198647446 b/63/c180d34d1b83f9e005597519e27e4198647446
new file mode 100644 (file)
index 0000000..8520b90
--- /dev/null
+++ b/63/c180d34d1b83f9e005597519e27e4198647446
@@ -0,0 +1,92 @@
+Return-Path: <dmishd@gmail.com>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 5E908431FBC\r
+       for <notmuch@notmuchmail.org>; Mon,  3 Feb 2014 14:18:51 -0800 (PST)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: -0.699\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=-0.699 tagged_above=-999 required=5\r
+       tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001,\r
+       RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id kcWxTA8vypry for <notmuch@notmuchmail.org>;\r
+       Mon,  3 Feb 2014 14:18:46 -0800 (PST)\r
+Received: from mail-qc0-f178.google.com (mail-qc0-f178.google.com\r
+       [209.85.216.178]) (using TLSv1 with cipher RC4-SHA (128/128 bits))\r
+       (No client certificate requested)\r
+       by olra.theworths.org (Postfix) with ESMTPS id 94C5E431FAF\r
+       for <notmuch@notmuchmail.org>; Mon,  3 Feb 2014 14:18:46 -0800 (PST)\r
+Received: by mail-qc0-f178.google.com with SMTP id m20so12140296qcx.23\r
+       for <notmuch@notmuchmail.org>; Mon, 03 Feb 2014 14:18:46 -0800 (PST)\r
+DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;\r
+       h=mime-version:sender:from:date:message-id:subject:to:content-type;\r
+       bh=8q38TB5EwsUB4tS7nIEiP5ROdOm+QkaTZIyb8IwMR6A=;\r
+       b=h94OXI/ThsY02PTMdAhqKRNLFDlbIyacfxIU0ssXw3aJCy5Uv2ykU++CpccS/qdBXZ\r
+       AA8LTWHu+1/1bZ0qkl9abG80EA8K1F964SmZpUfp56/9V7lGieJ5uJTjofarghI92FjX\r
+       RTZcGrCslPJ0D7enXwrPdnhttsUrbvRMtdLEKtApr4GbegHfyvjBMHvzLjLTTN8UEHFo\r
+       ULXS1FKRgDuo9Jm6yxzU2zHyYxvV4/2U5OH9qdEZQhAXzA9kr/DXFViIZ0ixAoiv4+GE\r
+       XLDWoX6UWV3yrt+aTPVyZykVBGjZwGs7ZK2zT50ZEMj22Yq9+AK4M2IA8VY7tes7IuvL\r
+       dmrg==\r
+X-Received: by 10.140.49.239 with SMTP id q102mr20790595qga.103.1391465924865;\r
+       Mon, 03 Feb 2014 14:18:44 -0800 (PST)\r
+MIME-Version: 1.0\r
+Sender: dmishd@gmail.com\r
+Received: by 10.140.49.83 with HTTP; Mon, 3 Feb 2014 14:18:01 -0800 (PST)\r
+From: Hamish Downer <hamish@foobacca.co.uk>\r
+Date: Mon, 3 Feb 2014 22:18:01 +0000\r
+X-Google-Sender-Auth: PXgZdkCFd2VqpUWgRaxR3dw07yU\r
+Message-ID:\r
+ <CAOxvSbfWu3M=M1PyFrZcUhszjW0rpb0wYOiia+3sSSd9AGqD4w@mail.gmail.com>\r
+Subject: notmuch killed due to out of memory - how to move forward\r
+To: notmuch@notmuchmail.org\r
+Content-Type: text/plain; charset=UTF-8\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Mon, 03 Feb 2014 22:18:51 -0000\r
+\r
+Hello\r
+\r
+I recently deleted almost 30000 old messages from my maildirs, and\r
+since I did that, notmuch new has not managed to complete.  I have it\r
+running on a server with 1 GB of RAM, and the output is telling me\r
+\r
+    Cleaned up 25515 of 29803 messages (1m 10s remaining).\r
+\r
+at the point it is killed.  I have followed it up to this point with\r
+top and free and I can see memory usage growing to something like\r
+700MB (RES) at which point the process is killed.\r
+\r
+I am using notmuch 0.17 (from the debian jessie package 0.17-3) on\r
+debian wheezy 64 bit.\r
+\r
+Any pointers as to what to do to get past this point would be greatly\r
+appreciated.  If I have just deleted that many messages should I just\r
+expect notmuch to use that much memory?  (Unfortunately the company\r
+supplying the server does not allow swap to be enabled so I can't fudge\r
+it that way)\r
+\r
+I did also try running it with NOTMUCH_TALLOC_REPORT, but that didn't\r
+produce a report (though I was unsure if I needed to rebuild notmuch\r
+before that would work).\r
+\r
+Happy to build notmuch from source if this might be an interesting bug\r
+worth tracking down.\r
+\r
+Hamish\r
+\r
+(PS sorry to moderators - I subscribed and then sent this email from the\r
+wrong address a couple of times)\r