Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id 5E908431FBC for ; Mon, 3 Feb 2014 14:18:51 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -0.699 X-Spam-Level: X-Spam-Status: No, score=-0.699 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id kcWxTA8vypry for ; Mon, 3 Feb 2014 14:18:46 -0800 (PST) Received: from mail-qc0-f178.google.com (mail-qc0-f178.google.com [209.85.216.178]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by olra.theworths.org (Postfix) with ESMTPS id 94C5E431FAF for ; Mon, 3 Feb 2014 14:18:46 -0800 (PST) Received: by mail-qc0-f178.google.com with SMTP id m20so12140296qcx.23 for ; Mon, 03 Feb 2014 14:18:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:from:date:message-id:subject:to:content-type; bh=8q38TB5EwsUB4tS7nIEiP5ROdOm+QkaTZIyb8IwMR6A=; b=h94OXI/ThsY02PTMdAhqKRNLFDlbIyacfxIU0ssXw3aJCy5Uv2ykU++CpccS/qdBXZ AA8LTWHu+1/1bZ0qkl9abG80EA8K1F964SmZpUfp56/9V7lGieJ5uJTjofarghI92FjX RTZcGrCslPJ0D7enXwrPdnhttsUrbvRMtdLEKtApr4GbegHfyvjBMHvzLjLTTN8UEHFo ULXS1FKRgDuo9Jm6yxzU2zHyYxvV4/2U5OH9qdEZQhAXzA9kr/DXFViIZ0ixAoiv4+GE XLDWoX6UWV3yrt+aTPVyZykVBGjZwGs7ZK2zT50ZEMj22Yq9+AK4M2IA8VY7tes7IuvL dmrg== X-Received: by 10.140.49.239 with SMTP id q102mr20790595qga.103.1391465924865; Mon, 03 Feb 2014 14:18:44 -0800 (PST) MIME-Version: 1.0 Sender: dmishd@gmail.com Received: by 10.140.49.83 with HTTP; Mon, 3 Feb 2014 14:18:01 -0800 (PST) From: Hamish Downer Date: Mon, 3 Feb 2014 22:18:01 +0000 X-Google-Sender-Auth: PXgZdkCFd2VqpUWgRaxR3dw07yU Message-ID: Subject: notmuch killed due to out of memory - how to move forward To: notmuch@notmuchmail.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Feb 2014 22:18:51 -0000 Hello I recently deleted almost 30000 old messages from my maildirs, and since I did that, notmuch new has not managed to complete. I have it running on a server with 1 GB of RAM, and the output is telling me Cleaned up 25515 of 29803 messages (1m 10s remaining). at the point it is killed. I have followed it up to this point with top and free and I can see memory usage growing to something like 700MB (RES) at which point the process is killed. I am using notmuch 0.17 (from the debian jessie package 0.17-3) on debian wheezy 64 bit. Any pointers as to what to do to get past this point would be greatly appreciated. If I have just deleted that many messages should I just expect notmuch to use that much memory? (Unfortunately the company supplying the server does not allow swap to be enabled so I can't fudge it that way) I did also try running it with NOTMUCH_TALLOC_REPORT, but that didn't produce a report (though I was unsure if I needed to rebuild notmuch before that would work). Happy to build notmuch from source if this might be an interesting bug worth tracking down. Hamish (PS sorry to moderators - I subscribed and then sent this email from the wrong address a couple of times)