From 590577271912a0854e970a2a1c6f5a13c704c789 Mon Sep 17 00:00:00 2001 From: Hamish Downer Date: Tue, 4 Feb 2014 18:03:45 +0000 Subject: [PATCH] Re: notmuch killed due to out of memory - how to move forward --- 70/b0872f9e56e7f359d972accda169910dbb2541 | 93 +++++++++++++++++++++++ 1 file changed, 93 insertions(+) create mode 100644 70/b0872f9e56e7f359d972accda169910dbb2541 diff --git a/70/b0872f9e56e7f359d972accda169910dbb2541 b/70/b0872f9e56e7f359d972accda169910dbb2541 new file mode 100644 index 000000000..38f460cfb --- /dev/null +++ b/70/b0872f9e56e7f359d972accda169910dbb2541 @@ -0,0 +1,93 @@ +Return-Path: +X-Original-To: notmuch@notmuchmail.org +Delivered-To: notmuch@notmuchmail.org +Received: from localhost (localhost [127.0.0.1]) + by olra.theworths.org (Postfix) with ESMTP id 57A23431FBD + for ; Tue, 4 Feb 2014 10:04:33 -0800 (PST) +X-Virus-Scanned: Debian amavisd-new at olra.theworths.org +X-Spam-Flag: NO +X-Spam-Score: -0.699 +X-Spam-Level: +X-Spam-Status: No, score=-0.699 tagged_above=-999 required=5 + tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, + RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled +Received: from olra.theworths.org ([127.0.0.1]) + by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) + with ESMTP id ebrKOctANQZ0 for ; + Tue, 4 Feb 2014 10:04:27 -0800 (PST) +Received: from mail-qa0-f51.google.com (mail-qa0-f51.google.com + [209.85.216.51]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) + (No client certificate requested) + by olra.theworths.org (Postfix) with ESMTPS id 0C0CB431FBC + for ; Tue, 4 Feb 2014 10:04:27 -0800 (PST) +Received: by mail-qa0-f51.google.com with SMTP id f11so12715014qae.24 + for ; Tue, 04 Feb 2014 10:04:25 -0800 (PST) +DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; + h=mime-version:sender:in-reply-to:references:from:date:message-id + :subject:to:cc:content-type; + bh=IXen1FRWAMAMb8KouLrxuoeDjwU/7bWF5D6FJmnDGZ4=; + b=P0tfRP7M7fKdFJTrwPUZn10iPzXwYflafDemm5g9GytFasRY64jJbcPXG/SQMncihJ + 2Wu/K9QK9+BE+aMLtXftnHoHarDDuhvkel/JzzTGuwWy534pr/64S6E0uqk1uNw0dy/w + CzqMECLO5vs4ohgq3QXUu2EvKXolOIDapSq6DsVPOdKfEFLzZvui4HdGZy0p0N9Dzapt + iqFzSEEM2ooDt+Zdus2x0J3AFqjrCIRewAOeClVEmFFPT7zHMAmFIeIAFKvoT/vdK1nC + xGNZNHTeT4C1nU30cU154I22axFHv030gaKPLHOenmGzddSabC9rAv/KmPNDeOjP1zPj + +Jug== +X-Received: by 10.140.37.146 with SMTP id r18mr64619747qgr.61.1391537065313; + Tue, 04 Feb 2014 10:04:25 -0800 (PST) +MIME-Version: 1.0 +Sender: dmishd@gmail.com +Received: by 10.140.49.83 with HTTP; Tue, 4 Feb 2014 10:03:45 -0800 (PST) +In-Reply-To: <87r47jcmj6.fsf@nikula.org> +References: + + <87r47jcmj6.fsf@nikula.org> +From: Hamish Downer +Date: Tue, 4 Feb 2014 18:03:45 +0000 +X-Google-Sender-Auth: 9F-3oe94imF0wQfJA067Yr45Vv4 +Message-ID: + +Subject: Re: notmuch killed due to out of memory - how to move forward +To: Jani Nikula +Content-Type: text/plain; charset=UTF-8 +Cc: notmuch@notmuchmail.org +X-BeenThere: notmuch@notmuchmail.org +X-Mailman-Version: 2.1.13 +Precedence: list +List-Id: "Use and development of the notmuch mail system." + +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +X-List-Received-Date: Tue, 04 Feb 2014 18:04:33 -0000 + +On 4 February 2014 08:25, Jani Nikula wrote: +> On Mon, 03 Feb 2014, Hamish Downer wrote: +>> I recently deleted almost 30000 old messages from my maildirs, and +>> since I did that, notmuch new has not managed to complete. I have it +>> running on a server with 1 GB of RAM, and the output is telling me +>> +>> Cleaned up 25515 of 29803 messages (1m 10s remaining). +>> +>> at the point it is killed. I have followed it up to this point with +>> top and free and I can see memory usage growing to something like +>> 700MB (RES) at which point the process is killed. +> +> Please try SIGINT, or ^C, on notmuch new before it gets killed. That +> should be handled gracefully, making progress, and letting you chop up +> and eventually finish the operation. Please let us know if this helps. + +That did it, thank you. Good to know Ctrl-C is gracefully handled. + +> Needless to say, we shouldn't use that much memory just to delete files +> from the index. + +I have saved a copy of the index from before I fixed the problem. I am +happy to re-run it with a rebuilt notmuch if that would be useful from the +point of view of uncovering bugs. + +Otherwise I'll carry on as a happy notmuch user +Hamish -- 2.26.2