From: Patrick Totzke Date: Fri, 9 Nov 2012 09:34:37 +0000 (+0000) Subject: Re: Notmuch indexing takes too long X-Git-Url: http://git.tremily.us/gitweb.cgi?a=commitdiff_plain;h=e1bfa5c96c523b21679a02d4e3808b57914659ee;p=notmuch-archives.git Re: Notmuch indexing takes too long --- diff --git a/18/07b38682c396c0f3baabfe3b6d1fb23b4a52da b/18/07b38682c396c0f3baabfe3b6d1fb23b4a52da new file mode 100644 index 000000000..0c4def371 --- /dev/null +++ b/18/07b38682c396c0f3baabfe3b6d1fb23b4a52da @@ -0,0 +1,110 @@ +Return-Path: +X-Original-To: notmuch@notmuchmail.org +Delivered-To: notmuch@notmuchmail.org +Received: from localhost (localhost [127.0.0.1]) + by olra.theworths.org (Postfix) with ESMTP id 1B0DC431FB6 + for ; Fri, 9 Nov 2012 01:33:13 -0800 (PST) +X-Virus-Scanned: Debian amavisd-new at olra.theworths.org +X-Spam-Flag: NO +X-Spam-Score: -0.799 +X-Spam-Level: +X-Spam-Status: No, score=-0.799 tagged_above=-999 required=5 + tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, + FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled +Received: from olra.theworths.org ([127.0.0.1]) + by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) + with ESMTP id LdtUaDr5w4yC for ; + Fri, 9 Nov 2012 01:33:12 -0800 (PST) +Received: from mail-wi0-f179.google.com (mail-wi0-f179.google.com + [209.85.212.179]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) + (No client certificate requested) + by olra.theworths.org (Postfix) with ESMTPS id 65EED431FAE + for ; Fri, 9 Nov 2012 01:33:12 -0800 (PST) +Received: by mail-wi0-f179.google.com with SMTP id hm6so262226wib.2 + for ; Fri, 09 Nov 2012 01:33:09 -0800 (PST) +DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; + h=content-type:mime-version:content-transfer-encoding:from:user-agent + :to:references:in-reply-to:message-id:subject:date; + bh=+LeS4IWzsnz9UIZLU1WM9NtWkOed7+L07xZm1rHpjNQ=; + b=VGhxTGfNG9fqhbioFVYIMrGyoLMFCfTTGgozCo8X5cCofmtHjWW7ngWdnpd633pO5P + f2gziKzYMvESCSUjDtrTWk3kXtN64GnvLUmoTnlFgVIpdozUL01CMt1k8iW7Tf45SyQy + maSgbyZixAxpzJPRHYxVoeRIKpndY4QTAq1UO3YLBlrre53fjQDH+xH7KevuWTGAauLP + r5hl+dGPS8qv9kexduc+QX8spPAVmr0Lm/cDIkV+Y82wPn2niidgpp6k10Y0of2p83/W + 1RgDYaLBRPgoR4wEVnLxL/wMvqfhI2hs9sTC6scurdTG89Ts2Blpedn6kIG54Ahltfit + CCvQ== +Received: by 10.180.7.194 with SMTP id l2mr1579333wia.0.1352453589773; + Fri, 09 Nov 2012 01:33:09 -0800 (PST) +Received: from localhost (dhcp-91-036.inf.ed.ac.uk. [129.215.91.36]) + by mx.google.com with ESMTPS id s12sm1332729wik.11.2012.11.09.01.33.07 + (version=TLSv1/SSLv3 cipher=OTHER); + Fri, 09 Nov 2012 01:33:08 -0800 (PST) +Content-Type: text/plain; charset="utf-8" +MIME-Version: 1.0 +Content-Transfer-Encoding: quoted-printable +From: Patrick Totzke +User-Agent: alot/0.3.3+ +To: Ondrej Jombik , notmuch@notmuchmail.org +References: +In-Reply-To: +Message-ID: <20121109093437.4382.75139@megatron> +Subject: Re: Notmuch indexing takes too long +Date: Fri, 09 Nov 2012 09:34:37 +0000 +X-BeenThere: notmuch@notmuchmail.org +X-Mailman-Version: 2.1.13 +Precedence: list +List-Id: "Use and development of the notmuch mail system." + +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +X-List-Received-Date: Fri, 09 Nov 2012 09:33:13 -0000 + +Hi Ondrej, + +Quoting Ondrej Jombik (2012-11-09 02:58:09) +> I am trying to move from mairix to some better solution. mairix has been +> working really well for me, but it had some limitations. +> = + +> I decided to give a try to notmuch, but I has been suprised with +> estimated indexing time: +> = + +> Processed 4157 of 822462 files (10h 3m 42s remaining). +> = + +> At the beggining when there was 11 hours estimate I simply thought that +> those numbers are wrong. But they are not. This is really going to take +> that long. I could not believe that you all wait that long to index your +> maildirs:) +> = + +> Also if I understand correctly the concept, whenever I want to +> regenerate database, I have to move old away and create new one, +> correct? mairix worked that way that you run it and it updated its own +> database. Is it possible with notmuch as well? I simply do not want to +> wait 10+ hours for every database regeneration, thought I am willing to +> wait that long for initial indexing. + +Notmuch does incremental idnex updates once the initial index is build. +The initial indexing takes a while, depending on the number of mails you ha= +ve +but 10 *hours* seems a little off. For me its ~5mins on the hdd and <2 on a= + ssd. + +> My last question is related to notmuch and Alpine. Alpine is +> a IMAP/Maildir e-mail client based on old PINE. I get used to that so +> much that I cannot move away (to Mutt, for example). Is there anyone who +> uses notmuch with Alpine and created some scripts and/or key-bindings? + +You might want to have a look at notmuchfs: https://github.com/tsto/notmuch= +fs +Also, there are a few other MUAs based on notmuch: +Check out http://notmuchmail.org/frontends/ + +Have fun, +/p