1 Return-Path: <mh@glandium.org>
\r
2 X-Original-To: notmuch@notmuchmail.org
\r
3 Delivered-To: notmuch@notmuchmail.org
\r
4 Received: from localhost (localhost [127.0.0.1])
\r
5 by olra.theworths.org (Postfix) with ESMTP id 48066431FBC
\r
6 for <notmuch@notmuchmail.org>; Sun, 22 Nov 2009 00:37:31 -0800 (PST)
\r
7 X-Virus-Scanned: Debian amavisd-new at olra.theworths.org
\r
8 Received: from olra.theworths.org ([127.0.0.1])
\r
9 by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)
\r
10 with ESMTP id 07CYxhR9p5Wi for <notmuch@notmuchmail.org>;
\r
11 Sun, 22 Nov 2009 00:37:30 -0800 (PST)
\r
12 Received: from vuizook.err.no (vuizook.err.no [85.19.221.46])
\r
13 by olra.theworths.org (Postfix) with ESMTP id 51C1C431FAE
\r
14 for <notmuch@notmuchmail.org>; Sun, 22 Nov 2009 00:37:30 -0800 (PST)
\r
15 Received: from cha92-13-88-165-248-19.fbx.proxad.net ([88.165.248.19]
\r
17 by vuizook.err.no with esmtps (TLS-1.0:RSA_AES_256_CBC_SHA1:32)
\r
18 (Exim 4.69) (envelope-from <mh@glandium.org>)
\r
19 id 1NC7wk-0006Ts-2P; Sun, 22 Nov 2009 09:37:28 +0100
\r
20 Received: from mh by jigen with local (Exim 4.69) (envelope-from <mh@jigen>)
\r
21 id 1NC7w6-0002OZ-93; Sun, 22 Nov 2009 09:36:46 +0100
\r
22 Date: Sun, 22 Nov 2009 09:36:46 +0100
\r
23 From: Mike Hommey <mh+notmuch@glandium.org>
\r
24 To: Brett Viren <brett.viren@gmail.com>
\r
25 Message-ID: <20091122083646.GA8420@glandium.org>
\r
26 References: <20091121145111.GB19397@excalibur.local>
\r
27 <87fx874xj5.fsf@yoom.home.cworth.org>
\r
28 <46263c600911211436s5826015eqc5fc18a4164245cb@mail.gmail.com>
\r
30 Content-Type: text/plain; charset=us-ascii
\r
31 Content-Disposition: inline
\r
32 In-Reply-To: <46263c600911211436s5826015eqc5fc18a4164245cb@mail.gmail.com>
\r
33 X-GPG-Fingerprint: A479 A824 265C B2A5 FC54 8D1E DE4B DA2C 54FD 2A58
\r
34 User-Agent: Mutt/1.5.20 (2009-06-14)
\r
35 Cc: notmuch@notmuchmail.org
\r
36 Subject: Re: [notmuch] 25 minutes load time with emacs -f notmuch
\r
37 X-BeenThere: notmuch@notmuchmail.org
\r
38 X-Mailman-Version: 2.1.12
\r
40 List-Id: "Use and development of the notmuch mail system."
\r
41 <notmuch.notmuchmail.org>
\r
42 List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,
\r
43 <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>
\r
44 List-Archive: <http://notmuchmail.org/pipermail/notmuch>
\r
45 List-Post: <mailto:notmuch@notmuchmail.org>
\r
46 List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>
\r
47 List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,
\r
48 <mailto:notmuch-request@notmuchmail.org?subject=subscribe>
\r
49 X-List-Received-Date: Sun, 22 Nov 2009 08:37:31 -0000
\r
51 On Sat, Nov 21, 2009 at 05:36:18PM -0500, Brett Viren wrote:
\r
52 > On Sat, Nov 21, 2009 at 12:07 PM, Carl Worth <cworth@cworth.org> wrote:
\r
54 > > Though, frankly, I think we need to fix "notmuch new" to do much better
\r
55 > > than 40 files/sec.
\r
59 > Processed 130871 total files in 38m 7s (57 files/sec.).
\r
60 > Added 102723 new messages to the database (not much, really).
\r
62 > This was ~2GB of mail on a 2.5GHz CPU. That seems pretty reasonable
\r
63 > to me but I'd like to rerun the "notmuch new" under google perftools
\r
64 > to see if there are any obvious bottlenecks that might be cleaned up.
\r
66 FWIW, my 90k+ messages mailbox was imported at a pace of 130 files/sec,
\r
67 and my CPU is "only" 2.2GHz, but I have a SSD. A good share of the
\r
68 bottlenecks is "simply" I/O. Don't forget having a lot of small files
\r
69 sucks I/O wise, as files are most likely spread all over the disk.
\r
71 A good test, if you have enough memory, would be to put your mailbox in
\r
72 a tmpfs, and see how fast that imports.
\r