Return-Path: <cworth@cworth.org>
X-Original-To: notmuch@notmuchmail.org
Delivered-To: notmuch@notmuchmail.org
Received: from localhost (localhost [127.0.0.1])
	by olra.theworths.org (Postfix) with ESMTP id E21B4431FBF;
	Fri, 20 Nov 2009 12:56:44 -0800 (PST)
X-Virus-Scanned: Debian amavisd-new at olra.theworths.org
Received: from olra.theworths.org ([127.0.0.1])
	by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id MTcrkQqsFwyo; Fri, 20 Nov 2009 12:56:44 -0800 (PST)
Received: from cworth.org (localhost [127.0.0.1])
	by olra.theworths.org (Postfix) with ESMTP id 0D672431FAE;
	Fri, 20 Nov 2009 12:56:43 -0800 (PST)
From: Carl Worth <cworth@cworth.org>
To: Dominik Epple <dominik.epple@googlemail.com>, notmuch@notmuchmail.org
In-Reply-To: <123554aa0911200056h73def158pb0db64a2a78ed687@mail.gmail.com>
References: <123554aa0911200056h73def158pb0db64a2a78ed687@mail.gmail.com>
Date: Fri, 20 Nov 2009 21:56:32 +0100
Message-ID: <87skc8oqyn.fsf@yoom.home.cworth.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Subject: Re: [notmuch] notmuch new: Memory problem
X-BeenThere: notmuch@notmuchmail.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Use and development of the notmuch mail system."
	<notmuch.notmuchmail.org>
List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,
	<mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>
List-Archive: <http://notmuchmail.org/pipermail/notmuch>
List-Post: <mailto:notmuch@notmuchmail.org>
List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>
List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,
	<mailto:notmuch-request@notmuchmail.org?subject=subscribe>
X-List-Received-Date: Fri, 20 Nov 2009 20:56:45 -0000

On Fri, 20 Nov 2009 09:56:50 +0100, Dominik Epple <dominik.epple@googlemail.com> wrote:
> Is there a problem with the number of my mails? I currently have over
> 40.000 Mails... they live currently in mbox files, I created a Maildir
> with mb2md-3.20.pl.

I'm suspecting that you have some big files in there, (such as indexes
from some other mail program). We had code in notmuch to detect and
ignore these, but a recent bug had broken that.

I just fixed this code as of the below commit. So please update and try
again and let us know if things work any better.

Thanks for your patience!

-Carl

commit 3ae12b1e286d1c0041a2e3957cb01daa2981dad9
Author: Carl Worth <cworth@cworth.org>
Date:   Fri Nov 20 21:46:37 2009 +0100

    add_message: Re-fix handling of non-mail files.
    
    More fallout from _get_header now returning "" for missing headers.
    
    The bug here is that we would no longer detect that a file is not an
    email message and give up on it like we should.
    
    And this time, I actually audited all callers to
    notmuch_message_get_header, so hopefully we're done fixing this
    bug over and over.