From 77df809dec6f37e8466bd97b87a7c209cd61fa53 Mon Sep 17 00:00:00 2001 From: Mayeu Date: Tue, 21 Apr 2015 18:09:13 +0200 Subject: [PATCH] Notmuch removing messages from the index, when calling `new` two times in a row --- 29/4b2b20c4b4c4b455bbf4a2543462d684a463af | 100 ++++++++++++++++++++++ 1 file changed, 100 insertions(+) create mode 100644 29/4b2b20c4b4c4b455bbf4a2543462d684a463af diff --git a/29/4b2b20c4b4c4b455bbf4a2543462d684a463af b/29/4b2b20c4b4c4b455bbf4a2543462d684a463af new file mode 100644 index 000000000..9bdc6b726 --- /dev/null +++ b/29/4b2b20c4b4c4b455bbf4a2543462d684a463af @@ -0,0 +1,100 @@ +Return-Path: +X-Original-To: notmuch@notmuchmail.org +Delivered-To: notmuch@notmuchmail.org +Received: from localhost (localhost [127.0.0.1]) + by arlo.cworth.org (Postfix) with ESMTP id 63CDA6DE13AC + for ; Tue, 21 Apr 2015 09:16:02 -0700 (PDT) +X-Virus-Scanned: Debian amavisd-new at cworth.org +X-Spam-Flag: NO +X-Spam-Score: -0.002 +X-Spam-Level: +X-Spam-Status: No, score=-0.002 tagged_above=-999 required=5 + tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, SPF_HELO_PASS=-0.001, + SPF_PASS=-0.001] autolearn=disabled +Received: from arlo.cworth.org ([127.0.0.1]) + by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) + with ESMTP id p9xcCVreSQv3 for ; + Tue, 21 Apr 2015 09:15:58 -0700 (PDT) +X-Greylist: delayed 397 seconds by postgrey-1.35 at arlo; + Tue, 21 Apr 2015 09:15:58 PDT +Received: from asgard.tc2.fr (asgard.tc2.fr [37.59.60.141]) + by arlo.cworth.org (Postfix) with ESMTPS id 64CB86DE0AC2 + for ; Tue, 21 Apr 2015 09:15:58 -0700 (PDT) +Received: from asgard.tc2.fr (localhost [127.0.0.1]); + by asgard.tc2.fr (OpenSMTPD) with ESMTP id 4083f0a9; + for ; Tue, 21 Apr 2015 16:09:16 +0000 (UTC) +DKIM-Signature: v=1; a=rsa-sha1; c=simple; d=tc2.fr; h=from:to:subject + :date:message-id:mime-version:content-type; s=smtpd; bh=5Xzwc+P4 + ItXw0qKMLPTnUg8whmM=; b=J8J7Ycwbrlj3ZRIMCKyz+28HWB3ccHQ4vxAbj7BH + S38zHiWidTKN1KARAuz1Oxn4I3+CBnujo6YAolmERW7m0M0ZLykB4esEnCjiBC4a + mqM3Z6YxWl/UkUEkVneAqkaPlTqlyEp1rNTArDzBzZj77W10RhwPPbaAH+QIz79T + PzM= +Received: from localhost (unused.senselan.ch [83.222.141.234]); by + asgard.tc2.fr (OpenSMTPD) with ESMTPSA id 5947abf0; TLS version=TLSv1/SSLv3 + cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO; for + ; Tue, 21 Apr 2015 16:09:16 +0000 (UTC) +From: Mayeu +To: notmuch@notmuchmail.org +Subject: Notmuch removing messages from the index, + when calling `new` two times in a row +User-Agent: Notmuch/0.19 (http://notmuchmail.org) Emacs/24.4.2 + (x86_64-unknown-linux-gnu) +Date: Tue, 21 Apr 2015 18:09:13 +0200 +Message-ID: <87y4llpiom.fsf@azathoth.devlab.ch> +MIME-Version: 1.0 +Content-Type: text/plain +X-Mailman-Approved-At: Wed, 22 Apr 2015 05:08:42 -0700 +X-BeenThere: notmuch@notmuchmail.org +X-Mailman-Version: 2.1.18 +Precedence: list +List-Id: "Use and development of the notmuch mail system." + +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +X-List-Received-Date: Tue, 21 Apr 2015 16:16:02 -0000 + +Hi, + +I have hit a weird behaviour with notmuch. + +I recently saw a drop of the number of messages in my index, and after +doing a backup of the current state of the index, I am able to reproduce +this behaviour fairly consistently. ie: notmuch is purgin at least 50% +of its index of messages that are still in the maildir. + +I do the following: + +1. remove my notmuch database completely. +2. launching `notmuch new`: + + Found 42059 total files (that's not much mail). + Processed 42059 total files in 3m 24s (205 files/sec.). + Added 41331 new messages to the database. + +3. launching `notmuch new` right after, without having done anything else + on my Maildir folder: + + Cleaned up 5 of 156 directories (1m 9s remaining). + No new mail. Removed 22211 messages. Detected 378 file renames. + +Then I can loop back to step 1 and reproduce the behaviour every single time. + +If I keep a window with Notmuch Emacs in it, I can see some e-mail +disapearing, and search not returning result anymore after the second +notmuch new. + +Is it a know bug? A feature that I do not understand? Anyway, this make +notmuch almost unusable right now, since I can't have acces to my full +e-mail history, and I endup with conversations with holes in them. + +Regards, + +-- +Mayeu a.k.a Matthieu +http://6x9.fr +GPG: A016 F2D8 0472 1186 1B33 A419 22B1 0496 B00D A693 -- 2.26.2