Notmuch removing messages from the index, when calling `new` two times in a row

diff --git a/29/4b2b20c4b4c4b455bbf4a2543462d684a463af b/29/4b2b20c4b4c4b455bbf4a2543462d684a463af
new file mode 100644 (file)
index 0000000..9bdc6b7
--- /dev/null
+++ b/29/4b2b20c4b4c4b455bbf4a2543462d684a463af
@@ -0,0 +1,100 @@
+Return-Path: <m@6x9.fr>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+ by arlo.cworth.org (Postfix) with ESMTP id 63CDA6DE13AC\r
+ for <notmuch@notmuchmail.org>; Tue, 21 Apr 2015 09:16:02 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at cworth.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: -0.002\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=-0.002 tagged_above=-999 required=5\r
+ tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, SPF_HELO_PASS=-0.001,\r
+ SPF_PASS=-0.001] autolearn=disabled\r
+Received: from arlo.cworth.org ([127.0.0.1])\r
+ by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024)\r
+ with ESMTP id p9xcCVreSQv3 for <notmuch@notmuchmail.org>;\r
+ Tue, 21 Apr 2015 09:15:58 -0700 (PDT)\r
+X-Greylist: delayed 397 seconds by postgrey-1.35 at arlo;\r
+ Tue, 21 Apr 2015 09:15:58 PDT\r
+Received: from asgard.tc2.fr (asgard.tc2.fr [37.59.60.141])\r
+ by arlo.cworth.org (Postfix) with ESMTPS id 64CB86DE0AC2\r
+ for <notmuch@notmuchmail.org>; Tue, 21 Apr 2015 09:15:58 -0700 (PDT)\r
+Received: from asgard.tc2.fr (localhost [127.0.0.1]);\r
+ by asgard.tc2.fr (OpenSMTPD) with ESMTP id 4083f0a9;\r
+ for <notmuch@notmuchmail.org>; Tue, 21 Apr 2015 16:09:16 +0000 (UTC)\r
+DKIM-Signature: v=1; a=rsa-sha1; c=simple; d=tc2.fr; h=from:to:subject\r
+ :date:message-id:mime-version:content-type; s=smtpd; bh=5Xzwc+P4\r
+ ItXw0qKMLPTnUg8whmM=; b=J8J7Ycwbrlj3ZRIMCKyz+28HWB3ccHQ4vxAbj7BH\r
+ S38zHiWidTKN1KARAuz1Oxn4I3+CBnujo6YAolmERW7m0M0ZLykB4esEnCjiBC4a\r
+ mqM3Z6YxWl/UkUEkVneAqkaPlTqlyEp1rNTArDzBzZj77W10RhwPPbaAH+QIz79T\r
+ PzM=\r
+Received: from localhost (unused.senselan.ch [83.222.141.234]); by\r
+ asgard.tc2.fr (OpenSMTPD) with ESMTPSA id 5947abf0; TLS version=TLSv1/SSLv3\r
+ cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO;  for\r
+ <notmuch@notmuchmail.org>; Tue, 21 Apr 2015 16:09:16 +0000 (UTC)\r
+From: Mayeu <m@6x9.fr>\r
+To: notmuch@notmuchmail.org\r
+Subject: Notmuch removing messages from the index,\r
+ when calling `new` two times in a row\r
+User-Agent: Notmuch/0.19 (http://notmuchmail.org) Emacs/24.4.2\r
+ (x86_64-unknown-linux-gnu)\r
+Date: Tue, 21 Apr 2015 18:09:13 +0200\r
+Message-ID: <87y4llpiom.fsf@azathoth.devlab.ch>\r
+MIME-Version: 1.0\r
+Content-Type: text/plain\r
+X-Mailman-Approved-At: Wed, 22 Apr 2015 05:08:42 -0700\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.18\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+ <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+ <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch/>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+ <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Tue, 21 Apr 2015 16:16:02 -0000\r
+\r
+Hi,\r
+\r
+I have hit a weird behaviour with notmuch.\r
+\r
+I recently saw a drop of the number of messages in my index, and after\r
+doing a backup of the current state of the index, I am able to reproduce\r
+this behaviour fairly consistently. ie: notmuch is purgin at least 50%\r
+of its index of messages that are still in the maildir.\r
+\r
+I do the following:\r
+\r
+1. remove my notmuch database completely.\r
+2. launching `notmuch new`:\r
+\r
+   Found 42059 total files (that's not much mail).\r
+   Processed 42059 total files in 3m 24s (205 files/sec.).\r
+   Added 41331 new messages to the database.\r
+\r
+3. launching `notmuch new` right after, without having done anything else\r
+   on my Maildir folder:\r
+\r
+   Cleaned up 5 of 156 directories (1m 9s remaining).                                                                                                   \r
+   No new mail. Removed 22211 messages. Detected 378 file renames.\r
+\r
+Then I can loop back to step 1 and reproduce the behaviour every single time.\r
+\r
+If I keep a window with Notmuch Emacs in it, I can see some e-mail\r
+disapearing, and search not returning result anymore after the second\r
+notmuch new.\r
+\r
+Is it a know bug? A feature that I do not understand? Anyway, this make\r
+notmuch almost unusable right now, since I can't have acces to my full\r
+e-mail history, and I endup with conversations with holes in them.\r
+\r
+Regards,\r
+\r
+-- \r
+Mayeu a.k.a Matthieu\r
+http://6x9.fr\r
+GPG: A016 F2D8 0472 1186 1B33  A419 22B1 0496 B00D A693\r