Re: How to debug 'ignoring non-mail file' issues

diff --git a/fe/473fddc0b904d1c321579c534fc0d4e0bd672e b/fe/473fddc0b904d1c321579c534fc0d4e0bd672e
new file mode 100644 (file)
index 0000000..2e0cdcd
--- /dev/null
+++ b/fe/473fddc0b904d1c321579c534fc0d4e0bd672e
@@ -0,0 +1,88 @@
+Return-Path: <perttu.luukko@iki.fi>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 5FA7E431FC0\r
+       for <notmuch@notmuchmail.org>; Sun, 31 Aug 2014 23:52:29 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: 0\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=0 tagged_above=-999 required=5 tests=[none]\r
+       autolearn=disabled\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id IVdyEMS4IcAQ for <notmuch@notmuchmail.org>;\r
+       Sun, 31 Aug 2014 23:52:23 -0700 (PDT)\r
+Received: from mail.kapsi.fi (mail.kapsi.fi [217.30.184.167])\r
+       (using TLSv1 with cipher AES256-SHA (256/256 bits))\r
+       (No client certificate requested)\r
+       by olra.theworths.org (Postfix) with ESMTPS id 2DA5E431FAE\r
+       for <notmuch@notmuchmail.org>; Sun, 31 Aug 2014 23:52:23 -0700 (PDT)\r
+Received: from lakka.kapsi.fi ([2001:1bc8:1004::1] ident=Debian-exim)\r
+       by mail.kapsi.fi with esmtps (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16)\r
+       (Exim 4.72) (envelope-from <perttu.luukko@iki.fi>)\r
+       id 1XOLTQ-0002QR-Ve; Mon, 01 Sep 2014 09:52:20 +0300\r
+Received: from nuteater by lakka.kapsi.fi with local (Exim 4.80)\r
+       (envelope-from <perttu.luukko@iki.fi>)\r
+       id 1XOLTQ-0007Y9-Ow; Mon, 01 Sep 2014 09:52:20 +0300\r
+Date: Mon, 1 Sep 2014 09:52:20 +0300\r
+From: Perttu Luukko <perttu.luukko@iki.fi>\r
+To: David Bremner <david@tethera.net>\r
+Subject: Re: How to debug 'ignoring non-mail file' issues\r
+Message-ID: <20140901065220.GB3901@lakka.kapsi.fi>\r
+References: <20140831074059.GA13399@rakuuna.dhcp.inet.fi>\r
+       <87tx4ssoux.fsf@maritornes.cs.unb.ca>\r
+MIME-Version: 1.0\r
+Content-Type: text/plain; charset=us-ascii\r
+Content-Disposition: inline\r
+In-Reply-To: <87tx4ssoux.fsf@maritornes.cs.unb.ca>\r
+User-Agent: Mutt/1.5.22.1 (2013-10-16)\r
+X-SA-Exim-Connect-IP: 2001:1bc8:1004::1\r
+X-SA-Exim-Mail-From: perttu.luukko@iki.fi\r
+X-SA-Exim-Scanned: No (on mail.kapsi.fi); SAEximRunCond expanded to false\r
+Cc: notmuch@notmuchmail.org\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Mon, 01 Sep 2014 06:52:29 -0000\r
+\r
+On 2014-08-31 07:41:42, David Bremner wrote:\r
+> Perttu Luukko <perttu.luukko@iki.fi> writes:\r
+> > The vast majority of these ignored mails are not ignored after I\r
+> > transfer them with offlineimap to another computer. I can non-ignore\r
+> > these files probably by copying the renamed file back to the mail\r
+> > server, so this is fixable. Offlineimap shouldn't mess with the file's\r
+> > contents, so is there something that can cause notmuch to ignore a file\r
+> > based on its name?\r
+> \r
+> The most likely cause is that the files are mboxes, whether intentional\r
+> or not.  In particular if they start with a "From " (note the lack of :)\r
+> and contain a second "From " at the beginning of a line later in the\r
+> file. In this case something like sed can replace the initial \r
+> "From " with "X-Envelope-From: ".\r
+> \r
+> I agree that the error message could be more informative in this case.\r
+\r
+No, the mails do contain "From: " with the appropriate colon. If I\r
+understood correctly notmuch returns the same "not mail" return code\r
+both when the essential headers are missing (so the file probably really\r
+isn't mail) and when GMime fails to parse the message. I think it would\r
+be a good idea to give a different warning in the latter case.\r
+\r
+If the files really are ignored because of GMime it also explains why so\r
+much more files are ignored on my mail provider's server than on my\r
+laptop. The server probably has an older version of GMime. I'll upgrade\r
+and see if that makes a difference.\r
+\r
+-- \r
+Perttu\r