Re: How to debug 'ignoring non-mail file' issues

diff --git a/d8/d170cb07c1ffa06fb06dd2f3fb05344c3ea2d5 b/d8/d170cb07c1ffa06fb06dd2f3fb05344c3ea2d5
new file mode 100644 (file)
index 0000000..8eee20a
--- /dev/null
+++ b/d8/d170cb07c1ffa06fb06dd2f3fb05344c3ea2d5
@@ -0,0 +1,84 @@
+Return-Path: <perttu.luukko@iki.fi>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 0C9EE431FB6\r
+       for <notmuch@notmuchmail.org>; Wed,  3 Sep 2014 21:35:08 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: 0\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=0 tagged_above=-999 required=5 tests=[none]\r
+       autolearn=disabled\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id QGo4+8MS3KWn for <notmuch@notmuchmail.org>;\r
+       Wed,  3 Sep 2014 21:34:58 -0700 (PDT)\r
+Received: from mail.kapsi.fi (mail.kapsi.fi [217.30.184.167])\r
+       (using TLSv1 with cipher AES256-SHA (256/256 bits))\r
+       (No client certificate requested)\r
+       by olra.theworths.org (Postfix) with ESMTPS id 840AF431FAF\r
+       for <notmuch@notmuchmail.org>; Wed,  3 Sep 2014 21:34:58 -0700 (PDT)\r
+Received: from dsl-jklbrasgw1-54fb12-136.dhcp.inet.fi ([84.251.18.136]\r
+       helo=localhost)\r
+       by mail.kapsi.fi with esmtpsa (TLS1.0:RSA_AES_128_CBC_SHA1:16)\r
+       (Exim 4.72) (envelope-from <perttu.luukko@iki.fi>)\r
+       id 1XPOky-0004mq-0H; Thu, 04 Sep 2014 07:34:48 +0300\r
+Date: Thu, 4 Sep 2014 07:34:35 +0300\r
+From: Perttu Luukko <perttu.luukko@iki.fi>\r
+To: Jani Nikula <jani@nikula.org>\r
+Subject: Re: How to debug 'ignoring non-mail file' issues\r
+Message-ID: <20140904043435.GA3987@rakuuna.dhcp.inet.fi>\r
+References: <20140831074059.GA13399@rakuuna.dhcp.inet.fi>\r
+       <87tx4ssoux.fsf@maritornes.cs.unb.ca>\r
+       <20140901065220.GB3901@lakka.kapsi.fi>\r
+       <20140901071526.GA13634@lakka.kapsi.fi> <87r3ztvjwn.fsf@nikula.org>\r
+       <20140903045439.GA5022@rakuuna.dhcp.inet.fi>\r
+       <87oauwadyb.fsf@nikula.org>\r
+MIME-Version: 1.0\r
+Content-Type: text/plain; charset=us-ascii\r
+Content-Disposition: inline\r
+In-Reply-To: <87oauwadyb.fsf@nikula.org>\r
+User-Agent: Mutt/1.5.22.1 (2013-10-16)\r
+X-SA-Exim-Connect-IP: 84.251.18.136\r
+X-SA-Exim-Mail-From: perttu.luukko@iki.fi\r
+X-SA-Exim-Scanned: No (on mail.kapsi.fi); SAEximRunCond expanded to false\r
+Cc: notmuch@notmuchmail.org\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Thu, 04 Sep 2014 04:35:08 -0000\r
+\r
+On 2014-09-03 19:03:40, Jani Nikula wrote:\r
+> On Wed, 03 Sep 2014, Perttu Luukko <perttu.luukko@iki.fi> wrote:\r
+> > What I mean that there would be a separate error for cases "Does not\r
+> > resemble an email message at all", i.e., some control file your mail\r
+> > server happens to store in the mailbox, and "Looks like mail but we\r
+> > can't parse it", i.e., better find out why it can't be parsed to avoid\r
+> > potentially important messages going missing from the database.\r
+> \r
+> As I said, GMime does not tell us the difference between the two.\r
+\r
+There could be a separate parsing step that reads the first kilobyte or\r
+so and checks whether it is text, and whether there is a line starting\r
+with "From: " and possibly other headers. This could be run if GMime\r
+thinks the file is not mail so there would be negligible overhead.\r
+\r
+This is just a suggestion. Notmuch users are probably quite experienced\r
+so they can always investigate on their own why their emails are being\r
+ignored. But there could be more warning about ignored messages.\r
+Something like, at the end of each 'notmuch new' output: "Note: some\r
+files were ignored as non-mail. Check the list at\r
+~/mail/.notmuch/ignored-files and adjust your ~/.notmuch-config".\r
+\r
+-- \r
+Perttu\r