Re: [PATCH] test suite: don't consider skipped individual tests as failing

diff --git a/fe/bbe00b902a63d594281369004a1bb78ddd9720 b/fe/bbe00b902a63d594281369004a1bb78ddd9720
new file mode 100644 (file)
index 0000000..f1525f0
--- /dev/null
+++ b/fe/bbe00b902a63d594281369004a1bb78ddd9720
@@ -0,0 +1,64 @@
+Return-Path: <david@tethera.net>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+ by arlo.cworth.org (Postfix) with ESMTP id CD5146DE13AB\r
+ for <notmuch@notmuchmail.org>; Fri, 25 Sep 2015 05:26:57 -0700 (PDT)\r
+X-Virus-Scanned: Debian amavisd-new at cworth.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: 0.112\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=0.112 tagged_above=-999 required=5 tests=[AWL=0.112]\r
+ autolearn=disabled\r
+Received: from arlo.cworth.org ([127.0.0.1])\r
+ by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024)\r
+ with ESMTP id Cj5mR0bol3yv for <notmuch@notmuchmail.org>;\r
+ Fri, 25 Sep 2015 05:26:56 -0700 (PDT)\r
+Received: from gitolite.debian.net (gitolite.debian.net [87.98.215.224])\r
+ by arlo.cworth.org (Postfix) with ESMTPS id C7F446DE0B7C\r
+ for <notmuch@notmuchmail.org>; Fri, 25 Sep 2015 05:26:55 -0700 (PDT)\r
+Received: from remotemail by gitolite.debian.net with local (Exim 4.80)\r
+ (envelope-from <david@tethera.net>)\r
+ id 1ZfS4Z-0004ur-HH; Fri, 25 Sep 2015 12:25:55 +0000\r
+Received: (nullmailer pid 19292 invoked by uid 1000); Fri, 25 Sep 2015\r
+ 12:25:36 -0000\r
+From: David Bremner <david@tethera.net>\r
+To: Tomi Ollila <tomi.ollila@iki.fi>, notmuch@notmuchmail.org\r
+Subject: Re: [PATCH] test suite: don't consider skipped individual tests as\r
+ failing\r
+In-Reply-To: <m27fnf4mqn.fsf@guru.guru-group.fi>\r
+References: <1443093210-6511-1-git-send-email-david@tethera.net>\r
+ <m27fnf4mqn.fsf@guru.guru-group.fi>\r
+User-Agent: Notmuch/0.20.2+73~gd432116 (http://notmuchmail.org) Emacs/24.5.1\r
+ (x86_64-pc-linux-gnu)\r
+Date: Fri, 25 Sep 2015 09:25:36 -0300\r
+Message-ID: <87twqi1y9r.fsf@zancas.localnet>\r
+MIME-Version: 1.0\r
+Content-Type: text/plain\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.18\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+ <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+ <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch/>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+ <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Fri, 25 Sep 2015 12:26:57 -0000\r
+\r
+Tomi Ollila <tomi.ollila@iki.fi> writes:\r
+\r
+>\r
+> Looks OK, but I think there should be (some good) comment here informing\r
+> any potential viewer that we're not checking $skipped...\r
+>\r
+\r
+I put some vaguely threatening comment in test/README, and a brief\r
+comment in the file. I've merged the commit, but feel free to send\r
+suggestions / patches for further doc changes. I more or less made up a\r
+hypothetical future policy on the spot...\r
+\r
+d\r