[notmuch] A functional (but rudimentary) test suite for notmuch

diff --git a/20/cd3cafb5694985b073f6b26d84ed76e1b6e832 b/20/cd3cafb5694985b073f6b26d84ed76e1b6e832
new file mode 100644 (file)
index 0000000..366c3ac
--- /dev/null
+++ b/20/cd3cafb5694985b073f6b26d84ed76e1b6e832
@@ -0,0 +1,117 @@
+Return-Path: <cworth@cworth.org>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 806AD431FBD\r
+       for <notmuch@notmuchmail.org>; Thu,  4 Feb 2010 12:50:26 -0800 (PST)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: -1.866\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=-1.866 tagged_above=-999 required=5\r
+       tests=[ALL_TRUSTED=-1.8, AWL=-0.067, BAYES_50=0.001] autolearn=ham\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id 0u-JpexJpDRs for <notmuch@notmuchmail.org>;\r
+       Thu,  4 Feb 2010 12:50:25 -0800 (PST)\r
+Received: from yoom.home.cworth.org (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 90137431FAE\r
+       for <notmuch@notmuchmail.org>; Thu,  4 Feb 2010 12:50:25 -0800 (PST)\r
+Received: by yoom.home.cworth.org (Postfix, from userid 1000)\r
+       id 469575500D4; Fri,  5 Feb 2010 09:50:25 +1300 (NZDT)\r
+From: Carl Worth <cworth@cworth.org>\r
+To: notmuch@notmuchmail.org\r
+Date: Thu, 04 Feb 2010 12:50:18 -0800\r
+Message-ID: <87ljf8pvxx.fsf@yoom.home.cworth.org>\r
+MIME-Version: 1.0\r
+Content-Type: multipart/signed; boundary="=-=-=";\r
+       micalg=pgp-sha1; protocol="application/pgp-signature"\r
+Subject: [notmuch] A functional (but rudimentary) test suite for notmuch\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Thu, 04 Feb 2010 20:50:26 -0000\r
+\r
+--=-=-=\r
+\r
+I've just pushed out some improvements to make the little notmuch-test\r
+script I had posted earlier into an actual test suite. I've included the\r
+output of a run of the test suite below so that you can get an idea of\r
+what it does so far.\r
+\r
+What I'd like to see going forward is that new features get submitted\r
+along with new test cases for the test suite. And it would be great if\r
+everyone submitting patches could get into the habit of running:\r
+\r
+       ./test/notmuch-test\r
+\r
+before submitting.\r
+\r
+The test suite is still extremely rudimentary. Here are some things I'd\r
+like to improve about it:\r
+\r
+  * Make the test suite more modular. Right now it's just one long shell\r
+    script---so it's not even easy to see where one test ends and the\r
+    next begins.\r
+\r
+  * Allow for executing a subset of the test suite, (eg. notmuch-test reply)\r
+\r
+    I just wrote a bunch of "notmuch reply" tests and it was annoying to\r
+    have to wait for all of the "notmuch new" tests to run each time.\r
+\r
+  * Actually document what it takes to write a test, (what the test can\r
+    assume about the environment in which its running, what functions\r
+    are available to call, etc.)\r
+\r
+I hope others find this useful.\r
+\r
+-Carl\r
+\r
+Testing "notmuch new" in several variations:\r
+ No new messages...                    PASS\r
+ Single new message...                 PASS\r
+ Multiple new messages...              PASS\r
+ No new messages (non-empty DB)...     PASS\r
+ New directories...                    PASS\r
+ Alternate inode order...              PASS\r
+ Message moved in...                   PASS\r
+ Renamed message...                    PASS\r
+ Deleted message...                    PASS\r
+ Renamed directory...                  PASS\r
+ Deleted directory...                  PASS\r
+ New directory (at end of list)...     PASS\r
+ Deleted directory (end of list)...    PASS\r
+ New symlink to directory...           PASS\r
+ New symlink to a file...              PASS\r
+ New two-level directory...            PASS\r
+ Deleted two-level directory...        PASS\r
+\r
+Testing "notmuch reply" in several variations:\r
+ Basic reply...                                PASS\r
+ Multiple recipients...                        PASS\r
+ Reply with CC...                      PASS\r
+ Reply from alternate address...       PASS\r
+ Support for Reply-To...               PASS\r
+ Un-munging Reply-To...                        PASS\r
+Notmuch test suite complete.\r
+\r
+--=-=-=\r
+Content-Type: application/pgp-signature\r
+\r
+-----BEGIN PGP SIGNATURE-----\r
+Version: GnuPG v1.4.10 (GNU/Linux)\r
+\r
+iD8DBQFLazMK6JDdNq8qSWgRAnrbAJ0ejxcS6VMQe0nYZ5N0V3xBdfEl4gCeOfaD\r
+29pKupbyu860+cW9cSDFhD0=\r
+=NvZi\r
+-----END PGP SIGNATURE-----\r
+--=-=-=--\r