[PATCH v2 7/7] HACK: fix broken messages in the perf test corpus

diff --git a/5d/767e99e8bcb58b1c7f76b7695a6b16d16d79f3 b/5d/767e99e8bcb58b1c7f76b7695a6b16d16d79f3
new file mode 100644 (file)
index 0000000..eae2fe8
--- /dev/null
+++ b/5d/767e99e8bcb58b1c7f76b7695a6b16d16d79f3
@@ -0,0 +1,106 @@
+Return-Path: <jani@nikula.org>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id 7532F429E2F\r
+       for <notmuch@notmuchmail.org>; Sat, 30 Nov 2013 07:35:01 -0800 (PST)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Amavis-Alert: BAD HEADER SECTION, Duplicate header field: "References"\r
+X-Spam-Flag: NO\r
+X-Spam-Score: -0.7\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=-0.7 tagged_above=-999 required=5\r
+       tests=[RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id bdY8qTgqjAZf for <notmuch@notmuchmail.org>;\r
+       Sat, 30 Nov 2013 07:34:55 -0800 (PST)\r
+Received: from mail-ea0-f171.google.com (mail-ea0-f171.google.com\r
+       [209.85.215.171]) (using TLSv1 with cipher RC4-SHA (128/128 bits))\r
+       (No client certificate requested)\r
+       by olra.theworths.org (Postfix) with ESMTPS id 167AE429E28\r
+       for <notmuch@notmuchmail.org>; Sat, 30 Nov 2013 07:34:18 -0800 (PST)\r
+Received: by mail-ea0-f171.google.com with SMTP id h10so7565546eak.2\r
+       for <notmuch@notmuchmail.org>; Sat, 30 Nov 2013 07:34:18 -0800 (PST)\r
+X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;\r
+       d=1e100.net; s=20130820;\r
+       h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to\r
+       :references:in-reply-to:references;\r
+       bh=pz0idViY6MGdFvO+vit0oEPL12UDi7GGIzhuYBwo5AY=;\r
+       b=iGsvQ7GA7kPYte3fQNP2IxlDM3dTdGcjVrAoZDPP5ri2bEl+O8Uh9VKLW8Wi8MbN/W\r
+       kyWjsTASkreiHiHLLHZ8f3ZQ0HVbh6Fxp23q3Ykb+wAzcedM6JDBzxYfI43BM0Gccbv5\r
+       QJPEOmSwp7kFzhbYuncTq31ajqtQVFnKtjeBlMwpInUL33IlXK8Nv2lW41TJ1AI7GFcx\r
+       e/sdwr7rM+M88oFj7T5G6Mxb8UJ823V5ugxgG+Cty9U6jHcEDlQ+Xt+VIcVM9wEMS0Rv\r
+       gF8lMKVFSRNqmaKJFJX4eRcH0wsfmLsEdndMyxEcFeT0ukr4v2EM9/ogikCqv1Robjs0\r
+       FdXQ==\r
+X-Gm-Message-State:\r
+ ALoCoQno5GFK2VnzXqexYHRJJzT1VlYe8V1NDsduwb+8Wjd52KPDtv9I06uqSkojdUhQn7fcs+ab\r
+X-Received: by 10.15.54.72 with SMTP id s48mr30800334eew.3.1385825656756;\r
+       Sat, 30 Nov 2013 07:34:16 -0800 (PST)\r
+Received: from localhost (dsl-hkibrasgw2-58c36f-91.dhcp.inet.fi.\r
+       [88.195.111.91])\r
+       by mx.google.com with ESMTPSA id 44sm51853110eek.5.2013.11.30.07.34.15\r
+       for <multiple recipients>\r
+       (version=TLSv1.2 cipher=RC4-SHA bits=128/128);\r
+       Sat, 30 Nov 2013 07:34:16 -0800 (PST)\r
+From: Jani Nikula <jani@nikula.org>\r
+To: notmuch@notmuchmail.org\r
+Subject: [PATCH v2 7/7] HACK: fix broken messages in the perf test corpus\r
+Date: Sat, 30 Nov 2013 17:33:56 +0200\r
+Message-Id:\r
+ <d74499f1e462755676edf9aa6ab689ba47fa2471.1385825425.git.jani@nikula.org>\r
+X-Mailer: git-send-email 1.8.4.2\r
+In-Reply-To: <cover.1385825425.git.jani@nikula.org>\r
+References: <cover.1385825425.git.jani@nikula.org>\r
+In-Reply-To: <cover.1385825425.git.jani@nikula.org>\r
+References: <cover.1385825425.git.jani@nikula.org>\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Sat, 30 Nov 2013 15:35:02 -0000\r
+\r
+The gmime header parser rejects a lot of messages in the perf test\r
+corpus which have this in the middle of headers:\r
+\r
+Microsoft Mail Internet Headers Version 2.0\r
+\r
+The header parsing stops right there. This illustrates a change in the\r
+parsing. The message is clearly broken, but previously notmuch\r
+accepted it anyway.\r
+\r
+This patch "fixes" the messages in the perf test corpus to be able to\r
+do fair comparisons of the parsers.\r
+\r
+NOT TO BE MERGED, if that isn't obvious. This is just a quick hack.\r
+---\r
+ performance-test/perf-test-lib.sh | 4 ++++\r
+ 1 file changed, 4 insertions(+)\r
+\r
+diff --git a/performance-test/perf-test-lib.sh b/performance-test/perf-test-lib.sh\r
+index 9ee7661..caec0d0 100644\r
+--- a/performance-test/perf-test-lib.sh\r
++++ b/performance-test/perf-test-lib.sh\r
+@@ -84,7 +84,11 @@ add_email_corpus ()\r
+           "${args[@]}"\r
+ \r
+       printf "\n"\r
++      printf "Fix broken messages in corpus..."\r
+ \r
++      find "${TEST_DIRECTORY}/corpus" -type f -print0 | xargs -0 sed -i -e 's/^Microsoft Mail Internet Headers Version 2\.0/X-Crap: &/'\r
++\r
++      printf "\n"\r
+     fi\r
+ \r
+     cp -lr $TAG_CORPUS $TMP_DIRECTORY/corpus.tags\r
+-- \r
+1.8.4.2\r
+\r