notmuch python bindings corrupt db index (was: gmail importer script)

diff --git a/4f/1185ef5123c84a89dc2f4b1427acd89019406f b/4f/1185ef5123c84a89dc2f4b1427acd89019406f
new file mode 100644 (file)
index 0000000..f17b40f
--- /dev/null
+++ b/4f/1185ef5123c84a89dc2f4b1427acd89019406f
@@ -0,0 +1,84 @@
+Return-Path: <Jason@zx2c4.com>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+       by olra.theworths.org (Postfix) with ESMTP id A83CB431FAF\r
+       for <notmuch@notmuchmail.org>; Tue, 11 Dec 2012 05:47:36 -0800 (PST)\r
+X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: -0.1\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=-0.1 tagged_above=-999 required=5\r
+       tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,\r
+       RCVD_IN_DNSWL_NONE=-0.0001] autolearn=disabled\r
+Received: from olra.theworths.org ([127.0.0.1])\r
+       by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
+       with ESMTP id P8MFP3DA-J8X for <notmuch@notmuchmail.org>;\r
+       Tue, 11 Dec 2012 05:47:36 -0800 (PST)\r
+Received: from homiemail-a3.g.dreamhost.com (caiajhbdcbbj.dreamhost.com\r
+       [208.97.132.119])\r
+       by olra.theworths.org (Postfix) with ESMTP id 3BCF8431FAE\r
+       for <notmuch@notmuchmail.org>; Tue, 11 Dec 2012 05:47:36 -0800 (PST)\r
+Received: from homiemail-a3.g.dreamhost.com (localhost [127.0.0.1])\r
+       by homiemail-a3.g.dreamhost.com (Postfix) with ESMTP id 5B6F9284081\r
+       for <notmuch@notmuchmail.org>; Tue, 11 Dec 2012 05:47:34 -0800 (PST)\r
+DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=zx2c4.com; h=mime-version\r
+       :date:message-id:subject:from:to:cc:content-type; s=zx2c4.com;\r
+       bh=Bz6umJ0e+4OSH3CoxHUjHeD/DFQ=; b=B6CoOxB2lfjsNXaaTImelAsK32jw\r
+       c1pjg1gA3MI6wbjQSrhQpJf4Px7QKG8US9v5pH+vOWM2P0drk+InPzIuUnQ82TYT\r
+       jHzYgWBjMuBqC+uolievtxQBIU8Ou99qW+98Tnq7qnsIza3qtmxeDgt5fvyYe0UQ\r
+       iFTa2dehlX4xwZg=\r
+Received: from mail-oa0-f53.google.com (mail-oa0-f53.google.com\r
+       [209.85.219.53]) (using TLSv1 with cipher RC4-SHA (128/128 bits))\r
+       (No client certificate requested)\r
+       (Authenticated sender: jason@zx2c4.com)\r
+       by homiemail-a3.g.dreamhost.com (Postfix) with ESMTPSA id 36CDA284076\r
+       for <notmuch@notmuchmail.org>; Tue, 11 Dec 2012 05:47:34 -0800 (PST)\r
+Received: by mail-oa0-f53.google.com with SMTP id j6so3463965oag.26\r
+       for <notmuch@notmuchmail.org>; Tue, 11 Dec 2012 05:47:33 -0800 (PST)\r
+MIME-Version: 1.0\r
+Received: by 10.60.30.70 with SMTP id q6mr9089028oeh.103.1355233652683; Tue,\r
+       11 Dec 2012 05:47:32 -0800 (PST)\r
+Received: by 10.76.33.70 with HTTP; Tue, 11 Dec 2012 05:47:32 -0800 (PST)\r
+Date: Tue, 11 Dec 2012 14:47:32 +0100\r
+Message-ID:\r
+ <CAHmME9phAD0JKHDf+1KuCPyo4WXpDW5NESAE_iT3Ruv3bEVCuw@mail.gmail.com>\r
+Subject: notmuch python bindings corrupt db index (was: gmail importer script)\r
+From: "Jason A. Donenfeld" <Jason@zx2c4.com>\r
+To: Patrick Totzke <patricktotzke@gmail.com>\r
+Content-Type: text/plain; charset=ISO-8859-1\r
+Cc: notmuch@notmuchmail.org\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.13\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+       <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
+       <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Tue, 11 Dec 2012 13:47:36 -0000\r
+\r
+On Tue, Dec 11, 2012 at 11:04 AM, Patrick Totzke\r
+<patricktotzke@gmail.com> wrote:\r
+> I ended up killing the process after i saw that ETA was >3h.\r
+\r
+Gmail's bottleneck. Very unfortunate. Leave it going over night.\r
+\r
+> This broke my index!\r
+>\r
+> afterwards, a `notmuch new` printed\r
+>\r
+> A Xapian exception occurred creating a directory: Expected block\r
+> 485 to be level 1, not 0.\r
+>\r
+> I wasnt able to properly read the index anymore and had to\r
+> restore an old index dump. not cool!\r
+\r
+\r
+Can you provide any more information about this? The script properly\r
+uses atomic transactions. Any corruption here is the result of a\r
+notmuch library bug, which should be investigated.\r