Re: notmuch python bindings corrupt db index (was: gmail importer script)
[notmuch-archives.git] / c3 / 7f6f08c4b50ca52bf9f8e001422f0a9a38703a
1 Return-Path: <patricktotzke@gmail.com>\r
2 X-Original-To: notmuch@notmuchmail.org\r
3 Delivered-To: notmuch@notmuchmail.org\r
4 Received: from localhost (localhost [127.0.0.1])\r
5         by olra.theworths.org (Postfix) with ESMTP id ADDF6431FBC\r
6         for <notmuch@notmuchmail.org>; Thu, 13 Dec 2012 08:14:12 -0800 (PST)\r
7 X-Virus-Scanned: Debian amavisd-new at olra.theworths.org\r
8 X-Spam-Flag: NO\r
9 X-Spam-Score: -0.799\r
10 X-Spam-Level: \r
11 X-Spam-Status: No, score=-0.799 tagged_above=-999 required=5\r
12         tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,\r
13         FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled\r
14 Received: from olra.theworths.org ([127.0.0.1])\r
15         by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024)\r
16         with ESMTP id qh+6HCOHU7w1 for <notmuch@notmuchmail.org>;\r
17         Thu, 13 Dec 2012 08:14:12 -0800 (PST)\r
18 Received: from mail-we0-f181.google.com (mail-we0-f181.google.com\r
19         [74.125.82.181]) (using TLSv1 with cipher RC4-SHA (128/128 bits))\r
20         (No client certificate requested)\r
21         by olra.theworths.org (Postfix) with ESMTPS id 2D8C2431FB6\r
22         for <notmuch@notmuchmail.org>; Thu, 13 Dec 2012 08:14:12 -0800 (PST)\r
23 Received: by mail-we0-f181.google.com with SMTP id t11so942508wey.26\r
24         for <notmuch@notmuchmail.org>; Thu, 13 Dec 2012 08:14:11 -0800 (PST)\r
25 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;\r
26         h=content-type:mime-version:content-transfer-encoding:to:from\r
27         :in-reply-to:cc:references:message-id:user-agent:subject:date;\r
28         bh=GGAFXonHljeBzLhXYRl3l3JnHk7VhSrfmERJy0Mlov0=;\r
29         b=uetKYJUtDiwi6m/0TdgNy4NlDGfs9xDIeY9o38tUUvcXfdNVm1C+Op4Pke7vEazKSs\r
30         Nm0bl1pvhtqo61Y67Qi2dJsiH+jIPE3xC/HkFrrzaxqZJ9m8d8XAsm0edx2fAcH4Itx8\r
31         gI0Qrno8wm4VlSiWDT5gCNY02uX3Qs4veVjaF19sKwP6A8TqYEGl+La8yH13Fey7r4XH\r
32         UkHaVJag/o87kzJ0YQD/tcTxUbFe5WKuASGjzIVqT80SdBKjucFnn+Ve35C+JfuWIDyB\r
33         iu75O+AnKF6A6Ssh92m/9uClRzJWpINfL1fyi+XhwwaG1zIh7vV/uPI6YXqaI5j66r3K\r
34         e5mQ==\r
35 Received: by 10.180.80.201 with SMTP id t9mr4359018wix.0.1355415249708;\r
36         Thu, 13 Dec 2012 08:14:09 -0800 (PST)\r
37 Received: from localhost (dhcp-91-036.inf.ed.ac.uk. [129.215.91.36])\r
38         by mx.google.com with ESMTPS id o3sm8401416wic.0.2012.12.13.08.14.06\r
39         (version=TLSv1/SSLv3 cipher=OTHER);\r
40         Thu, 13 Dec 2012 08:14:07 -0800 (PST)\r
41 Content-Type: text/plain; charset="utf-8"\r
42 MIME-Version: 1.0\r
43 Content-Transfer-Encoding: quoted-printable\r
44 To: "Jason A. Donenfeld" <Jason@zx2c4.com>, Austin Clements <amdragon@mit.edu>\r
45 From: Patrick Totzke <patricktotzke@gmail.com>\r
46 In-Reply-To:\r
47  <CAHmME9q-NbhRC=Be20aW5Vz+swou419zJxZD4O-3PSTJr+K=iQ@mail.gmail.com>\r
48 References:\r
49  <CAHmME9phAD0JKHDf+1KuCPyo4WXpDW5NESAE_iT3Ruv3bEVCuw@mail.gmail.com>\r
50         <20121211182638.27237.98903@brick.lan>\r
51         <CAHmME9qafP5He4hYPEAyrtS4hq3CRNKBQfvxvP=r4L6uDeqt1w@mail.gmail.com>\r
52         <20121212204922.GB6187@mit.edu>\r
53         <CAHmME9q-NbhRC=Be20aW5Vz+swou419zJxZD4O-3PSTJr+K=iQ@mail.gmail.com>\r
54 Message-ID: <20121213161600.28349.42261@megatron>\r
55 User-Agent: alot/0.3.3+\r
56 Subject: Re: notmuch python bindings corrupt db index (was: gmail importer\r
57         script)\r
58 Date: Thu, 13 Dec 2012 16:16:00 +0000\r
59 Cc: notmuch@notmuchmail.org\r
60 X-BeenThere: notmuch@notmuchmail.org\r
61 X-Mailman-Version: 2.1.13\r
62 Precedence: list\r
63 List-Id: "Use and development of the notmuch mail system."\r
64         <notmuch.notmuchmail.org>\r
65 List-Unsubscribe: <http://notmuchmail.org/mailman/options/notmuch>,\r
66         <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
67 List-Archive: <http://notmuchmail.org/pipermail/notmuch>\r
68 List-Post: <mailto:notmuch@notmuchmail.org>\r
69 List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
70 List-Subscribe: <http://notmuchmail.org/mailman/listinfo/notmuch>,\r
71         <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
72 X-List-Received-Date: Thu, 13 Dec 2012 16:14:12 -0000\r
73 \r
74 Quoting Jason A. Donenfeld (2012-12-13 14:32:53)\r
75 > On Wed, Dec 12, 2012 at 9:49 PM, Austin Clements <amdragon@mit.edu> wrote:\r
76 > > There should be no way to corrupt the database at this level through\r
77 > > the Xapian API, which means nothing libnotmuch can do (much less users\r
78 > > of libnotmuch) should be able to corrupt the database.  If you can\r
79 > > reproduce the problem, it's probably a serious bug in Xapian, but it\r
80 > > could also have been a file system bug or even random file system\r
81 > > corruption.\r
82 > =\r
83 \r
84 > Well that's... troubling.\r
85 > =\r
86 \r
87 > Patrick: could you please backup and try to reproduce? Otherwise I'll\r
88 > assume this was a one-off situation.\r
89 \r
90 \r
91 I tried it again, concurrently triggered some modifications\r
92 and killed the process afer a while.\r
93 (my modifications were not flushed during the run of your script as\r
94 the index was locked)\r
95 The index seems to be OK. So I'm afraid I cannot reproduce this reliably.\r
96 /p\r
97 \r
98 \r