Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id CEB1C431FC2 for ; Thu, 13 Dec 2012 06:32:56 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -0.1 X-Spam-Level: X-Spam-Status: No, score=-0.1 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Smfyb7HbaJgX for ; Thu, 13 Dec 2012 06:32:56 -0800 (PST) Received: from homiemail-a60.g.dreamhost.com (caiajhbdcbbj.dreamhost.com [208.97.132.119]) by olra.theworths.org (Postfix) with ESMTP id 73655431FB6 for ; Thu, 13 Dec 2012 06:32:56 -0800 (PST) Received: from homiemail-a60.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a60.g.dreamhost.com (Postfix) with ESMTP id 73CD83BC071 for ; Thu, 13 Dec 2012 06:32:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=zx2c4.com; h=mime-version :in-reply-to:references:date:message-id:subject:from:to:cc: content-type; s=zx2c4.com; bh=SPE18E8y2erEuPPJAE3CR6q9dfc=; b=pc GsRIxKnLu3aeBk8PCBAP43DEr+b0UcMwLJBvkkFqAIhmvba0I+LIG7VgnnVNdddc jAf8p+b1pEWh3C59a/aq21ce7+bdklrXY2/akMQTRc5Cdk0KAhJAG0vGUmPuu3gI 0NGqRuVdbcC6hcR/otCmeIcNsiZCb//dtn3GbVyhc= Received: from mail-oa0-f53.google.com (mail-oa0-f53.google.com [209.85.219.53]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: jason@zx2c4.com) by homiemail-a60.g.dreamhost.com (Postfix) with ESMTPSA id 491093BC070 for ; Thu, 13 Dec 2012 06:32:54 -0800 (PST) Received: by mail-oa0-f53.google.com with SMTP id j6so2166966oag.26 for ; Thu, 13 Dec 2012 06:32:53 -0800 (PST) MIME-Version: 1.0 Received: by 10.60.169.205 with SMTP id ag13mr1656822oec.40.1355409173729; Thu, 13 Dec 2012 06:32:53 -0800 (PST) Received: by 10.76.33.70 with HTTP; Thu, 13 Dec 2012 06:32:53 -0800 (PST) In-Reply-To: <20121212204922.GB6187@mit.edu> References: <20121211182638.27237.98903@brick.lan> <20121212204922.GB6187@mit.edu> Date: Thu, 13 Dec 2012 15:32:53 +0100 Message-ID: Subject: Re: notmuch python bindings corrupt db index (was: gmail importer script) From: "Jason A. Donenfeld" To: Austin Clements Content-Type: text/plain; charset=ISO-8859-1 Cc: notmuch@notmuchmail.org X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Dec 2012 14:32:57 -0000 On Wed, Dec 12, 2012 at 9:49 PM, Austin Clements wrote: > There should be no way to corrupt the database at this level through > the Xapian API, which means nothing libnotmuch can do (much less users > of libnotmuch) should be able to corrupt the database. If you can > reproduce the problem, it's probably a serious bug in Xapian, but it > could also have been a file system bug or even random file system > corruption. Well that's... troubling. Patrick: could you please backup and try to reproduce? Otherwise I'll assume this was a one-off situation. Austin-- think you could do a quick review of the script to double check and confirm I'm not doing anything nefarious? http://git.zx2c4.com/gmail-notmuch/tree/gmail-notmuch.py