From: Eric J Date: Sat, 27 Feb 2016 20:04:41 +0000 (+0100) Subject: Re: Lost updates to Notmuch database X-Git-Url: http://git.tremily.us/?a=commitdiff_plain;h=1719f2296e03327e8675ec7d82bc71eda21c173c;p=notmuch-archives.git Re: Lost updates to Notmuch database --- diff --git a/df/30af109824cc2b5afe709cedab40ecbd798739 b/df/30af109824cc2b5afe709cedab40ecbd798739 new file mode 100644 index 000000000..34adc9991 --- /dev/null +++ b/df/30af109824cc2b5afe709cedab40ecbd798739 @@ -0,0 +1,119 @@ +Return-Path: +X-Original-To: notmuch@notmuchmail.org +Delivered-To: notmuch@notmuchmail.org +Received: from localhost (localhost [127.0.0.1]) + by arlo.cworth.org (Postfix) with ESMTP id 5C1376DE17D7 + for ; Sat, 27 Feb 2016 12:05:37 -0800 (PST) +X-Virus-Scanned: Debian amavisd-new at cworth.org +X-Spam-Flag: NO +X-Spam-Score: 0.092 +X-Spam-Level: +X-Spam-Status: No, score=0.092 tagged_above=-999 required=5 tests=[AWL=0.002, + DKIM_SIGNED=0.1, RCVD_IN_DNSWL_NONE=-0.0001, + RCVD_IN_MSPIKE_H3=-0.01, + RCVD_IN_MSPIKE_WL=-0.01, T_DKIM_INVALID=0.01] autolearn=disabled +Received: from arlo.cworth.org ([127.0.0.1]) + by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) + with ESMTP id e_d5ppHNME2G for ; + Sat, 27 Feb 2016 12:05:35 -0800 (PST) +Received: from mx1.solardns.com (mx1.solardns.com [109.73.127.119]) + by arlo.cworth.org (Postfix) with ESMTPS id C468C6DE17BE + for ; Sat, 27 Feb 2016 12:05:34 -0800 (PST) +Received: from [213.129.84.218] (helo=luna.solardns.com) + by mx1.solardns.com with esmtps (TLSv1.2:DHE-RSA-AES256-SHA:256) + (Exim 4.85) (envelope-from ) id 1aZl7H-0001Mo-S5 + for notmuch@notmuchmail.org; Sat, 27 Feb 2016 20:05:31 +0000 +DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=deptj.eu; + s=default; h=Date:Message-ID:References:In-Reply-To:To:Subject:From; + bh=JTPSQ9g0S1XDn8XzDAPV3d2kbp1Gck9CS9MRmAy+07k=; b=Il1jGzPxok9OfZ8YGYqaNmRv+P + yEf9lrURhyEkQm5kZAWhMB5bOKrojKKLHAXUJ3iH9J+B5vu5RwPD6hpAhsW2XWaLl0NEZRXeeeNHQ + WSXBIvf3ra5EEQDwukMKP1snZ13jTe+S6oeJ4K6luxD1SGJ35FvqyZ9Fx+j8Qpg0zdsA=; +Received: from [2.12.196.83] (port=50530 helo=bruno.deptj.eu) + by luna.solardns.com with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) + (Exim 4.86) (envelope-from ) id 1aZl7F-001sQR-SM + for notmuch@notmuchmail.org; Sat, 27 Feb 2016 20:05:25 +0000 +Received: from eric by bruno.deptj.eu with local (Exim 4.84) + (envelope-from ) id 1aZl7F-0004ey-6I + for notmuch@notmuchmail.org; Sat, 27 Feb 2016 21:05:25 +0100 +From: Eric J +Subject: Re: Lost updates to Notmuch database +To: notmuch@notmuchmail.org +In-Reply-To: <6d9d87c8bbd4c9499574382a9aa1d868a41f525a-NM@bruno.deptj.eu> +References: <337393ce5e2484d64f837a44b2c4f2ea32f91295-NM@bruno.deptj.eu> + <6d9d87c8bbd4c9499574382a9aa1d868a41f525a-NM@bruno.deptj.eu> +Message-ID: <560022a0fd262b994edd22b981f0a49f74c3b01b-NM@bruno.deptj.eu> +Date: Sat, 27 Feb 2016 21:04:41 +0100 (CET) +X-AuthUser: deptjeu +X-Filter-ID: + s0sct1PQhAABKnZB5plbIZxxbsbMXbbOVqDrOlLQDPCKLoLP9dSDpksiPa3sfcfQiw3bi2TEXpBy + KOgMDJLxZ2gLr13hkJnqYlE8dI2PqoFC/lGsrXcsS0xY0J18f6o7xB66CWvXcfKDfXjTU++u62XJ + sv+ATaoCMXomvA2z71CJthUWezq5NFGJAptZ8/vRZuM7jUXIESohoO51xWmU8U0XxLGz4gGrl7np + YUMMsx7Zx6js8RMGZ+eyCM03IideZE/8G6RrW+hPYRmHOym9VEp4OmAp9SwcFw57ijAOXur1H/aA + warQpYDOYx/6JtUOKIpz/KyJk6xidDbrtJGeIvwS+mRNB2u5eXMTyiRDCl4blv/7/GYDGL6pBAPx + 3RhxuHrpSpJU4PQlqFj9797wgsGhIeDBws4kvu4hgViYIJSOH7FelTFEA57OugCjQqJvq5XDlSi1 + S/CAqp6x6giLUpAadaOpLL7vzAlHz9Vt0lJbH3q7FSJEAvmcpRDg+DcXMCx8qKfWo/2nfeswSb/v + XOidX4Ts4xdG+C13IyWeZaJClvAWyUAUCSYHhmge3quet8geXjZWRvaT/RbJ/nX/IFFm7SbdEzck + 901Ob2Iq9tC/Vh1lis0iI/S1HLwoHXf0 +X-Report-Abuse-To: spam@mx1.solardns.com +X-Filter-Fingerprint: + IFrWXGses7OKB5S5G8/dJdIz5bb8V0ykx8BnFBnunHBA3cTUQ1R++keuE7RDJ8Kg3RbMLUalw1oC + mj99/u+Poh38tEMU4IgC4sNz49qn3HHnhRv/ZJ3kEy8bfiAr+Fb/UpndEJ0YoaLytXXo8BMTaVt0 + ARHRi6XGuAluI1udprGClI6bm+u9ssQgM5AHe3Zacv4uJct5wtJvPpZ2dlBHCwDSxr3Vz+LJ/RhM + 2JZ0ECN5dnq47RWft7iCyM9+PbHelB4qP9S6mTzNwoPraFy6ieiDqMHb2a0eZvGOvr7RaxKWGCKO + us9nABr0Pk/4CplP +X-Originating-IP: 213.129.84.218 +X-SpamExperts-Domain: out.solardns.com +X-SpamExperts-Username: 213.129.84.218 +Authentication-Results: solardns.com; + auth=pass smtp.auth=213.129.84.218@out.solardns.com +X-SpamExperts-Outgoing-Class: unsure +X-SpamExperts-Outgoing-Evidence: Combined (0.37) +X-Recommended-Action: accept +X-BeenThere: notmuch@notmuchmail.org +X-Mailman-Version: 2.1.20 +Precedence: list +List-Id: "Use and development of the notmuch mail system." + +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +X-List-Received-Date: Sat, 27 Feb 2016 20:05:37 -0000 + +On Sun, 21 Feb 2016 13:57:30 +0100 (CET), Eric J wrote: +> On Wed, 17 Feb 2016 21:44:23 +0100 (CET), Eric J wrote: +> > Using the API, I am adding single mail files, already in the maildir, to +> > the Notmuch database and tagging them. It works, every time, as long as +> > I run it one file at a time. +> > +> > However, if I do it twice, in different processes, at the same time, one +> > file is added and tagged properly, the other is not (totally unfindable +> > by notmuch search). Neither process reports any error, and they both log +> > their actions normally. Actually a third simultaneous process also fails +> > to leave any result in the database. +> 8>< -------- +> > +> > The wrapper around the API for Tcl is very simple, and I can not see any +> > way for that or Tcl itself to cause this sort of problem. Beyond this, +> > I haven't thought of any way to decide if this could be a Notmuch problem +> > or a Xapian problem. +> 8>< -------- +> +> Well, after some experimenting, this is not specific to Notmuch at all. +> Xapian itself has Tcl bindings, and they also silently fail to lock the +> file. So does putting a minimally changed copy of Xapian's locking code +> directly in a Tcl extension, though that code works when called from a +> tiny C main program instead. +> +> So thanks for looking, I will report here if I find out why. + +Well, this seems to be a Tcl problem, not present in 8.5, but present in +8.6, up until the very new 8.6.5rc2, where it seems to work. Sadly, I +still have no explanation of the problem. + +Eric +-- +ms fnd in a lbry