From: Eric J Date: Thu, 18 Feb 2016 21:26:56 +0000 (+0100) Subject: Re: Lost updates to Notmuch database X-Git-Url: http://git.tremily.us/?a=commitdiff_plain;h=893372716f35dc862b956560ce3f12e8994e6d62;p=notmuch-archives.git Re: Lost updates to Notmuch database --- diff --git a/f7/b4bafe523cf6c4ad389c3725d9296361b5a9b1 b/f7/b4bafe523cf6c4ad389c3725d9296361b5a9b1 new file mode 100644 index 000000000..87ae8f1d2 --- /dev/null +++ b/f7/b4bafe523cf6c4ad389c3725d9296361b5a9b1 @@ -0,0 +1,149 @@ +Return-Path: +X-Original-To: notmuch@notmuchmail.org +Delivered-To: notmuch@notmuchmail.org +Received: from localhost (localhost [127.0.0.1]) + by arlo.cworth.org (Postfix) with ESMTP id DF2E46DE01F5 + for ; Thu, 18 Feb 2016 13:27:05 -0800 (PST) +X-Virus-Scanned: Debian amavisd-new at cworth.org +X-Spam-Flag: NO +X-Spam-Score: 0.094 +X-Spam-Level: +X-Spam-Status: No, score=0.094 tagged_above=-999 required=5 tests=[AWL=0.004, + DKIM_SIGNED=0.1, RCVD_IN_DNSWL_NONE=-0.0001, + RCVD_IN_MSPIKE_H3=-0.01, + RCVD_IN_MSPIKE_WL=-0.01, T_DKIM_INVALID=0.01] autolearn=disabled +Received: from arlo.cworth.org ([127.0.0.1]) + by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) + with ESMTP id Hc73BvyckE-Q for ; + Thu, 18 Feb 2016 13:27:03 -0800 (PST) +Received: from mx1.solardns.com (mx1.solardns.com [109.73.127.119]) + by arlo.cworth.org (Postfix) with ESMTPS id 241676DE01C2 + for ; Thu, 18 Feb 2016 13:27:03 -0800 (PST) +Received: from [213.129.84.218] (helo=luna.solardns.com) + by mx1.solardns.com with esmtps (TLSv1.2:DHE-RSA-AES256-SHA:256) + (Exim 4.85) (envelope-from ) id 1aWW6E-00030B-Cy + for notmuch@notmuchmail.org; Thu, 18 Feb 2016 21:27:00 +0000 +DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=deptj.eu; + s=default; h=Date:Message-ID:References:In-Reply-To:To:Subject:From; + bh=sul/5tdrhJNRNwbHR6+iaiL1mK5u9QeEj9fFAzIshWs=; b=Zarr6jiUL5Yk/BkThyEFd1YyLz + XfBlcXR71eMIr3xmpc/5fIIy0F86KXEGJ+6z8kr/tneOR0hOnaehpOtUkF3eHU7tlpQFO5lqThw/p + 2oAau5UX0mCEn6Jja8UaryIie+hUDwBPPuV9aWtZ6E5HZ9E1DSmztlLtpeT5QBRkgdzA=; +Received: from [92.135.160.170] (port=45233 helo=bruno.deptj.eu) + by luna.solardns.com with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) + (Exim 4.86) (envelope-from ) id 1aWW6D-000Nqa-Rq + for notmuch@notmuchmail.org; Thu, 18 Feb 2016 21:26:58 +0000 +Received: from eric by bruno.deptj.eu with local (Exim 4.84) + (envelope-from ) id 1aWW6C-0000rv-9I + for notmuch@notmuchmail.org; Thu, 18 Feb 2016 22:26:56 +0100 +From: Eric J +Subject: Re: Lost updates to Notmuch database +To: notmuch@notmuchmail.org +In-Reply-To: +References: <337393ce5e2484d64f837a44b2c4f2ea32f91295-NM@bruno.deptj.eu> + <871t8avnhq.fsf@zancas.localnet> +Message-ID: +Date: Thu, 18 Feb 2016 22:26:56 +0100 (CET) +X-AuthUser: deptjeu +X-Filter-ID: + s0sct1PQhAABKnZB5plbIZxxbsbMXbbOVqDrOlLQDPCKLoLP9dSDpksiPa3sfcfQiw3bi2TEXpBy + KOgMDJLxZ2gLr13hkJnqYlE8dI2PqoFC/lGsrXcsS0xY0J18f6o7xB66CWvXcfKDfXjTU++u6xhe + WCSLUuyYP2jwPnaAzIpzxWLFN0FQvlq8eSU5QIMLZuM7jUXIESohoO51xWmU8U0XxLGz4gGrl7np + YUMMsx7Zx6js8RMGZ+eyCM03IideZE/8G6RrW+hPYRmHOym9VEp4OmAp9SwcFw57ijAOXur1H/aA + warQpYDOYx/6JtUOKIpz/KyJk6xidDbrtJGeIvwS+mRNB2u5eXMTyiRDCl4blv/7/GYDGL6pBAPx + 3RhxuHrpSpJU4PQlqFj9797wgsGhIeDBws4kvu4hgViYIJSOH7FelTFEA57OugCjQqJvq5XDlSi1 + S/CAqp6x6giLUpAadaOpLL7vzAlHz9Vt0lJbH3q7FSJEAvmcpRDg+DcXMCx8qKfWo/2nfeswSb/v + XOidX4Ts4xdG+C13IyWeZaJClvAWyUAUCSYHhmge3quet8geXjZWRvaT/RbJ/nX/IFFm7SbdEzck + 901Ob2Iq9tC/Vh1lis0iI/S1HLwoHXf0 +X-Report-Abuse-To: spam@mx1.solardns.com +X-Filter-Fingerprint: + IFrWXGses7OKB5S5G8/dJdIz5bb8V0ykx8BnFBnunHBA3cTUQ1R++keuE7RDJ8Kg3RbMLUalw1oC + mj99/u+Poh38tEMU4IgC4sNz49qn3HHnhRv/ZJ3kEy8bfiAr+Fb/UpndEJ0YoaLytXXo8BMTaVt0 + ARHRi6XGuAluI1udprGClI6bm+u9ssQgM5AHe3Zacv4uJct5wtJvPpZ2dlBHCwDSxr3Vz+LJ/RhM + 2JZ0ECN5dnq47RWft7iCyM9+PbHelB4qP9S6mTzNwoPraFy6ieiDqMHb2a0eZvGOvr7RaxKWGCKO + us9nABr0Pk/4CplP +X-Originating-IP: 213.129.84.218 +X-SpamExperts-Domain: out.solardns.com +X-SpamExperts-Username: 213.129.84.218 +Authentication-Results: solardns.com; + auth=pass smtp.auth=213.129.84.218@out.solardns.com +X-SpamExperts-Outgoing-Class: ham +X-SpamExperts-Outgoing-Evidence: Combined (0.21) +X-Recommended-Action: accept +X-BeenThere: notmuch@notmuchmail.org +X-Mailman-Version: 2.1.20 +Precedence: list +List-Id: "Use and development of the notmuch mail system." + +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +X-List-Received-Date: Thu, 18 Feb 2016 21:27:06 -0000 + +On Thu, 18 Feb 2016 16:30:34 +0200, Tomi Ollila wrote: +> On Thu, Feb 18 2016, David Bremner wrote: +> +> > Eric J writes: +> > +> >> However, if I do it twice, in different processes, at the same time, one +> >> file is added and tagged properly, the other is not (totally unfindable +> >> by notmuch search). Neither process reports any error, and they both log +> >> their actions normally. Actually a third simultaneous process also fails +> >> to leave any result in the database. +> > +> > It should be impossible for more than one process to open a Xapian +> > database for writing at the same time. So if the processes are really +> > running in parallel, you should be getting error codes from the later +> > calls to notmuch_database_open{_verbose}. You claim that's not +> > happening, which is puzzling. Maybe you can try to duplicate your +> > problem with a tiny C program. +> +> In addition to that (or even before), you could +> +> 1) be able to reproduce the problem + +As I said in my response to David, I can do just the open, and see that +there is no lock, and do the same open in another session without error. + +> 2) try to reproduce it prefixing the command with ltrace -tt + +Well, as you say below, no Xapian references. Even worse, ltracing the +Tcl version sees no Notmuch references either. + +> 3) examine carefully the ltrace logs to figure out where the proble lies + +So all I can see is that the notmuch_database_open from notmuch new +looks just like I think mine would look - if I could see it. + +(Adding -S to ltrace was not particularly informative either.) + +> Tomi +> +> Hmm, Interestingly when I run +> +> LD_LIBRARY_PATH=~/vc/ext/notmuch/lib ltrace -f -tt ~/vc/ext/notmuch/notmuch-shared new +> +> I did not see any Xapian references, but when I did +> +> ltrace -f -tt ~/vc/ext/notmuch/notmuch new +> +> I did. Interestingly when using libnotmuch.so.4 the xapian interface +> is hidden (is it baked inside ~/vc/ext/notmuch/lib/libnotmuch.so.4.3.0 :O) + +My latest piece of evidence suggests that this may not be a Notmuch +problem, because opening a Xapian database via the Xapian-Tcl bindings +results in: + +COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME +cat 2803 eric 5w REG 8,9 0 526601 /home/eric/omega/data/newsgroups/flintlock + +No lock here either (and this is not even a Notmuch database). + +Investigations will continue. + +Eric +-- +ms fnd in a lbry