Re: Lost updates to Notmuch database
authorEric J <eric@deptj.eu>
Thu, 18 Feb 2016 21:26:56 +0000 (22:26 +0100)
committerW. Trevor King <wking@tremily.us>
Sat, 20 Aug 2016 23:21:09 +0000 (16:21 -0700)
f7/b4bafe523cf6c4ad389c3725d9296361b5a9b1 [new file with mode: 0644]

diff --git a/f7/b4bafe523cf6c4ad389c3725d9296361b5a9b1 b/f7/b4bafe523cf6c4ad389c3725d9296361b5a9b1
new file mode 100644 (file)
index 0000000..87ae8f1
--- /dev/null
@@ -0,0 +1,149 @@
+Return-Path: <eric@deptj.eu>\r
+X-Original-To: notmuch@notmuchmail.org\r
+Delivered-To: notmuch@notmuchmail.org\r
+Received: from localhost (localhost [127.0.0.1])\r
+ by arlo.cworth.org (Postfix) with ESMTP id DF2E46DE01F5\r
+ for <notmuch@notmuchmail.org>; Thu, 18 Feb 2016 13:27:05 -0800 (PST)\r
+X-Virus-Scanned: Debian amavisd-new at cworth.org\r
+X-Spam-Flag: NO\r
+X-Spam-Score: 0.094\r
+X-Spam-Level: \r
+X-Spam-Status: No, score=0.094 tagged_above=-999 required=5 tests=[AWL=0.004, \r
+ DKIM_SIGNED=0.1, RCVD_IN_DNSWL_NONE=-0.0001,\r
+ RCVD_IN_MSPIKE_H3=-0.01, \r
+ RCVD_IN_MSPIKE_WL=-0.01, T_DKIM_INVALID=0.01] autolearn=disabled\r
+Received: from arlo.cworth.org ([127.0.0.1])\r
+ by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024)\r
+ with ESMTP id Hc73BvyckE-Q for <notmuch@notmuchmail.org>;\r
+ Thu, 18 Feb 2016 13:27:03 -0800 (PST)\r
+Received: from mx1.solardns.com (mx1.solardns.com [109.73.127.119])\r
+ by arlo.cworth.org (Postfix) with ESMTPS id 241676DE01C2\r
+ for <notmuch@notmuchmail.org>; Thu, 18 Feb 2016 13:27:03 -0800 (PST)\r
+Received: from [213.129.84.218] (helo=luna.solardns.com)\r
+ by mx1.solardns.com with esmtps (TLSv1.2:DHE-RSA-AES256-SHA:256)\r
+ (Exim 4.85) (envelope-from <eric@deptj.eu>) id 1aWW6E-00030B-Cy\r
+ for notmuch@notmuchmail.org; Thu, 18 Feb 2016 21:27:00 +0000\r
+DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=deptj.eu;\r
+ s=default; h=Date:Message-ID:References:In-Reply-To:To:Subject:From;\r
+ bh=sul/5tdrhJNRNwbHR6+iaiL1mK5u9QeEj9fFAzIshWs=; b=Zarr6jiUL5Yk/BkThyEFd1YyLz\r
+ XfBlcXR71eMIr3xmpc/5fIIy0F86KXEGJ+6z8kr/tneOR0hOnaehpOtUkF3eHU7tlpQFO5lqThw/p\r
+ 2oAau5UX0mCEn6Jja8UaryIie+hUDwBPPuV9aWtZ6E5HZ9E1DSmztlLtpeT5QBRkgdzA=;\r
+Received: from [92.135.160.170] (port=45233 helo=bruno.deptj.eu)\r
+ by luna.solardns.com with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256)\r
+ (Exim 4.86) (envelope-from <eric@deptj.eu>) id 1aWW6D-000Nqa-Rq\r
+ for notmuch@notmuchmail.org; Thu, 18 Feb 2016 21:26:58 +0000\r
+Received: from eric by bruno.deptj.eu with local (Exim 4.84)\r
+ (envelope-from <eric@deptj.eu>) id 1aWW6C-0000rv-9I\r
+ for notmuch@notmuchmail.org; Thu, 18 Feb 2016 22:26:56 +0100\r
+From: Eric J <eric@deptj.eu>\r
+Subject: Re: Lost updates to Notmuch database\r
+To: notmuch@notmuchmail.org\r
+In-Reply-To: <m27fi2nl9x.fsf@guru.guru-group.fi>\r
+References: <337393ce5e2484d64f837a44b2c4f2ea32f91295-NM@bruno.deptj.eu>\r
+ <871t8avnhq.fsf@zancas.localnet> <m27fi2nl9x.fsf@guru.guru-group.fi>\r
+Message-ID: <d64b4eafab192f6a44fb615730ff3350bae8876b-NM@bruno.deptj.eu>\r
+Date: Thu, 18 Feb 2016 22:26:56 +0100 (CET)\r
+X-AuthUser: deptjeu\r
+X-Filter-ID:\r
+ s0sct1PQhAABKnZB5plbIZxxbsbMXbbOVqDrOlLQDPCKLoLP9dSDpksiPa3sfcfQiw3bi2TEXpBy\r
+ KOgMDJLxZ2gLr13hkJnqYlE8dI2PqoFC/lGsrXcsS0xY0J18f6o7xB66CWvXcfKDfXjTU++u6xhe\r
+ WCSLUuyYP2jwPnaAzIpzxWLFN0FQvlq8eSU5QIMLZuM7jUXIESohoO51xWmU8U0XxLGz4gGrl7np\r
+ YUMMsx7Zx6js8RMGZ+eyCM03IideZE/8G6RrW+hPYRmHOym9VEp4OmAp9SwcFw57ijAOXur1H/aA\r
+ warQpYDOYx/6JtUOKIpz/KyJk6xidDbrtJGeIvwS+mRNB2u5eXMTyiRDCl4blv/7/GYDGL6pBAPx\r
+ 3RhxuHrpSpJU4PQlqFj9797wgsGhIeDBws4kvu4hgViYIJSOH7FelTFEA57OugCjQqJvq5XDlSi1\r
+ S/CAqp6x6giLUpAadaOpLL7vzAlHz9Vt0lJbH3q7FSJEAvmcpRDg+DcXMCx8qKfWo/2nfeswSb/v\r
+ XOidX4Ts4xdG+C13IyWeZaJClvAWyUAUCSYHhmge3quet8geXjZWRvaT/RbJ/nX/IFFm7SbdEzck\r
+ 901Ob2Iq9tC/Vh1lis0iI/S1HLwoHXf0\r
+X-Report-Abuse-To: spam@mx1.solardns.com\r
+X-Filter-Fingerprint:\r
+ IFrWXGses7OKB5S5G8/dJdIz5bb8V0ykx8BnFBnunHBA3cTUQ1R++keuE7RDJ8Kg3RbMLUalw1oC\r
+ mj99/u+Poh38tEMU4IgC4sNz49qn3HHnhRv/ZJ3kEy8bfiAr+Fb/UpndEJ0YoaLytXXo8BMTaVt0\r
+ ARHRi6XGuAluI1udprGClI6bm+u9ssQgM5AHe3Zacv4uJct5wtJvPpZ2dlBHCwDSxr3Vz+LJ/RhM\r
+ 2JZ0ECN5dnq47RWft7iCyM9+PbHelB4qP9S6mTzNwoPraFy6ieiDqMHb2a0eZvGOvr7RaxKWGCKO\r
+ us9nABr0Pk/4CplP\r
+X-Originating-IP: 213.129.84.218\r
+X-SpamExperts-Domain: out.solardns.com\r
+X-SpamExperts-Username: 213.129.84.218\r
+Authentication-Results: solardns.com;\r
+ auth=pass smtp.auth=213.129.84.218@out.solardns.com\r
+X-SpamExperts-Outgoing-Class: ham\r
+X-SpamExperts-Outgoing-Evidence: Combined (0.21)\r
+X-Recommended-Action: accept\r
+X-BeenThere: notmuch@notmuchmail.org\r
+X-Mailman-Version: 2.1.20\r
+Precedence: list\r
+List-Id: "Use and development of the notmuch mail system."\r
+ <notmuch.notmuchmail.org>\r
+List-Unsubscribe: <https://notmuchmail.org/mailman/options/notmuch>,\r
+ <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>\r
+List-Archive: <http://notmuchmail.org/pipermail/notmuch/>\r
+List-Post: <mailto:notmuch@notmuchmail.org>\r
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>\r
+List-Subscribe: <https://notmuchmail.org/mailman/listinfo/notmuch>,\r
+ <mailto:notmuch-request@notmuchmail.org?subject=subscribe>\r
+X-List-Received-Date: Thu, 18 Feb 2016 21:27:06 -0000\r
+\r
+On Thu, 18 Feb 2016 16:30:34 +0200, Tomi Ollila <tomi.ollila@iki.fi> wrote:\r
+> On Thu, Feb 18 2016, David Bremner <david@tethera.net> wrote:\r
+> \r
+> > Eric J <eric@deptj.eu> writes:\r
+> >\r
+> >> However, if I do it twice, in different processes, at the same time, one\r
+> >> file is added and tagged properly, the other is not (totally unfindable\r
+> >> by notmuch search). Neither process reports any error, and they both log\r
+> >> their actions normally. Actually a third simultaneous process also fails\r
+> >> to leave any result in the database.\r
+> >\r
+> > It should be impossible for more than one process to open a Xapian\r
+> > database for writing at the same time. So if the processes are really\r
+> > running in parallel, you should be getting error codes from the later\r
+> > calls to notmuch_database_open{_verbose}. You claim that's not\r
+> > happening, which is puzzling. Maybe you can try to duplicate your\r
+> > problem with a tiny C program.\r
+> \r
+> In addition to that (or even before), you could\r
+> \r
+> 1) be able to reproduce the problem\r
+\r
+As I said in my response to David, I can do just the open, and see that\r
+there is no lock, and do the same open in another session without error.\r
+\r
+> 2) try to reproduce it prefixing the command with ltrace -tt\r
+\r
+Well, as you say below, no Xapian references. Even worse, ltracing the\r
+Tcl version sees no Notmuch references either.\r
+\r
+> 3) examine carefully the ltrace logs to figure out where the proble lies\r
+\r
+So all I can see is that the notmuch_database_open from notmuch new\r
+looks just like I think mine would look - if I could see it.\r
+\r
+(Adding -S to ltrace was not particularly informative either.)\r
+\r
+> Tomi\r
+> \r
+> Hmm, Interestingly when I run\r
+> \r
+> LD_LIBRARY_PATH=~/vc/ext/notmuch/lib ltrace -f -tt ~/vc/ext/notmuch/notmuch-shared new\r
+> \r
+> I did not see any Xapian references, but when I did\r
+> \r
+> ltrace -f -tt ~/vc/ext/notmuch/notmuch new\r
+> \r
+> I did. Interestingly when using libnotmuch.so.4 the xapian interface\r
+> is hidden (is it baked inside ~/vc/ext/notmuch/lib/libnotmuch.so.4.3.0 :O)\r
+\r
+My latest piece of evidence suggests that this may not be a Notmuch\r
+problem, because opening a Xapian database via the Xapian-Tcl bindings\r
+results in:\r
+\r
+COMMAND  PID USER   FD   TYPE DEVICE SIZE/OFF   NODE NAME\r
+cat     2803 eric    5w   REG    8,9        0 526601 /home/eric/omega/data/newsgroups/flintlock\r
+\r
+No lock here either (and this is not even a Notmuch database). \r
+\r
+Investigations will continue.\r
+\r
+Eric\r
+-- \r
+ms fnd in a lbry\r