From: Daniel Kahn Gillmor <dkg@fifthhorseman.net>
Date: Fri, 15 Jan 2016 19:26:01 +0000 (+1900)
Subject: Re: Bug report: undeletable traces of ghosts in the notmuch database
X-Git-Url: http://git.tremily.us/?a=commitdiff_plain;h=e0575b46eb81b1ba354c7f472e6d6262f37fed07;p=notmuch-archives.git

Re: Bug report: undeletable traces of ghosts in the notmuch database
---

diff --git a/8a/95f4226663c1ba37d0fb678b30f85785aab129 b/8a/95f4226663c1ba37d0fb678b30f85785aab129
new file mode 100644
index 000000000..8f7479f83
--- /dev/null
+++ b/8a/95f4226663c1ba37d0fb678b30f85785aab129
@@ -0,0 +1,114 @@
+Return-Path: <dkg@fifthhorseman.net>
+X-Original-To: notmuch@notmuchmail.org
+Delivered-To: notmuch@notmuchmail.org
+Received: from localhost (localhost [127.0.0.1])
+ by arlo.cworth.org (Postfix) with ESMTP id 5A5336DE178F
+ for <notmuch@notmuchmail.org>; Fri, 15 Jan 2016 11:26:05 -0800 (PST)
+X-Virus-Scanned: Debian amavisd-new at cworth.org
+X-Spam-Flag: NO
+X-Spam-Score: -0.024
+X-Spam-Level: 
+X-Spam-Status: No, score=-0.024 tagged_above=-999 required=5
+ tests=[AWL=-0.024] autolearn=disabled
+Received: from arlo.cworth.org ([127.0.0.1])
+ by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024)
+ with ESMTP id dD6FxVVquXKn for <notmuch@notmuchmail.org>;
+ Fri, 15 Jan 2016 11:26:03 -0800 (PST)
+Received: from che.mayfirst.org (che.mayfirst.org [209.234.253.108])
+ by arlo.cworth.org (Postfix) with ESMTP id A48BF6DE0A87
+ for <notmuch@notmuchmail.org>; Fri, 15 Jan 2016 11:26:03 -0800 (PST)
+Received: from fifthhorseman.net (unknown [38.109.115.130])
+ by che.mayfirst.org (Postfix) with ESMTPSA id 47067F984
+ for <notmuch@notmuchmail.org>; Fri, 15 Jan 2016 14:26:01 -0500 (EST)
+Received: by fifthhorseman.net (Postfix, from userid 1000)
+ id 1250320000; Fri, 15 Jan 2016 11:26:01 -0800 (PST)
+From: Daniel Kahn Gillmor <dkg@fifthhorseman.net>
+To: notmuch@notmuchmail.org
+Subject: Re: Bug report: undeletable traces of ghosts in the notmuch database
+In-Reply-To: <87twmf7t8k.fsf@alice.fifthhorseman.net>
+References: <87twmf7t8k.fsf@alice.fifthhorseman.net>
+User-Agent: Notmuch/0.21+66~g8c19a9a (http://notmuchmail.org) Emacs/24.5.1
+ (x86_64-pc-linux-gnu)
+Date: Fri, 15 Jan 2016 14:26:01 -0500
+Message-ID: <87y4bq63w6.fsf@alice.fifthhorseman.net>
+MIME-Version: 1.0
+Content-Type: multipart/mixed; boundary="=-=-="
+X-BeenThere: notmuch@notmuchmail.org
+X-Mailman-Version: 2.1.20
+Precedence: list
+List-Id: "Use and development of the notmuch mail system."
+ <notmuch.notmuchmail.org>
+List-Unsubscribe: <https://notmuchmail.org/mailman/options/notmuch>,
+ <mailto:notmuch-request@notmuchmail.org?subject=unsubscribe>
+List-Archive: <http://notmuchmail.org/pipermail/notmuch/>
+List-Post: <mailto:notmuch@notmuchmail.org>
+List-Help: <mailto:notmuch-request@notmuchmail.org?subject=help>
+List-Subscribe: <https://notmuchmail.org/mailman/listinfo/notmuch>,
+ <mailto:notmuch-request@notmuchmail.org?subject=subscribe>
+X-List-Received-Date: Fri, 15 Jan 2016 19:26:05 -0000
+
+--=-=-=
+Content-Type: text/plain
+
+On Thu 2016-01-14 16:20:59 -0500, Daniel Kahn Gillmor wrote:
+> This suggests that if i include a bogus message-id in my References:
+> list for any mail i send to a notmuch user, then access to their
+> database will let me tell whether they ever saw it or not, regardless of
+> whether they deleted the message.
+
+The script below demonstrates the problem.
+
+before the message is added and removed, delve -a shows:
+
+----------------------
+All terms in database:
+----------------------
+
+but afterward, it shows:
+
+----------------------
+All terms in database: G0000000000000001 Qno-such-message@example.org Tghost XDDIRENTRY2:new XDIRECTORY XDIRECTORYnew
+----------------------
+
+    --dkg
+
+
+--=-=-=
+Content-Type: text/x-sh
+Content-Disposition: inline; filename=demonstrate-ghost-leak
+
+#!/bin/bash -x
+
+workdir="$(mktemp -d)"
+export NOTMUCH_CONFIG="${workdir}/.notmuch-config"
+mkdir -p "${workdir}"/messages/{cur,tmp,new}
+
+cat >$NOTMUCH_CONFIG <<EOF
+[database]
+path=$workdir/messages
+EOF
+
+notmuch new
+delve -a $workdir/messages/.notmuch/xapian
+
+cat >"${workdir}"/messages/new/test-message.eml <<EOF
+From: alice@example.org
+To: bob@example.org
+Date: Fri, 15 Jan 2016 14:16:46 -0500
+Subject: a test message
+References: <no-such-message@example.org>
+Message-ID: <12345@example.org>
+Content-Type: text/plain
+
+This is a test message
+EOF
+
+notmuch new
+delve -a $workdir/messages/.notmuch/xapian
+
+rm -f "${workdir}"/messages/new/test-message.eml
+
+notmuch new
+delve -a $workdir/messages/.notmuch/xapian
+
+--=-=-=--