From e7f6e62a9af81a0bea4afe26d3e5880c5fd8a629 Mon Sep 17 00:00:00 2001 From: Ciprian Dorin Craciun Date: Sat, 11 Aug 2012 13:00:22 +0300 Subject: [PATCH] Re: Alternative (raw) message store (i.e. instead of maildir) --- a9/b29af48dc4b7d8806379c106539c0e9e34d27f | 101 ++++++++++++++++++++++ 1 file changed, 101 insertions(+) create mode 100644 a9/b29af48dc4b7d8806379c106539c0e9e34d27f diff --git a/a9/b29af48dc4b7d8806379c106539c0e9e34d27f b/a9/b29af48dc4b7d8806379c106539c0e9e34d27f new file mode 100644 index 000000000..b25287630 --- /dev/null +++ b/a9/b29af48dc4b7d8806379c106539c0e9e34d27f @@ -0,0 +1,101 @@ +Return-Path: +X-Original-To: notmuch@notmuchmail.org +Delivered-To: notmuch@notmuchmail.org +Received: from localhost (localhost [127.0.0.1]) + by olra.theworths.org (Postfix) with ESMTP id 56029431FAF + for ; Sat, 11 Aug 2012 03:00:24 -0700 (PDT) +X-Virus-Scanned: Debian amavisd-new at olra.theworths.org +X-Spam-Flag: NO +X-Spam-Score: -0.799 +X-Spam-Level: +X-Spam-Status: No, score=-0.799 tagged_above=-999 required=5 + tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, + FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled +Received: from olra.theworths.org ([127.0.0.1]) + by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) + with ESMTP id 1bvBJm10ZOiu for ; + Sat, 11 Aug 2012 03:00:23 -0700 (PDT) +Received: from mail-wi0-f179.google.com (mail-wi0-f179.google.com + [209.85.212.179]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) + (No client certificate requested) + by olra.theworths.org (Postfix) with ESMTPS id 8301A431FAE + for ; Sat, 11 Aug 2012 03:00:23 -0700 (PDT) +Received: by wibhq4 with SMTP id hq4so1671727wib.2 + for ; Sat, 11 Aug 2012 03:00:22 -0700 (PDT) +DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; + h=mime-version:in-reply-to:references:date:message-id:subject:from:to + :content-type; bh=Z2xnhSet7OxXNVY94hI2uTzkBiGGI97b7GgfNYOcJo8=; + b=lv0kWMNHFmIny12ZsXmsIE43Qencb+Hl4xGNF9iVt+iuCBVmBMIm34JexG9soVBUjM + bt+kdaGNxLP78gVncNfHfkMr8nKwJZ9SuB9QPFT8C25nGK0WkyDM99DzxIRGS7a6YsLE + iHKw6FU4xrp1Dct56kW2CUA9nqsGS2rAnz0dq+wWqejoIH/lYuFW19yD4A+STk8SASIj + 2yyaRYozoFmUDRXm+H2bE0C0bFhkuHjZR7wk864Ofo+LoNNNlkyx/Pn4BiojPozZI9Ra + aXdfuK7IpNFnwveTLs9Ivt3/7avwR6YqyQLZtxE0ObKh2SLV1WE+v7eDD422Iqu/BVXd + X9SA== +MIME-Version: 1.0 +Received: by 10.217.1.197 with SMTP id n47mr2947337wes.27.1344679222308; Sat, + 11 Aug 2012 03:00:22 -0700 (PDT) +Received: by 10.180.104.196 with HTTP; Sat, 11 Aug 2012 03:00:22 -0700 (PDT) +In-Reply-To: <20120811094635.GY28321@pub.cz.oracle.com> +References: + + <20120811094635.GY28321@pub.cz.oracle.com> +Date: Sat, 11 Aug 2012 13:00:22 +0300 +Message-ID: + +Subject: Re: Alternative (raw) message store (i.e. instead of maildir) +From: Ciprian Dorin Craciun +To: notmuch@notmuchmail.org +Content-Type: text/plain; charset=UTF-8 +X-BeenThere: notmuch@notmuchmail.org +X-Mailman-Version: 2.1.13 +Precedence: list +List-Id: "Use and development of the notmuch mail system." + +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +X-List-Received-Date: Sat, 11 Aug 2012 10:00:24 -0000 + +On Sat, Aug 11, 2012 at 12:46 PM, Vladimir Marek + wrote: +> Hi, +> +> I have objections against maildir too, + + Just for the record I have nothing against maildir (or at least +when compared to mbox format). On the contrary I find it quite easy to +fiddle with... + + My problem with it is that it doesn't scale... And I don't mean +this in a theoretical sense, I mean it in the concrete one: I have +about 661k emails... And a single `notmuch sync` takes a few tens of +seconds... + + (Of course my problem could be partially solved by moving to a +fanout maildir folder, i.e. multiple maildirs. But this doesn't solve +the scalability it just delays the problem...) + + +> but I tried to tackle it from +> different perspective. Store the maildir in zip file and use fuse-zip to +> manage it. It works sort of but it has two major disadvantages: + + I also thought of using either FUSE or 9p for this. Unfortunately +it doesn't quite solve my issue as seen above... + + + Now about other hacks to my problem: + * I'm aware that I can feed notmuch with individual file paths to +be indexed, but it still needs a path where to find an email; + * use the before mentioned fanout solution; + * others? + + But regardless, having 600k emails on my disk (currently in the +same folder) is insane... Moreover I would have loved to be able to +use some Git plumbing as a store, or maybe CouchDB, etc... + + Ciprian. -- 2.26.2