Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id 56029431FAF for ; Sat, 11 Aug 2012 03:00:24 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -0.799 X-Spam-Level: X-Spam-Status: No, score=-0.799 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1bvBJm10ZOiu for ; Sat, 11 Aug 2012 03:00:23 -0700 (PDT) Received: from mail-wi0-f179.google.com (mail-wi0-f179.google.com [209.85.212.179]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by olra.theworths.org (Postfix) with ESMTPS id 8301A431FAE for ; Sat, 11 Aug 2012 03:00:23 -0700 (PDT) Received: by wibhq4 with SMTP id hq4so1671727wib.2 for ; Sat, 11 Aug 2012 03:00:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Z2xnhSet7OxXNVY94hI2uTzkBiGGI97b7GgfNYOcJo8=; b=lv0kWMNHFmIny12ZsXmsIE43Qencb+Hl4xGNF9iVt+iuCBVmBMIm34JexG9soVBUjM bt+kdaGNxLP78gVncNfHfkMr8nKwJZ9SuB9QPFT8C25nGK0WkyDM99DzxIRGS7a6YsLE iHKw6FU4xrp1Dct56kW2CUA9nqsGS2rAnz0dq+wWqejoIH/lYuFW19yD4A+STk8SASIj 2yyaRYozoFmUDRXm+H2bE0C0bFhkuHjZR7wk864Ofo+LoNNNlkyx/Pn4BiojPozZI9Ra aXdfuK7IpNFnwveTLs9Ivt3/7avwR6YqyQLZtxE0ObKh2SLV1WE+v7eDD422Iqu/BVXd X9SA== MIME-Version: 1.0 Received: by 10.217.1.197 with SMTP id n47mr2947337wes.27.1344679222308; Sat, 11 Aug 2012 03:00:22 -0700 (PDT) Received: by 10.180.104.196 with HTTP; Sat, 11 Aug 2012 03:00:22 -0700 (PDT) In-Reply-To: <20120811094635.GY28321@pub.cz.oracle.com> References: <20120811094635.GY28321@pub.cz.oracle.com> Date: Sat, 11 Aug 2012 13:00:22 +0300 Message-ID: Subject: Re: Alternative (raw) message store (i.e. instead of maildir) From: Ciprian Dorin Craciun To: notmuch@notmuchmail.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Aug 2012 10:00:24 -0000 On Sat, Aug 11, 2012 at 12:46 PM, Vladimir Marek wrote: > Hi, > > I have objections against maildir too, Just for the record I have nothing against maildir (or at least when compared to mbox format). On the contrary I find it quite easy to fiddle with... My problem with it is that it doesn't scale... And I don't mean this in a theoretical sense, I mean it in the concrete one: I have about 661k emails... And a single `notmuch sync` takes a few tens of seconds... (Of course my problem could be partially solved by moving to a fanout maildir folder, i.e. multiple maildirs. But this doesn't solve the scalability it just delays the problem...) > but I tried to tackle it from > different perspective. Store the maildir in zip file and use fuse-zip to > manage it. It works sort of but it has two major disadvantages: I also thought of using either FUSE or 9p for this. Unfortunately it doesn't quite solve my issue as seen above... Now about other hacks to my problem: * I'm aware that I can feed notmuch with individual file paths to be indexed, but it still needs a path where to find an email; * use the before mentioned fanout solution; * others? But regardless, having 600k emails on my disk (currently in the same folder) is insane... Moreover I would have loved to be able to use some Git plumbing as a store, or maybe CouchDB, etc... Ciprian.