Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id 5D72140D143 for ; Tue, 12 Oct 2010 06:17:09 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -2.6 X-Spam-Level: X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7] autolearn=ham Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dhjoJWsux1tV for ; Tue, 12 Oct 2010 06:16:58 -0700 (PDT) Received: from tempo.its.unb.ca (tempo.its.unb.ca [131.202.1.21]) by olra.theworths.org (Postfix) with ESMTP id CFDC340D141 for ; Tue, 12 Oct 2010 06:16:58 -0700 (PDT) Received: from convex-new.cs.unb.ca (convex-new.cs.unb.ca [131.202.245.35]) by tempo.its.unb.ca (8.13.8/8.13.8) with ESMTP id o9CDGUHe023334; Tue, 12 Oct 2010 10:16:30 -0300 Received: from bremner by convex-new.cs.unb.ca with local (Exim 4.72) (envelope-from ) id 1P5eiU-0005im-FZ; Tue, 12 Oct 2010 10:16:30 -0300 From: David Bremner To: Michal Sojka , notmuch@notmuchmail.org Subject: Re: First draft of logging functionality. In-Reply-To: <87ocaz3akd.fsf@steelpick.2x.cz> References: <1286803617-17328-1-git-send-email-david@tethera.net> <87zkuj3hme.fsf@steelpick.2x.cz> <87hbgrhd1a.fsf@rocinante.cs.unb.ca> <87ocaz3akd.fsf@steelpick.2x.cz> User-Agent: Notmuch/0.3.1-58-g6607fd6 (http://notmuchmail.org) Emacs/23.2.1 (x86_64-pc-linux-gnu) Date: Tue, 12 Oct 2010 10:16:30 -0300 Message-ID: <878w23eekx.fsf@convex-new.cs.unb.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Oct 2010 13:17:09 -0000 On Tue, 12 Oct 2010 13:38:42 +0200, Michal Sojka wrote: > > Why multiple log files? You may have the buffers for message logs in > memory, right? Well, maybe one log for tag operations, one for adding messages, etc... But it is easy enough to mark log entries by what they are. > > Another thing to keep in mind is how it will behave with 'notmuch > restore'. If do dump followed by resore you will have a very long log > with no useful information in it. Some optimization may be employed here. > Yes. This seems hard to optimize internally, but I was thinking of some "log compression" function that comes up with a minimal equivalent set of operations. I had in mind that this could be used to sync: concatenate all the logs, and then compress to a minimal set of operations. This is still not completely thought out... Another issue is that the buffer could get rather big during a restore, but this is presumably fixable by flushing it if it gets too large. All the best, David