Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id EB01E429E25 for ; Sat, 10 Dec 2011 19:27:17 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -2.29 X-Spam-Level: X-Spam-Status: No, score=-2.29 tagged_above=-999 required=5 tests=[RCVD_IN_DNSWL_MED=-2.3, T_MIME_NO_TEXT=0.01] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id OuUN2QPigetJ for ; Sat, 10 Dec 2011 19:27:17 -0800 (PST) Received: from tempo.its.unb.ca (tempo.its.unb.ca [131.202.1.21]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by olra.theworths.org (Postfix) with ESMTPS id 04A32431FB6 for ; Sat, 10 Dec 2011 19:27:16 -0800 (PST) Received: from zancas.localnet (fctnnbsc36w-156034079193.pppoe-dynamic.High-Speed.nb.bellaliant.net [156.34.79.193]) (authenticated bits=0) by tempo.its.unb.ca (8.13.8/8.13.8) with ESMTP id pBB3RDGb015857 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=NO); Sat, 10 Dec 2011 23:27:15 -0400 Received: from bremner by zancas.localnet with local (Exim 4.77) (envelope-from ) id 1RZa4G-0007dw-RZ; Sat, 10 Dec 2011 23:27:12 -0400 From: David Bremner To: Notmuch Mail Subject: experimental logging branch User-Agent: Notmuch/0.10.2+80~g144897e (http://notmuchmail.org) Emacs/23.3.1 (x86_64-pc-linux-gnu) Date: Sat, 10 Dec 2011 23:27:02 -0400 Message-ID: <87obvfu6t5.fsf@zancas.localnet> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha1; protocol="application/pgp-signature" X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Dec 2011 03:27:18 -0000 --=-=-= Content-Transfer-Encoding: quoted-printable I have pushed a branch jlog=20 git://pivot.cs.unb.ca/notmuch.git This uses the jlog library (http://labs.omniti.com/labs/jlog) to atomically log messages in pub-sub model. On this branch you can enable logging of tagging operations by=20 notmuch config set log.subscribers 'name1;name2;name3' the "subscriber names" identify clients (one could imagine one client deals with general tag syncing, another with nmbug, or so). =20=20 One can read the log via the jlog api (there are perl bindings) or via the "notmuch log" command.=20 notmuch log name1=20 will print all of the log messages since the last time the queue was read. for e.g., tag removal, these lines look like T-1322702130-26068-3-git-send-email-bremner@debian.org test T-1322702130-26068-1-git-send-email-bremner@debian.org test T-7fbe6befcf31881a9bca672f55b93501249a220c.1322859389.git.jani@nikula.org t= est T-716da00e176e1dc6af0ba248caee40acee733120.1322859389.git.jani@nikula.org t= est An example application would be a cron job that writes all tag changes to some nmbug like git repo. There are a few rough edges and I expect to rebase the branch a bit more, but feel free to have a look at it. I guess I'm curious if people think jlog is an acceptable dependency, and whether the whole logging thing seems worthwhile.=20 I did some preliminary tests, and for adding or deleting a tag to 200k messages, this added about a 5% time penalty. I didn't notice any really heavy I/O (no SSD here, but i7 cpu). Tests were roughly 95% CPU bound. There are some preliminary debian packages for jlog at=20 git://pivot.cs.unb.ca/jlog.git The upstream source for jlog is at=20 =20=20=20=20 https://github.com/omniti-labs/jlog --=-=-= Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iJwEAQECAAYFAk7kIwYACgkQTiiN/0Um85m4rwP9FTTbhlez2RsSXjqd1tue9C/c ai8mG2Bo6Dx+fmwL8Kz/+QT7y7ySziIIB0LhwdncRIUfy+Yk6SFXB2EDU+WsIppW pkeGGDJ4peFQx4OJT9aWkaVesl8UYrJsY5KBS5a8Umadq4hwKCZmnzxFySFsmkqF 7GVFOJvJztFWIDS7u4Q= =XE6Q -----END PGP SIGNATURE----- --=-=-=--