Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id 017904196F2 for ; Mon, 12 Apr 2010 07:21:38 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -4.19 X-Spam-Level: X-Spam-Status: No, score=-4.19 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, T_MIME_NO_TEXT=0.01] autolearn=ham Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YBqh+blg6Zr4 for ; Mon, 12 Apr 2010 07:21:37 -0700 (PDT) Received: from brinza.cc.columbia.edu (brinza.cc.columbia.edu [128.59.29.8]) by olra.theworths.org (Postfix) with ESMTP id E3F3E431FC1 for ; Mon, 12 Apr 2010 07:21:36 -0700 (PDT) Received: from servo.finestructure.net (geco.phys.columbia.edu [128.59.170.159]) (user=jgr2110 author=jrollins@finestructure.net mech=PLAIN bits=0) by brinza.cc.columbia.edu (8.14.3/8.14.3) with ESMTP id o3CELaqt027609 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=NOT); Mon, 12 Apr 2010 10:21:36 -0400 (EDT) Received: from jrollins by servo.finestructure.net with local (Exim 4.71) (envelope-from ) id 1O1KW8-0008NX-Jn; Mon, 12 Apr 2010 10:21:36 -0400 From: Jameson Rollins To: Sebastian Spaeth , Notmuch list Subject: Re: please eat my data! In-Reply-To: <87633wlrrk.fsf@SSpaeth.de> References: <87633wlrrk.fsf@SSpaeth.de> Date: Mon, 12 Apr 2010 10:21:35 -0400 Message-ID: <87tyrgeopc.fsf@servo.finestructure.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" X-No-Spam-Score: Local X-Scanned-By: MIMEDefang 2.68 on 128.59.29.8 X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Apr 2010 14:21:38 -0000 --=-=-= On Mon, 12 Apr 2010 15:33:35 +0200, "Sebastian Spaeth" wrote: > fsync is really killing xapian (and notmuch). What suffers, are the > boolean prefixes (tag, id, and thread). Using libeatmydata (which > disables fsync) shows a 10x speedup for tagging. The speedup is only > factor 2 for e.g. from: searches. This is ext4 on recent stock > Ubuntu. Given that search by tag and thread are performed really often > (each time I advance a thread, for example), that really hurts. Wow, this is really interesting, Sebastian. For those of us not in the know, can you explain what libeatmydata is and how it's used? It sounds like something I would *not* want to use! So you didn't have to recompile here, and only had to set LD_PRELOAD=./libeatmydata.so? Is there any drawback to what you're doing here? jamie. --=-=-= Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) iQIcBAEBCAAGBQJLwyxvAAoJEO00zqvie6q8xfAP/1krxMs7H/XQsh69s/NqrQhx TEcDWr+2OaXfahbigU8o7yQzuKC5gBAzM9gbh69wUlZuTD5e80wn/rUvbIgzSqk9 neFV1qr9sKBqyVsvoXemT3tQLFYKH4gwaCNjCC7zrBfI+AFEULEg5TIFxiQRdbNS Y85fnhsn8nyjYEkBMz7Ni/7cSBa/x9nVl5KC+lqZ6hFt+kwLupceWyiKvcyhrMDH HYK4J4HdP0KuXmcT6yPGKaaPFSYtBy5KAu2ZcHVISje62M15WEPblCFRWKB63tih +gb8YVH7Y364Sc28h3X4CaY0alMvEQKW69G8jeXgKyn3Vt1jwLjC9RO+f0ykGool zhK1kjn5tOw8URubpcL6lFQOs6GgLe48exbzBXVBBava/XoA2lP3v8v3tTsYkhi3 kiWYUF87td75pA+wW9glLMe6UpdkhJBrtQ+KfuJzU1jqgxDMANYWKJT/n2eu+7wL 6GjFO7z4WfelTl7ZQVTbs+6vhV+UcT554TK3HgT1m4BOu14+BGYgN+vJSyuUoBKi D70taKhyiYDc5OBvlUB4ib9KgWsiQFLB6DAWnB25a6KcIMULlKpFwtO3obFt7WP0 HaCXkBsVYKdZeK+A9qfm/gNLa5Dbls+dG9a6SBW0oYlgRvorowxtcVzT0LZaISiG NX7R1EXzwee+pzxFsyDZ =+0Gn -----END PGP SIGNATURE----- --=-=-=--