Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id E244D431FB6 for ; Sun, 13 Feb 2011 12:25:52 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -0.699 X-Spam-Level: X-Spam-Status: No, score=-0.699 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pQ2jFc8e+Y61 for ; Sun, 13 Feb 2011 12:25:52 -0800 (PST) Received: from mail-qy0-f174.google.com (mail-qy0-f174.google.com [209.85.216.174]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by olra.theworths.org (Postfix) with ESMTPS id 19885431FB5 for ; Sun, 13 Feb 2011 12:25:52 -0800 (PST) Received: by qyj19 with SMTP id 19so967008qyj.5 for ; Sun, 13 Feb 2011 12:25:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; bh=F3/YndJ1Zrmb33KXHFtdx6vH3Z41+S8DFDc7rwA68ZA=; b=HdrCozPj9Gls/kBO+cqot6qgXepwghkIhxVnauc4Rftcv7NpatLbi4QizC7WSyRpOi mrwBCR2cFAFNwjAfi64NTMxAC2GqUtV5DPU4fsDXwFtb3T9zBKWfvntns9awy55c/nWO R8wrn3YeB8IC2lQPHJTfnwaKRQ55xBxPtMxAI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=A/aUWJCSAobrxopSknSAM0NM6r4c+VqCo84mxUWT7R1nQ2jQB6jsxjUjwHNBCVXD1h Y3ZpJArRnxBqFDXLM6LHmZyyT7jQ9V/eeDD/9KKtaRiacFf4QipIEPNtovS6BPn8ZdXb /HcDVaANxCxsC4tCVIdXt2TyE2hV9xhu1aACQ= MIME-Version: 1.0 Received: by 10.229.240.85 with SMTP id kz21mr2262864qcb.2.1297628748850; Sun, 13 Feb 2011 12:25:48 -0800 (PST) Sender: amdragon@gmail.com Received: by 10.229.97.143 with HTTP; Sun, 13 Feb 2011 12:25:48 -0800 (PST) In-Reply-To: <1291928396-27937-1-git-send-email-amdragon@mit.edu> References: <1291928396-27937-1-git-send-email-amdragon@mit.edu> Date: Sun, 13 Feb 2011 15:25:48 -0500 X-Google-Sender-Auth: FAJhLdjS12NzvbE2w-H0Tob5LIY Message-ID: Subject: Re: [PATCH 0/5] Fetch all message metadata in a single pass From: Austin Clements To: notmuch@notmuchmail.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Feb 2011 20:25:53 -0000 I've rebased this against current master and fixed a few merge conflicts. The rebased patches are on the eager-metadata-v3 branch of http://awakening.csail.mit.edu/git/notmuch.git On Thu, Dec 9, 2010 at 3:59 PM, Austin Clements wrote: > This is the second of the two optimizations I described a while ago, > and brings my inbox search down to 1.811 seconds, 2.5X faster than it > was originally. > > This optimization is based on the observation that Xapian decompresses > a document's term list every time you iterate over it. =A0As a result, > notmuch can decompress the beginning of a single term list quite a few > times. =A0This patch series combines all of this into a single pass that > is only slightly more expensive than fetching one metadata field used > to be, but offers a huge win in the common case where a message object > is used for multiple metadata fields. > > _______________________________________________ > notmuch mailing list > notmuch@notmuchmail.org > http://notmuchmail.org/mailman/listinfo/notmuch >