From: Mark Walters Date: Tue, 23 Jul 2013 12:53:38 +0000 (+0100) Subject: Re: Performance-issues with large threads X-Git-Url: http://git.tremily.us/?a=commitdiff_plain;h=a3b0ace943649c759b467fddbd43ed693a72785a;p=notmuch-archives.git Re: Performance-issues with large threads --- diff --git a/49/5b6314e7e476efdbd0b004116d6c6d10a2124a b/49/5b6314e7e476efdbd0b004116d6c6d10a2124a new file mode 100644 index 000000000..35fbd5dcf --- /dev/null +++ b/49/5b6314e7e476efdbd0b004116d6c6d10a2124a @@ -0,0 +1,112 @@ +Return-Path: +X-Original-To: notmuch@notmuchmail.org +Delivered-To: notmuch@notmuchmail.org +Received: from localhost (localhost [127.0.0.1]) + by olra.theworths.org (Postfix) with ESMTP id 18947431FB6 + for ; Tue, 23 Jul 2013 05:53:58 -0700 (PDT) +X-Virus-Scanned: Debian amavisd-new at olra.theworths.org +X-Spam-Flag: NO +X-Spam-Score: -1.098 +X-Spam-Level: +X-Spam-Status: No, score=-1.098 tagged_above=-999 required=5 + tests=[DKIM_ADSP_CUSTOM_MED=0.001, FREEMAIL_FROM=0.001, + NML_ADSP_CUSTOM_MED=1.2, RCVD_IN_DNSWL_MED=-2.3] autolearn=disabled +Received: from olra.theworths.org ([127.0.0.1]) + by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) + with ESMTP id pRUFshOtE+83 for ; + Tue, 23 Jul 2013 05:53:50 -0700 (PDT) +Received: from mail2.qmul.ac.uk (mail2.qmul.ac.uk [138.37.6.6]) + (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) + (No client certificate requested) + by olra.theworths.org (Postfix) with ESMTPS id 1C91B431FBC + for ; Tue, 23 Jul 2013 05:53:50 -0700 (PDT) +Received: from smtp.qmul.ac.uk ([138.37.6.40]) + by mail2.qmul.ac.uk with esmtp (Exim 4.71) + (envelope-from ) + id 1V1c5z-0001iO-V6; Tue, 23 Jul 2013 13:53:42 +0100 +Received: from 93-97-24-31.zone5.bethere.co.uk ([93.97.24.31] helo=localhost) + by smtp.qmul.ac.uk with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.71) + (envelope-from ) + id 1V1c5z-0007bB-NT; Tue, 23 Jul 2013 13:53:39 +0100 +From: Mark Walters +To: Franz Fellner , notmuch@notmuchmail.org +Subject: Re: Performance-issues with large threads +In-Reply-To: <027633b9-200d-4174-a8b5-72daff923b93@gmail.com> +References: <027633b9-200d-4174-a8b5-72daff923b93@gmail.com> +User-Agent: Notmuch/0.15.2+192~g8222af3 (http://notmuchmail.org) Emacs/23.4.1 + (i486-pc-linux-gnu) +Date: Tue, 23 Jul 2013 13:53:38 +0100 +Message-ID: <87wqoh77zh.fsf@qmul.ac.uk> +MIME-Version: 1.0 +Content-Type: text/plain; charset=us-ascii +X-Sender-Host-Address: 93.97.24.31 +X-QM-SPAM-Info: Sender has good ham record. :) +X-QM-Body-MD5: d19e1c4558cf3f6b8a5feb3bfb3f1962 (of first 20000 bytes) +X-SpamAssassin-Score: 0.0 +X-SpamAssassin-SpamBar: / +X-SpamAssassin-Report: The QM spam filters have analysed this message to + determine if it is + spam. We require at least 5.0 points to mark a message as spam. + This message scored 0.0 points. Summary of the scoring: + * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail + provider * (markwalters1009[at]gmail.com) + * 0.0 AWL AWL: From: address is in the auto white-list +X-QM-Scan-Virus: ClamAV says the message is clean +X-BeenThere: notmuch@notmuchmail.org +X-Mailman-Version: 2.1.13 +Precedence: list +List-Id: "Use and development of the notmuch mail system." + +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +X-List-Received-Date: Tue, 23 Jul 2013 12:53:58 -0000 + + +Hi + +Sorry this will be a big list of questions but they might help narrow +down the problem. + +How long does + +notmuch show --format=json thread:thread-id > /dev/null + +take? Is it much faster after the first run? What about the same with +the added cli option --body=false? + +(you probably want something like echo 3 > /proc/sys/vm/drop_caches +between batches of runs) + +Do the messages have html parts? + +Also what disk are you using (and does it have any other significant +activity happening)? And what version of notmuch are you using? + +Best wishes + +Mark + + + + + + +Franz Fellner writes: + +> Hi, +> +> "Large" in the context of this issue is >20 replies, I have to wait ~1 sec until the thread shows up. With larger conversations it get's worse (a bug report on bugs.kde.org with ~400 replies takes ~13 secs. to load). +> This is due to the fact, that notmuch-{vim,emacs} load the complete mail including the body. +> ner does a great job here, it loads all headers but only the body of the first unread mail, resulting in instant loading even of gigantic conversations. It would be terrific to see something like that, at least in my favored vim-client ;) +> +> Thx +> Franz +> _______________________________________________ +> notmuch mailing list +> notmuch@notmuchmail.org +> http://notmuchmail.org/mailman/listinfo/notmuch