Return-Path: X-Original-To: notmuch@notmuchmail.org Delivered-To: notmuch@notmuchmail.org Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id EDB96431FD0 for ; Thu, 27 Jan 2011 14:20:23 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -0.698 X-Spam-Level: X-Spam-Status: No, score=-0.698 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id AXVxuOUHUx1R for ; Thu, 27 Jan 2011 14:20:22 -0800 (PST) Received: from mail-qw0-f53.google.com (mail-qw0-f53.google.com [209.85.216.53]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (No client certificate requested) by olra.theworths.org (Postfix) with ESMTPS id 1F750431FB5 for ; Thu, 27 Jan 2011 14:20:22 -0800 (PST) Received: by qwe5 with SMTP id 5so2792053qwe.26 for ; Thu, 27 Jan 2011 14:20:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=wZJh0VSCs3Bs1cTR5EvBJaIvVTijx+qUUmpPc6ILz3g=; b=WzWXSUpoks7I0kAR+nQKnDSaz2SBVdB2FHmT2rRDM143zVhq9YJUR2usRemLjLAOjL 4qdZ8WrYSWM9gUBzpkx88TvqNQcQShzmInCZvqmaIonlES5c8es2DkiLo4IQ5+QcvLhT SPCrLg7pqxkbVWGPpp0agsGBl9ZOzPr9RBE3I= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; b=Axm6Z5hfmpOxbxUQqiSgd63NsLC0XIGrl51GiC6LWVfsNMChPWf7sQptyKP/E54XDG fnMduPQFNGBLnRNsdNsC1jEiEylPxhGh9Ud1MX18ttk6bGFtLfnuwbaMqh0RgKgruGyY u4l2vN/+XUU5peFMpHeHe+RO31BIQP7MAtyzU= MIME-Version: 1.0 Received: by 10.229.240.85 with SMTP id kz21mr2022742qcb.2.1296166821212; Thu, 27 Jan 2011 14:20:21 -0800 (PST) Sender: amdragon@gmail.com Received: by 10.229.97.143 with HTTP; Thu, 27 Jan 2011 14:20:21 -0800 (PST) In-Reply-To: <87vd1a84qj.fsf@servo.finestructure.net> References: <87fwsetdin.fsf@kepler.schwinge.homeip.net> <8762taxk9y.fsf@algae.riseup.net> <87vd1a84qj.fsf@servo.finestructure.net> Date: Thu, 27 Jan 2011 17:20:21 -0500 X-Google-Sender-Auth: _mfErxMh_hNNCMnTa7jFiM6oS5c Message-ID: Subject: Re: notmuch's idea of concurrency / failing an invocation From: Austin Clements To: Jameson Rollins Content-Type: multipart/alternative; boundary=0016363101e5f2b320049adb5ab1 Cc: notmuch@notmuchmail.org, Thomas Schwinge X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Jan 2011 22:20:24 -0000 --0016363101e5f2b320049adb5ab1 Content-Type: text/plain; charset=ISO-8859-1 I'm looking into breaking notmuch new up into small transactions. It wouldn't be much a leap from there to simply close and reopen the database between transactions if another task wants to use it, which would release the lock and let the queued notmuch task have the database for a bit. It seems silly to have a daemon when all of notmuch's state is already on disk and queue on a lock is as good as a queue in a daemon, but without the accompanying architectural shenanigans. On Thu, Jan 27, 2011 at 3:35 PM, Jameson Rollins wrote: > On Thu, 27 Jan 2011 13:40:25 -0500, micah anderson > wrote: > > Due to my harddisk in my laptop being slow (5400RPM), my notmuch > > database growing, and perhaps some fragmentation somewhere, this has > > become *incredibly* annoying for me. I am checking email every 30 > > minutes, and I'm nicing and ionicing the processes so I can use my > > machine, but while those processes are running, I'm effectively locked > > out of a good portion of my email. > > I also have a very slow disk, but this is very rarely a problem for me. > I retrieve mail every 10 minutes, and the corresponding notmuch new > usually takes a minute or so. I really haven't found it to be much of a > bother to just wait it out. > > One of the suggested ways to develop around this problem would be a > notmuch daemon that would queue database modification requests. I don't > think anyone has been working on this yet, but if this is a big problem > for you guys, you might start looking into putting one together. > > jamie. --0016363101e5f2b320049adb5ab1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable I'm looking into breaking notmuch new up into small transactions. =A0It= wouldn't be much a leap from there to simply close and reopen the data= base between transactions if another task wants to use it, which would rele= ase the lock and let the queued notmuch task have the database for a bit. = =A0It seems silly to have a daemon when all of notmuch's state is alrea= dy on disk and queue on a lock is as good as a queue in a daemon, but witho= ut the accompanying architectural=A0shenanigans.

On Thu, Jan 27, 2011 at 3:35 PM, Jameson Rol= lins <jr= ollins@finestructure.net> wrote:
On Thu, 27 Jan 2011 13:40:25 -0500, micah anderson <micah@riseup.net> wrote:
> Due to my harddisk in my laptop being slow (5400RPM), my notmuch
> database growing, and perhaps some fragmentation somewhere, this has > become *incredibly* annoying for me. I am checking email every 30
> minutes, and I'm nicing and ionicing the processes so I can use my=
> machine, but while those processes are running, I'm effectively lo= cked
> out of a good portion of my email.

I also have a very slow disk, but this is very rarely a problem for m= e.
I retrieve mail every 10 minutes, and the corresponding notmuch new
usually takes a minute or so. =A0I really haven't found it to be much o= f a
bother to just wait it out.

One of the suggested ways to develop around this problem would be a
notmuch daemon that would queue database modification requests. =A0I don= 9;t
think anyone has been working on this yet, but if this is a big problem
for you guys, you might start looking into putting one together.

jamie.
--0016363101e5f2b320049adb5ab1--