From: Kan-Ru Chen <kanru@kanru.info>
To: Carl Worth <cworth@cworth.org>, notmuch@notmuchmail.org
In-Reply-To: <87ocl1lut1.fsf@yoom.home.cworth.org>
References: <87ocl1lut1.fsf@yoom.home.cworth.org>
Date: Tue, 12 Jan 2010 09:46:14 +0800
Message-ID: <87wrzoaye1.fsf@anar.kanru.info>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
	micalg=pgp-sha256; protocol="application/pgp-signature"
Subject: Re: [notmuch] Some Xapian tips and thoughts on rebuilding
Precedence: list

--=-=-=
Content-Transfer-Encoding: quoted-printable

On Sun, 10 Jan 2010 09:43:38 -0800, Carl Worth <cworth@cworth.org> wrote:
> Compacting your database
> ------------------------
> One final tip. I recently started experimenting with a Xapian feature
> for compacting a database. This is available only via a command-line
> program, (named xapian-compact in the 1.0 releases and
> xapian-compact-1.1 in the current Xapian from svn). This functionality
> is not yet available in the Xapian library interface or else I would
> probably make notmuch call it after building the database.
>=20
> If you want to experiment with xapian-compact, you'll want to call it
> with a command something like the following:
>=20
>      xapian-compact-1.1 --no-renumber ~/mail/.notmuch/xapian ~/mail/.notm=
uch/xapian-compact
>=20
> The --no-renumber argument is essential with a notmuch database, since
> (as of database format version 1), notmuch stores Xapian document IDs
> internally within terms. If you forget this, you'll find that all of
> your searches will return results that are unable to locate any of the
> filenames corresponding to your mail.

After compacting my database, the size shrunk significantly, but the
number of messages also changed. Beware that you might lose messages
after compacting if you are trying this.

run on xapian-svn r13824

>=20
> After running the above command, you could then move your existing
> .notmuch/xapian away and move .notmuch/xapian-compact in its place to
> test, and then discard the original .notmuch/xapian if you're happy with
> the result.
>=20
> For me, this compaction took my 5.0GB down to 3.1GB. So my database is
> now less than half the size of what I started with with flint, (and can
> conceivable be cached entirely within memory on my machine!), which is
> quite delightful.
>=20

=2D-=20
Kan-Ru Chen | http://kanru.info

Q: Why are my replies five sentences or less?
A: http://five.sentenc.es/

--=-=-=
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)

iQIcBAEBCAAGBQJLS9RmAAoJEBsTLgHOxq1Gw6AQAICRNbhGtc3KZzmdcaKfKcJL
XeFVj/jFmqBZ/xIWnMrqooDqKYCc5i1/G5Bv38Xq01B0TotghgL3EUPdqKeQUNyk
xzXyqCThB7C1Rt1vV/MZC9Ni9B0WXMWsUt9avA4FZ5eNrRuhWYr7PgWzQJMivDM9
VD4OebKzzkcf7d+ZtgPuAtBHaTzqChluP+IfpIwymacDzEdKyv2o5qcu3C6DLeFr
CP3j61isv3jOpS01saNVYxSvjotKZZWd4KtFcv5l/X0noSQeUeOutUpjcT1VHl7F
RKPxUko9Oe9jCt0bTqu6DfUHPrs8n2xCNQnOem709SaMmeo7LQ7R1tcCL9BYQpJs
m+/Ac44AB34ios4JBoGs1mbAB0K8isz8XYlGg7EOZOH+hJjggR5uEoZKO1JeG5Oj
t2iNVw6nTM6epDhnRaIVYanZ48rPwvwEyoWXHkoUszfLIQ+Dl3pdDYW1qmyKFe6z
ECPMnvowDSCTvvX7/3qD3CVwkkTAUGp8f6o2a2XVphlj9YPmXdOuHT/1qEqDSqBY
PsrUh0DPKdPYSfuoiBWbfdPmc0+HB4/PrGt9iUmq/qrP4WPQqrIyi5Bkd88UPxXL
zHe3mdlXcwJJcNv6IQqOSUiHoYHgm6km3mcZr6+T3nzXpyUynb9jH0hPNSIKvS1a
bL/efvtHLHjo3FvbNtkU
=U9tK
-----END PGP SIGNATURE-----
--=-=-=--