ssoma-mda.git
7 years agossoma-mda: Use the email subject as the commit message master
W. Trevor King [Sat, 18 Oct 2014 20:02:12 +0000 (13:02 -0700)]
ssoma-mda: Use the email subject as the commit message

This is more interesting than just using 'mda' all the time, but it's
harder to setup proper quoting around the message without using
third-party Perl modules (e.g. IPC::Run or String::ShellQuote).  This
proof-of-concept patch just assumes the subject doesn't contain
single-quotes (').  This patch also doesn't handle the empty/missing
subject case, which should probably fall back to '<no subject>' or
some such.

I'm fine dropping support for older Gits here, and just using the -m
option to commit-tree.  That landed with 96b8d93a (commit-tree: teach
-m/-F options to read logs from elsewhere, 2011-11-09) in Git v1.7.9,
which was released over 2.5 years ago on 2012-01-27.

It would also be useful (I think) to set the GIT_AUTHOR_NAME,
GIT_AUTHOR_EMAIL, and GIT_AUTHOR_DATE environment variables from the
message header before committing.  I know how to do that using
Python's subprocess module, but I don't know the Perl incantation.

7 years agodoc: remove HTML
Eric Wong [Wed, 2 Jul 2014 19:30:24 +0000 (19:30 +0000)]
doc: remove HTML

Even with txt2pre, the maintenance/discoverability burden is too
high and lynx still uses too much memory.  Unfortunately, we'll have
to keep our INSTALL.html for a while longer on the server since it's
linked, but not index.html!

8 years agossoma: cleanup IMAP password warnings
Eric Wong [Mon, 5 May 2014 20:21:13 +0000 (20:21 +0000)]
ssoma: cleanup IMAP password warnings

password may be an empty string, so we must check length.

8 years agossoma 0.1.0 v0.1.0
Eric Wong [Mon, 5 May 2014 05:31:37 +0000 (05:31 +0000)]
ssoma 0.1.0

* doc: describe public-inbox dedupe
* ssoma: lock against concurrent fetch/remote add
* ssoma: avoid redundant slash for expand_path
* extractor: filter out non-message paths

8 years agoextractor: filter out non-message paths
Eric Wong [Thu, 1 May 2014 20:38:39 +0000 (20:38 +0000)]
extractor: filter out non-message paths

We may allow files like "README" to appear in ssoma
repositories to reduce confusion.

8 years agossoma: avoid redundant slash for expand_path
Eric Wong [Wed, 30 Apr 2014 02:10:45 +0000 (02:10 +0000)]
ssoma: avoid redundant slash for expand_path

This makes our error messages look ugly.

8 years agossoma: lock against concurrent fetch/remote add
Eric Wong [Sat, 26 Apr 2014 03:16:06 +0000 (03:16 +0000)]
ssoma: lock against concurrent fetch/remote add

A user may manually run ssoma while cron is running,
so avoid any potential synchronization problems in this
case.

8 years agodoc: describe public-inbox dedupe
Eric Wong [Sat, 26 Apr 2014 00:29:57 +0000 (00:29 +0000)]
doc: describe public-inbox dedupe

Duplicate Message-IDs are uncommon enough to drop.

8 years agoINSTALL: add tarball link v0.0.0
Eric Wong [Mon, 21 Apr 2014 17:26:13 +0000 (17:26 +0000)]
INSTALL: add tarball link

Some users expect and prefer tarballs.

8 years agossoma: --cron implies --quiet
Eric Wong [Mon, 21 Apr 2014 09:42:14 +0000 (09:42 +0000)]
ssoma: --cron implies --quiet

cronjobs should be quiet, since cron default to emailing the user
on output.

8 years agodoc: various fixes and URL changes
Eric Wong [Mon, 21 Apr 2014 08:56:22 +0000 (08:56 +0000)]
doc: various fixes and URL changes

We don't need a specific list for ssoma, yet, just use the
meta@public-inbox.org list to avoid fragmentation.

8 years agossoma: add --since option for time-limiting imports
Eric Wong [Mon, 21 Apr 2014 08:42:00 +0000 (08:42 +0000)]
ssoma: add --since option for time-limiting imports

This should make it easier to avoid duplicating mail if
you're coming from being a normal mailing list subscriber
and switching to ssoma.

8 years agoworkaround older git without "commit-tree -m"
Eric Wong [Sun, 20 Apr 2014 23:49:17 +0000 (23:49 +0000)]
workaround older git without "commit-tree -m"

We need to support older git versions lying around.
Some versions broke argument ordering, too.

8 years agomda: keep Status: header when doing injection
Eric Wong [Sun, 20 Apr 2014 19:47:34 +0000 (19:47 +0000)]
mda: keep Status: header when doing injection

Non-public-inbox users may want to archive their personal email
with ssoma, so preserve the Status: line if it exists.  public-inbox
already kills the Status: header.

8 years agosome minor documentation tweaks
Eric Wong [Sun, 20 Apr 2014 19:46:11 +0000 (19:46 +0000)]
some minor documentation tweaks

Hopefully clarify things for folks coming from public-inbox.

8 years agodocumentation improvements, HTML page
Eric Wong [Sun, 20 Apr 2014 19:25:51 +0000 (19:25 +0000)]
documentation improvements, HTML page

8 years agouse Git.pm for efficient cat_blob if available
Eric Wong [Sun, 20 Apr 2014 19:18:19 +0000 (19:18 +0000)]
use Git.pm for efficient cat_blob if available

This reduces the amount of fork+exec and should improve performance
for large imports.

8 years agoGit*.pm: allow code improvements to flow back to git
Eric Wong [Sun, 20 Apr 2014 19:07:14 +0000 (19:07 +0000)]
Git*.pm: allow code improvements to flow back to git

By using GPLv2+, we are compatible with AGPLv3+ while still
allowing improvements to flow back into the git-svn modules
distributed with git.

8 years agossoma: add --cron option to sync
Eric Wong [Wed, 16 Apr 2014 19:45:51 +0000 (19:45 +0000)]
ssoma: add --cron option to sync

Encourages users to add "ssoma sync --cron" to their crontabs
and reduce load spikes.

8 years agossoma: use implicit $_ for simpler arg generation
Eric Wong [Wed, 16 Apr 2014 19:43:25 +0000 (19:43 +0000)]
ssoma: use implicit $_ for simpler arg generation

This makes the loop shorter and judicious use of $_ is OK.

8 years agoextractor: clarify naming for message delivery
Eric Wong [Tue, 15 Apr 2014 01:03:55 +0000 (01:03 +0000)]
extractor: clarify naming for message delivery

We'll be supporting multiple refs

8 years agoREADME: share list with public-inbox
Eric Wong [Sat, 12 Apr 2014 12:11:17 +0000 (12:11 +0000)]
README: share list with public-inbox

No reason to separate communities this early on.

8 years agouse flock instead of fcntl locking
Eric Wong [Sat, 12 Apr 2014 04:12:47 +0000 (04:12 +0000)]
use flock instead of fcntl locking

We do not need range locking of fcntl locks, so using flock removes
a dependency, hopefully making us easier-to-install.  Also keep in
mind Ruby (and perhaps other scripting language) supports flock
out-of-the-box as well, so it seems flock is easier to support
although fcntl locks offer superior functionality.

8 years agocleanup globbing
Eric Wong [Thu, 10 Apr 2014 07:26:08 +0000 (07:26 +0000)]
cleanup globbing

Calling the glob function explicitly seems to be favored nowadays.

8 years agoINSTALL: fix misnamed Debian package
Eric Wong [Thu, 10 Apr 2014 06:09:37 +0000 (06:09 +0000)]
INSTALL: fix misnamed Debian package

While we're at it, sort Makefile.PL so it's harder to
miss things.

8 years agoMakefile.PL: add parallel tests
Eric Wong [Wed, 9 Apr 2014 18:12:49 +0000 (18:12 +0000)]
Makefile.PL: add parallel tests

These tests are intended to run in parallel.

8 years agot/all: fixup test for missing IPC::Run
Eric Wong [Wed, 9 Apr 2014 18:12:06 +0000 (18:12 +0000)]
t/all: fixup test for missing IPC::Run

I forgot to re-enable the test once I ensured things passed without
IPC::Run.

8 years agomid2path ignores leading '<' and trailing '>'
Eric Wong [Tue, 8 Apr 2014 23:48:31 +0000 (23:48 +0000)]
mid2path ignores leading '<' and trailing '>'

This simplifies our code a bit, and hopefully in public-inbox, too.
There is little practical danger of a Message-ID not having '<>',
and having '<>' in all URLs is annoying.
This breaks compatibility.  Fortunately, this project is not
publically announced, yet.

8 years agolib/Ssoma/Git*: clarify copyright on original git code
Eric Wong [Tue, 8 Apr 2014 08:37:21 +0000 (08:37 +0000)]
lib/Ssoma/Git*: clarify copyright on original git code

I cannot change the license of git proper, of course.

8 years agoINSTALL: update documentation
Eric Wong [Tue, 8 Apr 2014 07:43:50 +0000 (07:43 +0000)]
INSTALL: update documentation

public-inbox (server daemon) is a separate project now
and ssoma is fairly generic.

8 years agot/all: IPC::Run is optional in tests
Eric Wong [Tue, 8 Apr 2014 07:37:50 +0000 (07:37 +0000)]
t/all: IPC::Run is optional in tests

We do not force users to install libraries only needed for testing.

8 years agouse "Message-ID" capitalization consistently
Eric Wong [Tue, 8 Apr 2014 01:44:32 +0000 (01:44 +0000)]
use "Message-ID" capitalization consistently

Technically it's case-insensitive; but "ID" is short for
"identifier" or "identification", and not a fish or a part
of a person's psyche.

8 years agossoma-mda: duplicate prevention
Eric Wong [Tue, 8 Apr 2014 01:36:53 +0000 (01:36 +0000)]
ssoma-mda: duplicate prevention

This is mainly for public-inbox, as duplicate message IDs are
usually evidence something is suspicious or a misconfigured SMTP
server/client.

8 years agoinitial commit
Eric Wong [Thu, 27 Mar 2014 20:38:26 +0000 (20:38 +0000)]
initial commit