headers
Mark Sapiro | 1 Mar 2008 02:01
Favicon

Re: Regular expressions in list config files?

bernholdtde <at> ornl.gov wrote:
>
>Here's the result: In applying header_filter_rules, it looks like the
>entire set of headers is being treated as a single multiline string.

That is correct.

>For reasons I don't entirely understand (remember I'm not a python
>expert), "^" and "$" are not matching the beginning and end of
>individual lines of a multiline string, even though I interpreted
>http://www.python.org/doc/current/lib/matching-searching.html to say
>that they should, and a colleague who's very familiar with Python also
>thought they should.

It works for me. I just set a header_filter_rules regexp on a test list
to "^subject:.*hello.*$" with a reject action, and my test post with

Subject: test Hello in subject

was rejected with "Message rejected by filter rule match". In case
you're wondering, the Subject: was the 15th of 21 headers in the
message delivered to Mailman.

I then tested the regexp "^subject:\s+yes\s*$" with a post with

Subject: yes

and it too was caught.

>If I don't have the line beginning/ending constraints in the regex,
(Continue reading)

Permalink | Reply | 2 comments |
headers
Matt Morgan | 1 Mar 2008 03:30
Picon

any way to batch unsubscribe notifications?

I'm working for a friend who asked me to set up mailman (2.1.9 on
Fedora Core 7) to replace a home-grown list server for one of his
clients. It's a small non-profit that has a little web-based
membership admin tool. For various reasons, they update the mailman
list with an export from the membership db. I have that working with
sync_members on a nightly basis. They then send out messages once a
week or so (the list is not a discussion, just for announcements).

They need a way to know when an address is bad, so they can go back
and fix or remove those bad addresses, in the membership db.

What I've done so far, which works almost perfectly, is to set up
automatic bounce processing to unsubscribe an address (with no
warnings) when its bounce score is 1.0, i.e., after any fatal error.
Then I have mailman notify the list admin of the unsubscribe, so he
can go and make the correction in the database.

The only problem is that a lot of their addresses are collected
manually, so there can be a lot of failures. Mailman sends these one
at a time, i.e. one unsubscribed address per notification message, and
not really all at once (although I'm sure that depends on how quickly
the bounce message comes back, too). Is it possible to get mailman to
batch the unsubscribed addresses once per day, and send them all out
in a single daily report? Or is there some other way to do this that
would work better than what I've come up with?

Thanks a lot,
Matt
(Continue reading)

Permalink | Reply | 2 comments |
headers
Mark Sapiro | 1 Mar 2008 04:09
Favicon

Re: any way to batch unsubscribe notifications?

Matt Morgan wrote:
>
>The only problem is that a lot of their addresses are collected
>manually, so there can be a lot of failures. Mailman sends these one
>at a time, i.e. one unsubscribed address per notification message, and
>not really all at once (although I'm sure that depends on how quickly
>the bounce message comes back, too). Is it possible to get mailman to
>batch the unsubscribed addresses once per day, and send them all out
>in a single daily report? Or is there some other way to do this that
>would work better than what I've come up with?

You could turn the notices to the admin off and run a daily cron to
generate a summary from Mailman's subscribe log. All the bounce
deletes should have entries similar to

Feb 20 10:00:24 2008 (10510) listname: deleted user <at> example.com;
disabled address

You can also work off the bounce log which will have entries like

Feb 20 10:00:24 2008 (10510) listname: user <at> example.com disabling due
to bounce score 1.0 >= 1.0
Feb 20 10:00:24 2008 (10510) listname: user <at> example.com deleted after
exhausting notices

--

-- 
Mark Sapiro <mark <at> msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan
(Continue reading)

Permalink | Reply | 1 comment |
headers
Mark Sapiro | 1 Mar 2008 04:53
Favicon

Re: Regular expressions in list config files?

Mark Sapiro wrote:

>bernholdtde <at> ornl.gov wrote:
>>
>>Here's the result: In applying header_filter_rules, it looks like the
>>entire set of headers is being treated as a single multiline string.
>
>
>That is correct.
>
>
>>For reasons I don't entirely understand (remember I'm not a python
>>expert), "^" and "$" are not matching the beginning and end of
>>individual lines of a multiline string, even though I interpreted
>>http://www.python.org/doc/current/lib/matching-searching.html to say
>>that they should, and a colleague who's very familiar with Python also
>>thought they should.
>
>
>It works for me.

I suspect you have an old Mailman version. Prior to Mailman 2.1.7, the
regular expression search was not multiline and therefore '^' and '$'
would only match the beginning and end respectively of the string of
all the headers.

I have updated FAQs 3.32 (again) and 3.51 to note the version
dependence.

--

--
(Continue reading)

Permalink | Reply | 1 comment |
headers
Brad Knowles | 1 Mar 2008 04:55
Favicon
Gravatar

Re: Web Interface for creating lists

On 2/29/08, Robert Everson wrote:

>  I would like a web interface for users to create lists, without giving
>  them access to the master mailman password.

You can have a separate list creator password.  No problem.

--

-- 
Brad Knowles <brad <at> shub-internet.org>
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Permalink | Reply | 0 comments |
headers
Perry M Lynch | 1 Mar 2008 10:45
Picon
Favicon

In need of help. Trying to recover from a serious buffer overflow

I'm list admin/moderator of a 450+ member list that ran into trouble yesterday.  
First, we're running Mailman 2.1.8 on a current release of OpenBSD. And it's been running for 2+ years with
no issues, until this past Friday morning when the user db became corrupt.

Content filtering is set to remove all attachments and graphics, and we'd determined that more than 15 CCs
would hold an inbound post to moderate. No message of more than 60 kb will be accepted. 

On Wednesday, a member submitted a large email with poor formatting to the list. And it had enough CCs
attached to it that it caused a buffer overflow, which resulted in the message being self-approved for the
list. Suddenly the server began repeating itself as it tried to process this huge message over and over
again. It became a vicious cycle - as the one message finally repeated out, other messages that were caught
in the queue became ammunition for the server to repeat. Prior to the system crash, more than 6100
duplicate messages were sent to 450 members, at an estimated peak rate of about 20,000 outbound messages
per half hour. 

The user db became corrupt, and my server admin and I have worked to get things operational again. At this
point, the list is supposedly behaving itself, yet no messages are actually being sent from the server. I
don't have access to the raw logs, but here is the snippet of discussion about the restoration of the user database.

Jason: here's what I see on the server.

    # pwd
    /var/spool/mailman/lists/cyberscots
    # file * 
    config.pck:      data
    config.pck.last: data
    digest.mbox:     UTF-8 Unicode mail text
    en:              setgid directory
    pending.pck:     ASCII text
    request.pck:     data
(Continue reading)

Permalink | Reply | 1 comment |
headers
Mark Sapiro | 1 Mar 2008 17:18
Favicon

Re: In need of help. Trying to recover from a seriousbuffer overflow

Perry M Lynch wrote:
>
>On Wednesday, a member submitted a large email with poor formatting to the list. And it had enough CCs
attached to it that it caused a buffer overflow, which resulted in the message being self-approved for the list.

Do you have evidence that this is what happened, or is this just
conjecture?

>Suddenly the server began repeating itself as it tried to process this huge message over and over again. It
became a vicious cycle - as the one message finally repeated out, other messages that were caught in the
queue became ammunition for the server to repeat. Prior to the system crash, more than 6100 duplicate
messages were sent to 450 members, at an estimated peak rate of about 20,000 outbound messages per half
hour. 
>
>The user db became corrupt, and my server admin and I have worked to get things operational again. At this
point, the list is supposedly behaving itself, yet no messages are actually being sent from the server. I
don't have access to the raw logs,

Which is unfortunate, because that's what we need to see to determine
what happened. I would like to see Mailman's error, post, qrunner,
smtp, smtp-failure and vette logs from the time of the original
failure to try to see what happened and if there is a Mailman bug of
some kind that allowed it. Can you get these logs from the server
admin?

>but here is the snippet of discussion about the restoration of the user database.
>
>Jason: here's what I see on the server.
>
>    # pwd
(Continue reading)

Permalink | Reply | 0 comments |
headers
Kelly Jones | 1 Mar 2008 22:10
Picon

Whitelisting members of sublists?

I have a list X that contains two sub-lists: Y and Z.

The members of Y can post to Y w/o being held, and the members of Z
can post to Z w/o being held.

However, if a Y member posts to X, his message is held, since he's not
directly on X (he's on Y, which is on X, so he's only indirectly on X).

Is there an easy fix for this? Does Mailman understand the concept of
"sublists", or does it treat sublists as just regular email addresses?
Can I make Mailman think "hey, this email address on this list is
coming to my domain and it's the name of another list I manage-- I'll
treat it special"?

I realize I can whitelist on a one-off basis or even script something
to run in cron, but that's ugly for a general solution.

--
We're just a Bunch Of Regular Guys, a collective group that's trying
to understand and assimilate technology. We feel that resistance to
new ideas and technology is unwise and ultimately futile.
Permalink | Reply | 1 comment |
headers
Mark Sapiro | 1 Mar 2008 23:41
Favicon

Re: Whitelisting members of sublists?

Kelly Jones wrote:

>I have a list X that contains two sub-lists: Y and Z.
>
>The members of Y can post to Y w/o being held, and the members of Z
>can post to Z w/o being held.
>
>However, if a Y member posts to X, his message is held, since he's not
>directly on X (he's on Y, which is on X, so he's only indirectly on X).
>
>Is there an easy fix for this? Does Mailman understand the concept of
>"sublists", or does it treat sublists as just regular email addresses?

Mailman treats sublists as just regular email addresses.

There is a patch at
<http://sourceforge.net/tracker/index.php?func=detail&aid=1220144&group_id=103&atid=300103>
which allows you to put for example,  <at> Y and  <at> Z in list X's
accept_these_nonmembers. This will do what you want, although you may
also need to put  <at> Y in Z's accept_these_nonmembers and vice versa.

This feature is in the base for Mailman 2.1.10 (now in beta).

--

-- 
Mark Sapiro <mark <at> msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan
Permalink | Reply | 0 comments |
headers
Brandon Sussman | 2 Mar 2008 01:27

converting an ezmlm archive


A 15 minute attempt to find doc on how to convert an ezmlm archive to
mailman is not showing much promise.

Without me personally writing a converter, is there any recent wisdom on
doing this?
Permalink | Reply | 1 comment |

Gmane