Richard Barrett | 1 Nov 2003 01:52
Picon
Favicon

Re: Problem with archrunner using large %'s of cpu (read faq & archives)


On Friday, October 31, 2003, at 11:59  pm, Brad Knowles wrote:

> At 6:21 PM -0500 2003/10/31, Scott Lambert wrote:
>
>>  I haven't looked at the code yet, and probably won't (ENOTIME), but  
>> it
>>  almost sounds to me like it's not pruning it's list of handled  
>> messages
>>  and has to walk all of them each time.  I would have expected queue
>>  handling to get faster as the queue got smaller due to fewer files
>>  in the directory that it needs to search through.  Maybe it's just a
>>  function of the python datastructure being used.
>
> 	If it's using files as the queue mechanism, then deleting a file  
> simply marks the entry in the directory as "available", and it still  
> takes just at long to scan the directory afterwards as it did before.
>
> 	This is a known problem with many MTAs handling large amounts of  
> messages, and is one reason why you should use a hashed directory  
> scheme for your mail queue (a la postfix), or you should periodically  
> stop the MTA, move the mail queue directory aside, create a new mail  
> queue directory (with appropriate ownership and permissions), then  
> move what messages may remain from the old queue back into the new one  
> (or fire up queue runners to clear the old queue while the new one is  
> being used for new mail).
>

In MM 2.1.3, the relevant code is in  
$prefix/Mailman/Queue/Switchboard.py function files() starting at line  
(Continue reading)

Michael Wood | 1 Nov 2003 02:52

Would like to move or remove some headers

All of our lists are closed and our members are internal; they don't need 
or want to subscribe or unsubscribe, etc.

As it is, the headers and the subscribe/unsubscribe, etc. lines are filling 
the page. We'd like to either remove them or move them below the message 
area. Is there a way to do this? Does it require programming? If so where 
can I hire someone to make the modification?

Mike

Scott Lambert | 1 Nov 2003 03:29

Re: Problem with archrunner using large %'s of cpu (read faq & archives)

On Sat, Nov 01, 2003 at 12:59:24AM +0100, Brad Knowles wrote:
> At 6:21 PM -0500 2003/10/31, Scott Lambert wrote:
> > I haven't looked at the code yet, and probably won't (ENOTIME), but
> > it almost sounds to me like it's not pruning it's list of handled
> > messages and has to walk all of them each time.  I would have
> > expected queue handling to get faster as the queue got smaller due
> > to fewer files in the directory that it needs to search through.
> > Maybe it's just a function of the python datastructure being used.
>
>       If it's using files as the queue mechanism, then deleting a file
> simply marks the entry in the directory as "available", and it still
> takes just at long to scan the directory afterwards as it did before.

If we were talking about more than 10,000 files, I might buy it.  But we
are talking about 1300 files.  Also the processing goes something like
O(n), in reverse, slower as it processes the files in the directory.  I
might buy it staying slow if it started slow but it doesn't.

--

-- 
Scott Lambert                    KC5MLE                       Unix SysAdmin
lambert <at> lambertfam.org      

Alexis | 1 Nov 2003 03:38
Picon

question about destination address

Im running mailman 2.1.3 at my box, and i need to change a setting related
to destination address, ive been reading and trying but i cannot get it
working.

I have a list called test.

when i send a post to this lists, i need that the destination address in the
msgs that subscribers receive be the real address and not the list address.

Example: my subscriber es bill <at> foo.com, and the list is test.

When bill get his mail, i need bill to see that the To: field is
bill <at> foo.com instead test <at> mydomain.com

How can i achieve this?

Thanks in advance.

--
A man in black on a snow white horse,
A pointless life has run its course,
The red rimmed eyes, the tears still run
As he fades into the setting sun

Jon Carnes | 1 Nov 2003 03:50
Picon

Re: Would like to move or remove some headers

On Fri, 2003-10-31 at 20:52, Michael Wood wrote:
> All of our lists are closed and our members are internal; they don't need 
> or want to subscribe or unsubscribe, etc.
> 
> As it is, the headers and the subscribe/unsubscribe, etc. lines are filling 
> the page. We'd like to either remove them or move them below the message 
> area. Is there a way to do this? Does it require programming? If so where 
> can I hire someone to make the modification?
> 
> Mike
> 
No programming at all - if you are using version 2.1.x. The toggle is in
the web-admin on the General options page (near the bottom).

If your using 2.0, the archives have it laid out very nicely. It takes
all of 5 minutes to remove the headers.

Good Luck - Jon Carnes

Jon Carnes | 1 Nov 2003 03:54
Picon

Re: Problem with archrunner using large %'s of cpu (read faq & archives)

On Fri, 2003-10-31 at 21:29, Scott Lambert wrote:
> On Sat, Nov 01, 2003 at 12:59:24AM +0100, Brad Knowles wrote:
> > At 6:21 PM -0500 2003/10/31, Scott Lambert wrote:
> > > I haven't looked at the code yet, and probably won't (ENOTIME), but
> > > it almost sounds to me like it's not pruning it's list of handled
> > > messages and has to walk all of them each time.  I would have
> > > expected queue handling to get faster as the queue got smaller due
> > > to fewer files in the directory that it needs to search through.
> > > Maybe it's just a function of the python datastructure being used.
> >
> >       If it's using files as the queue mechanism, then deleting a file
> > simply marks the entry in the directory as "available", and it still
> > takes just at long to scan the directory afterwards as it did before.
> 
> If we were talking about more than 10,000 files, I might buy it.  But we
> are talking about 1300 files.  Also the processing goes something like
> O(n), in reverse, slower as it processes the files in the directory.  I
> might buy it staying slow if it started slow but it doesn't.
>  
To me it sounds like a memory problem.

I wonder how fast we can fix it?

Jon Carnes | 1 Nov 2003 03:56
Picon

Re: question about destination address

On Fri, 2003-10-31 at 21:38, Alexis wrote:
> Im running mailman 2.1.3 at my box, and i need to change a setting related
> to destination address, ive been reading and trying but i cannot get it
> working.
> 
> I have a list called test.
> 
> when i send a post to this lists, i need that the destination address in the
> msgs that subscribers receive be the real address and not the list address.
> 
> Example: my subscriber es bill <at> foo.com, and the list is test.
> 
> When bill get his mail, i need bill to see that the To: field is
> bill <at> foo.com instead test <at> mydomain.com
> 
> How can i achieve this?
> 
> Thanks in advance.
> 
Read the FAQ and look for VERP (or Personalization). It's laid out in
HowTo fashion - step by step.

Jon Carnes

Paul H Byerly | 1 Nov 2003 05:16

Re: optionsurl not using full domain

Michael Alberghini wrote:
>For some reason my new subscriber messages are going out with only
>my hostname, not the full domain name in the urls.
>
>For example the welcome messages tells people to click
>
>http://mailbox/mailman/listinfo/galileo
>
>instead of
>
>http://mailbox.gsu.edu/mailman/listinfo/galileo
>
>I can't find a way to set the optionsurl variable to the full domain name.

      It should be the full domain - I would say there is something set 
wrong someplace.  The web links to the list info page, and to your 
administrative interface have the same error.  I checked a few other lists 
on the server and they do not have this problem, so it seems to be 
something that was set or changed for this list.

<>< Paul 

Anders Norrbring | 1 Nov 2003 11:52

Another CRON message I don't know what it means...

Can somebody please tell me what possibly could be wrong in my 2.1.3 setup?

I keep getting this message from the CRON daemon:

Traceback (most recent call last):
  File "/usr/lib/mailman/cron/nightly_archives", line 126, in ?
    main()
  File "/usr/lib/mailman/cron/nightly_archives", line 86, in main
    fp = open(mm_cfg.EDITED_ARCHIVES_FILE)
AttributeError: 'module' object has no attribute 'EDITED_ARCHIVES_FILE'

Later,

Anders Norrbring

Richard Barrett | 1 Nov 2003 14:48
Picon
Favicon

Re: Another CRON message I don't know what it means...


On Saturday, November 1, 2003, at 10:52  am, Anders Norrbring wrote:

> Can somebody please tell me what possibly could be wrong in my 2.1.3 
> setup?
>
> I keep getting this message from the CRON daemon:
>
>
> Traceback (most recent call last):
>   File "/usr/lib/mailman/cron/nightly_archives", line 126, in ?
>     main()
>   File "/usr/lib/mailman/cron/nightly_archives", line 86, in main
>     fp = open(mm_cfg.EDITED_ARCHIVES_FILE)
> AttributeError: 'module' object has no attribute 'EDITED_ARCHIVES_FILE'
>
>

I cannot find a cron/nightly_archives script as part of the standard MM 
2.0.13 or MM 2.1.3 distributions but plainly you have one installed, 
but from where? I thought you said in a previous post you had installed 
from source? Did you install any patches which might have added this 
cron script and the crontab entry?

Whatever the source of that script, it appears to depend on an extra MM 
config variable called EDITED_ARCHIVES_FILE having also been added.

Without the source of the script in order to determine its function and 
the semantic of the config variable it is difficult to offer any 
additional advice.
(Continue reading)


Gmane