DaB. | 1 Jan 15:58 2012

Happy New Year 2012

Hello all,

we are should be in 2012 now, so I would like to wish you all a Happy New 
Year. Let us hope that the toolserver will run smoothly, stable and fast in 
this year, that it will be extended as far as it is needed, that new and old 
users will write wonderfull tools, that people continue to use new and old 
tools and that the roots will not cause more trouble than needed.

Happy New Year!

Sincerly,
DaB.

--

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885
Hello all,

we are should be in 2012 now, so I would like to wish you all a Happy New 
Year. Let us hope that the toolserver will run smoothly, stable and fast in 
this year, that it will be extended as far as it is needed, that new and old 
users will write wonderfull tools, that people continue to use new and old 
tools and that the roots will not cause more trouble than needed.

Happy New Year!

Sincerly,
DaB.

(Continue reading)

Marlen Caemmerer | 10 Jan 10:36 2012
Picon

Regular Maintenance on January 11th

Hello all,

like already announced after the last maintenance, the next maintenance will 
be at

Wednesday, January 11, between 19:00 and 1:00 UTC.

The roots will collect what they will do at [1] until Sunday night. If you 
have something for us to do (like a software-update) please open a bugreport 
at JIRA and make sure to add the label "maintaince-window" until Sunday noon.

Cheers
 	Marlen

Dennis Tobar | 10 Jan 12:34 2012
Picon

Re: Regular Maintenance on January 11th

Hi:
there isn't link in the mail or I don't see it :)

Dennis Tobar
Superzerocool

El 10/01/2012 06:39, "Marlen Caemmerer" <marlen.caemmerer <at> wikimedia.de> escribió:
Hello all,

like already announced after the last maintenance, the next maintenance will
be at

Wednesday, January 11, between 19:00 and 1:00 UTC.

The roots will collect what they will do at [1] until Sunday night. If you
have something for us to do (like a software-update) please open a bugreport
at JIRA and make sure to add the label "maintaince-window" until Sunday noon.

Cheers
       Marlen

_______________________________________________
Toolserver-l mailing list (Toolserver-l <at> lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
<div>
<p>Hi:<br>
there isn't link in the mail or I don't see it :)</p>
<p>Dennis Tobar<br>
Superzerocool</p>
<div class="gmail_quote">El 10/01/2012 06:39, "Marlen Caemmerer" &lt;<a href="mailto:marlen.caemmerer <at> wikimedia.de">marlen.caemmerer <at> wikimedia.de</a>&gt; escribi&oacute;:<br type="attribution"><blockquote class="gmail_quote">
Hello all,<br><br>
like already announced after the last maintenance, the next maintenance will<br>
be at<br><br>
Wednesday, January 11, between 19:00 and 1:00 UTC.<br><br>
The roots will collect what they will do at [1] until Sunday night. If you<br>
have something for us to do (like a software-update) please open a bugreport<br>
at JIRA and make sure to add the label "maintaince-window" until Sunday noon.<br><br>
Cheers<br>
 &nbsp; &nbsp; &nbsp; &nbsp;Marlen<br><br>
_______________________________________________<br>
Toolserver-l mailing list (<a href="mailto:Toolserver-l <at> lists.wikimedia.org">Toolserver-l <at> lists.wikimedia.org</a>)<br><a href="https://lists.wikimedia.org/mailman/listinfo/toolserver-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/toolserver-l</a><br>
Posting guidelines for this list: <a href="https://wiki.toolserver.org/view/Mailing_list_etiquette" target="_blank">https://wiki.toolserver.org/view/Mailing_list_etiquette</a><br>
</blockquote>
</div>
</div>
Marlen Caemmerer | 10 Jan 15:41 2012
Picon

Re: Regular Maintenance on January 11th


Hey,

there is the link to the planned maintenance tasks:
https://wiki.toolserver.org/view/Admin:Next_maintenance .

Cheers
 	Marlen

Dmitry | 12 Jan 05:28 2012
Picon

fatal: relocation error

Hello all, 

After yesterday's maintenance all my bots, that launched with mono, didn't work. Last successful run was
at 21:15 (UTC). Since 21:25 (UTC) I have received a lot of mails from Cron Daemon with similar content:
>> ld.so.1: mono: fatal: relocation error: file /opt/mono/bin/mono: symbol locale_charset:
referenced symbol not found
>> Killed

Can you explain what is it and how to solve this problem?

Dmitry.

Maarten Dammers | 14 Jan 22:21 2012
Picon

interwiki.py

Hi everyone,

Nightshade was a bit slow so I typed "top -c". I was amazed to see that 
almost all the top processes seem to be interwiki related 
(interwiki.py). Same seems to be the case at willow. Normally I wouldn't 
really care, we have the servers so we should use them, but now the 
login servers seem to be overloaded. Isn't this a bit too many interwiki 
bots?

Maarten

Nickanc Wikipedia | 15 Jan 00:32 2012
Picon

Re: interwiki.py

In my opinion, the problem is not how many bots are working, but that
interwiki.py seems to use to overuse memory space. For example, my
interwiki.py was running, it was spending 982 megabyte and it was
killed. You may find a verbose log of its work at
http://toolserver.org/~nickanc/interwiki.log .

Nickanc

2012/1/14 Maarten Dammers <maarten <at> mdammers.nl>:
> Hi everyone,
>
> Nightshade was a bit slow so I typed "top -c". I was amazed to see that
> almost all the top processes seem to be interwiki related
> (interwiki.py). Same seems to be the case at willow. Normally I wouldn't
> really care, we have the servers so we should use them, but now the
> login servers seem to be overloaded. Isn't this a bit too many interwiki
> bots?
>
> Maarten
>
>
> _______________________________________________
> Toolserver-l mailing list (Toolserver-l <at> lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette

Merlijn van Deen | 15 Jan 01:31 2012
Picon

Re: interwiki.py

On 15 January 2012 00:32, Nickanc Wikipedia <nickanc.wiki <at> gmail.com> wrote:
In my opinion, the problem is not how many bots are working, but that
interwiki.py seems to use to overuse memory space. For example, my
interwiki.py was running, it was spending 982 megabyte and it was
killed. You may find a verbose log of its work at
http://toolserver.org/~nickanc/interwiki.log .

No, that is not the problem. Multichill was referring to CPU usage, not memory usage. And although interwiki.py in general is using a large amount of memory, your specific case has a different origin (being the use of the ReferringPageGenerator, which results in a memory leak).

You may be able to partially mitigate your problem by using
interwiki_contents_on_disk = True,
but this will not solve the actual memory leak - it will only release memory used by the page contents.

If you'd like to discuss details on your problem, please mail to the pywikipedia mailing list <pywikipedia-l <at> lists.wikimedia.org> or visit on IRC.

Merlijn
<div><div class="gmail_quote">On 15 January 2012 00:32, Nickanc Wikipedia <span dir="ltr">&lt;<a href="mailto:nickanc.wiki <at> gmail.com">nickanc.wiki <at> gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote">

In my opinion, the problem is not how many bots are working, but that<br>
interwiki.py seems to use to overuse memory space. For example, my<br>
interwiki.py was running, it was spending 982 megabyte and it was<br>
killed. You may find a verbose log of its work at<br><a href="http://toolserver.org/~nickanc/interwiki.log" target="_blank">http://toolserver.org/~nickanc/interwiki.log</a> .<br><br>
</blockquote>
<div>No, that is not the problem. Multichill was referring to CPU usage, not memory usage. And although interwiki.py in general is using a large amount of memory, your specific case has a different origin (being the use of the&nbsp;ReferringPageGenerator, which results in a memory leak).</div>

<div><br></div>
<div>You may be able to partially mitigate your problem by using</div>
<div>interwiki_contents_on_disk = True,</div>
<div>but this will not solve the actual memory leak - it will only release memory used by the page contents.</div>

<div><br></div>
<div>If you'd like to discuss details on your problem, please mail to the pywikipedia mailing list &lt;<a href="mailto:pywikipedia-l <at> lists.wikimedia.org">pywikipedia-l <at> lists.wikimedia.org</a>&gt; or visit on IRC.</div>

<div><br></div>
<div>Merlijn</div>
</div></div>
Chris Grant | 15 Jan 03:47 2012
DaB. | 15 Jan 17:38 2012

Re: interwiki.py

Hello,
At Sunday 15 January 2012 17:13:26 DaB. wrote:
> Isn't this a bit too many interwiki 
> bots?

yes, there are, although not the cpu-load is the problem but the memory-usage. 
The best solution would be if the mediawiki-devs finaly get rid of interwiki-
links in the article-text of course, but I have the fealing thta will not 
happen soon. The second best solution would be, if the interwiki.py would fix 
their code, but there I have also the fealing that will take some time.

So here is my plan to fix the problem on our (the TS) side:
1.) I create a MMP called interwiki-bot (or something).
2.) YOU (the ts-users) choose (by election, by appointing, by playing "Trip to 
Jerusalem",  I don't care) 5 of you who will become member of that MMP until 
15th February. Only rule: 1 of the 5 has to be an active user of a non-
wikipedia-project (like wikisource or wiktionary or so).
3.) The members of the MMP create a wikimedia-project-account (like "ts-
interwikibot" or something) and request global-bot-status until 1. April.
4.) After 2. April no-one is allowed to run a interwiki-bot except the MMP.

Any problems with my plan?

Sincerly,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885
Hello,
At Sunday 15 January 2012 17:13:26 DaB. wrote:
> Isn't this a bit too many interwiki 
> bots?

yes, there are, although not the cpu-load is the problem but the memory-usage. 
The best solution would be if the mediawiki-devs finaly get rid of interwiki-
links in the article-text of course, but I have the fealing thta will not 
happen soon. The second best solution would be, if the interwiki.py would fix 
their code, but there I have also the fealing that will take some time.

So here is my plan to fix the problem on our (the TS) side:
1.) I create a MMP called interwiki-bot (or something).
2.) YOU (the ts-users) choose (by election, by appointing, by playing "Trip to 
Jerusalem",  I don't care) 5 of you who will become member of that MMP until 
15th February. Only rule: 1 of the 5 has to be an active user of a non-
wikipedia-project (like wikisource or wiktionary or so).
3.) The members of the MMP create a wikimedia-project-account (like "ts-
interwikibot" or something) and request global-bot-status until 1. April.
4.) After 2. April no-one is allowed to run a interwiki-bot except the MMP.

Any problems with my plan?

Sincerly,
DaB.

--

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

Gmane