Happy New Year 2012

Hello all,

we are should be in 2012 now, so I would like to wish you all a Happy New 
Year. Let us hope that the toolserver will run smoothly, stable and fast in 
this year, that it will be extended as far as it is needed, that new and old 
users will write wonderfull tools, that people continue to use new and old 
tools and that the roots will not cause more trouble than needed.

Happy New Year!

Sincerly,
DaB.

--

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

Hello all,

we are should be in 2012 now, so I would like to wish you all a Happy New 
Year. Let us hope that the toolserver will run smoothly, stable and fast in 
this year, that it will be extended as far as it is needed, that new and old 
users will write wonderfull tools, that people continue to use new and old 
tools and that the roots will not cause more trouble than needed.

Happy New Year!

Sincerly,
DaB.

Re: Regular Maintenance on January 11th

<div>
<p>Hi:<br>
there isn't link in the mail or I don't see it :)</p>
<p>Dennis Tobar<br>
Superzerocool</p>
<div class="gmail_quote">El 10/01/2012 06:39, "Marlen Caemmerer" &lt;<a href="mailto:marlen.caemmerer <at> wikimedia.de">marlen.caemmerer <at> wikimedia.de</a>&gt; escribi&oacute;:<br type="attribution"><blockquote class="gmail_quote">
Hello all,<br><br>
like already announced after the last maintenance, the next maintenance will<br>
be at<br><br>
Wednesday, January 11, between 19:00 and 1:00 UTC.<br><br>
The roots will collect what they will do at [1] until Sunday night. If you<br>
have something for us to do (like a software-update) please open a bugreport<br>
at JIRA and make sure to add the label "maintaince-window" until Sunday noon.<br><br>
Cheers<br>
 &nbsp; &nbsp; &nbsp; &nbsp;Marlen<br><br>
_______________________________________________<br>
Toolserver-l mailing list (<a href="mailto:Toolserver-l <at> lists.wikimedia.org">Toolserver-l <at> lists.wikimedia.org</a>)<br><a href="https://lists.wikimedia.org/mailman/listinfo/toolserver-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/toolserver-l</a><br>
Posting guidelines for this list: <a href="https://wiki.toolserver.org/view/Mailing_list_etiquette" target="_blank">https://wiki.toolserver.org/view/Mailing_list_etiquette</a><br>
</blockquote>
</div>
</div>

Re: Regular Maintenance on January 11th

Hey,

there is the link to the planned maintenance tasks:
https://wiki.toolserver.org/view/Admin:Next_maintenance .

Cheers
 	Marlen

fatal: relocation error

Hello all, 

After yesterday's maintenance all my bots, that launched with mono, didn't work. Last successful run was
at 21:15 (UTC). Since 21:25 (UTC) I have received a lot of mails from Cron Daemon with similar content:
>> ld.so.1: mono: fatal: relocation error: file /opt/mono/bin/mono: symbol locale_charset:
referenced symbol not found
>> Killed

Can you explain what is it and how to solve this problem?

Dmitry.

interwiki.py

Hi everyone,

Nightshade was a bit slow so I typed "top -c". I was amazed to see that 
almost all the top processes seem to be interwiki related 
(interwiki.py). Same seems to be the case at willow. Normally I wouldn't 
really care, we have the servers so we should use them, but now the 
login servers seem to be overloaded. Isn't this a bit too many interwiki 
bots?

Maarten

Re: interwiki.py

In my opinion, the problem is not how many bots are working, but that
interwiki.py seems to use to overuse memory space. For example, my
interwiki.py was running, it was spending 982 megabyte and it was
killed. You may find a verbose log of its work at
http://toolserver.org/~nickanc/interwiki.log .

Nickanc

2012/1/14 Maarten Dammers <maarten <at> mdammers.nl>:
> Hi everyone,
>
> Nightshade was a bit slow so I typed "top -c". I was amazed to see that
> almost all the top processes seem to be interwiki related
> (interwiki.py). Same seems to be the case at willow. Normally I wouldn't
> really care, we have the servers so we should use them, but now the
> login servers seem to be overloaded. Isn't this a bit too many interwiki
> bots?
>
> Maarten
>
>
> _______________________________________________
> Toolserver-l mailing list (Toolserver-l <at> lists.wikimedia.org)
> https://lists.wikimedia.org/mailman/listinfo/toolserver-l
> Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: interwiki.py

<div><div class="gmail_quote">On 15 January 2012 00:32, Nickanc Wikipedia <span dir="ltr">&lt;<a href="mailto:nickanc.wiki <at> gmail.com">nickanc.wiki <at> gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote">

In my opinion, the problem is not how many bots are working, but that<br>
interwiki.py seems to use to overuse memory space. For example, my<br>
interwiki.py was running, it was spending 982 megabyte and it was<br>
killed. You may find a verbose log of its work at<br><a href="http://toolserver.org/~nickanc/interwiki.log" target="_blank">http://toolserver.org/~nickanc/interwiki.log</a> .<br><br>
</blockquote>
<div>No, that is not the problem. Multichill was referring to CPU usage, not memory usage. And although interwiki.py in general is using a large amount of memory, your specific case has a different origin (being the use of the&nbsp;ReferringPageGenerator, which results in a memory leak).</div>

<div><br></div>
<div>You may be able to partially mitigate your problem by using</div>
<div>interwiki_contents_on_disk = True,</div>
<div>but this will not solve the actual memory leak - it will only release memory used by the page contents.</div>

<div><br></div>
<div>If you'd like to discuss details on your problem, please mail to the pywikipedia mailing list &lt;<a href="mailto:pywikipedia-l <at> lists.wikimedia.org">pywikipedia-l <at> lists.wikimedia.org</a>&gt; or visit on IRC.</div>

<div><br></div>
<div>Merlijn</div>
</div></div>

Re: interwiki.py

<div>
<div>There has been some similar discussion in the past, on how to deal with interwiki bots.</div>
<div><a href="http://lists.wikimedia.org/pipermail/toolserver-l/2010-November/003660.html">http://lists.wikimedia.org/pipermail/toolserver-l/2010-November/003660.html</a></div>
<div><a href="http://lists.wikimedia.org/pipermail/toolserver-l/2010-December/003698.html">http://lists.wikimedia.org/pipermail/toolserver-l/2010-December/003698.html</a></div>
<div><a href="http://lists.wikimedia.org/pipermail/toolserver-l/2011-January/003847.html">http://lists.wikimedia.org/pipermail/toolserver-l/2011-January/003847.html</a></div>
<div><br></div>
<div>- Chris</div>
<br>
</div>

Re: interwiki.py

Hello,
At Sunday 15 January 2012 17:13:26 DaB. wrote:
> Isn't this a bit too many interwiki 
> bots?

yes, there are, although not the cpu-load is the problem but the memory-usage. 
The best solution would be if the mediawiki-devs finaly get rid of interwiki-
links in the article-text of course, but I have the fealing thta will not 
happen soon. The second best solution would be, if the interwiki.py would fix 
their code, but there I have also the fealing that will take some time.

So here is my plan to fix the problem on our (the TS) side:
1.) I create a MMP called interwiki-bot (or something).
2.) YOU (the ts-users) choose (by election, by appointing, by playing "Trip to 
Jerusalem",  I don't care) 5 of you who will become member of that MMP until 
15th February. Only rule: 1 of the 5 has to be an active user of a non-
wikipedia-project (like wikisource or wiktionary or so).
3.) The members of the MMP create a wikimedia-project-account (like "ts-
interwikibot" or something) and request global-bot-status until 1. April.
4.) After 2. April no-one is allowed to run a interwiki-bot except the MMP.

Any problems with my plan?

Sincerly,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

Hello,
At Sunday 15 January 2012 17:13:26 DaB. wrote:
> Isn't this a bit too many interwiki 
> bots?

yes, there are, although not the cpu-load is the problem but the memory-usage. 
The best solution would be if the mediawiki-devs finaly get rid of interwiki-
links in the article-text of course, but I have the fealing thta will not 
happen soon. The second best solution would be, if the interwiki.py would fix 
their code, but there I have also the fealing that will take some time.

So here is my plan to fix the problem on our (the TS) side:
1.) I create a MMP called interwiki-bot (or something).
2.) YOU (the ts-users) choose (by election, by appointing, by playing "Trip to 
Jerusalem",  I don't care) 5 of you who will become member of that MMP until 
15th February. Only rule: 1 of the 5 has to be an active user of a non-
wikipedia-project (like wikisource or wiktionary or so).
3.) The members of the MMP create a wikimedia-project-account (like "ts-
interwikibot" or something) and request global-bot-status until 1. April.
4.) After 2. April no-one is allowed to run a interwiki-bot except the MMP.

Any problems with my plan?

Sincerly,
DaB.

--

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

Re: interwiki.py

<div><div dir="ltr">
As an interwiki bot runner myself, I find this plan a little too constrained. Many of us run the interwiki bots on many different configuration and with this MMP project created, some configurations that we use would then not be available with this new plan. I can't think of much, but seeing from top -c, I can tell that the other bot runners run their bots differently from mine.<div><br></div>
<div>Personally, I rather we wait for the Pywikipedia devs to fix that script, install more memory for interwiki bots, or create another custom login server just for running interwiki bots.</div>
<div><br></div>
<div>Your plan is generally okay, just about having only 5 people to run this project, from many many bot operators, its quite hard to choose. Its best if people don't run multiple interwiki bot
 s for one project (especially enwiktionary, which has an overload of interwiki bots).<br><br>Regards,<br><div>Hydriz</div>
<br><br><div>
<div></div>From: WP <at> daniel.baur4.info<br>To: toolserver-l <at> lists.wikimedia.org<br>Date: Sun, 15 Jan 2012 17:38:40 +0100<br>Subject: Re: [Toolserver-l] interwiki.py<br><br>Hello,<br>At Sunday 15 January 2012 17:13:26 DaB. wrote:<br>&gt; Isn't this a bit too many interwiki <br>&gt; bots?<br><br>yes, there are, although not the cpu-load is the problem but the memory-usage. <br>The best solution would be if the mediawiki-devs finaly get rid of interwiki-<br>links in the article-text of course, but I have the fealing thta will not <br>happen soon. The second best solution would be, if the interwiki.py would fix <br>their code, but
  there I have also the fealing that will take some time.<br><br>So here is my plan to fix the problem on our (the TS) side:<br>1.) I create a MMP called interwiki-bot (or something).<br>2.) YOU (the ts-users) choose (by election, by appointing, by playing "Trip to <br>Jerusalem",  I don't care) 5 of you who will become member of that MMP until <br>15th February. Only rule: 1 of the 5 has to be an active user of a non-<br>wikipedia-project (like wikisource or wiktionary or so).<br>3.) The members of the MMP create a wikimedia-project-account (like "ts-<br>interwikibot" or something) and request global-bot-status until 1. April.<br>4.) After 2. April no-one is allowed to run a interwiki-bot except the MMP.<br><br>Any problems with my plan?<br><br>Sincerly,<br>DaB.<br><br>-- <br>Userpag
 e: [[:w:de:User:DaB.]] &#8213; PGP: 2B255885<br><br>_______________________________________________
Toolserver-l mailing list (Toolserver-l <at> lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette</div>
</div> 		 	   		  </div></div>