[wishlist] [patch] Bad wikipages should be skipped

Hello,

I write here because SF is seemingly very down, so no bugtrack and
patchtrack available for me. You may copy it there at will.

So, there are buggy pages all around, like:

WARNING: No character set found
WARNING: No text area found on ia.wikiquote.org/w/index.php?title=Dominio%20public&action=edit.
Maybe the server is down. Retrying in 1 minutes...

I understand that it would be nice to fix 'em all, but I would 
prefer the bot not blocking on them forever. I mean:

--- wikipedia.py.pregrin        2005-12-01 10:00:05.437118797 +0100
+++ wikipedia.py.postgrin       2005-12-01 10:04:56.396430481 +0100
 <at>  <at>  -434,6 +434,9  <at>  <at> 
                 retry_idle_time *= 2
                 if retry_idle_time > 30:
                     retry_idle_time = 30
+                    # faking orgasm, I mean, get outta here --g
+                    output(u"DBG> enough is enough! get outta here!")
+                    return "", isWatched, 'sysop'
                 continue
             i2 = re.search('</textarea>', text).start()
             if i2-i1 < 2:

And I don't even think there is a point in waiting _any time_ for a page
with no text area. I would skip it on 3rd retry, especially when the page
is retrieved fine and fast.

pywikipedia interwiki.py,1.264,1.265

Update of /cvsroot/pywikipediabot/pywikipedia
In directory sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv4585

Modified Files:
	interwiki.py 
Log Message:
Interwiki-bot can be used on nn: Wikipedia again!

Index: interwiki.py
===================================================================
RCS file: /cvsroot/pywikipediabot/pywikipedia/interwiki.py,v
retrieving revision 1.264
retrieving revision 1.265
diff -C2 -d -r1.264 -r1.265
*** interwiki.py	27 Nov 2005 21:08:51 -0000	1.264
--- interwiki.py	3 Dec 2005 16:13:52 -0000	1.265
***************
*** 198,204 ****
      """

- class NynorskException(wikipedia.Error):
-     """Do not do interwiki on the Nynorsk Wikipedia."""
- 
  msg = {
      'af': (u'robot ', u'Bygevoeg', u'Verwyder', u'Verander'),
--- 198,201 ----
***************
*** 1277,1284 ****
                  else:
                      inname.append(arg)

pywikipedia/families wikipedia_family.py,1.41,1.42

Update of /cvsroot/pywikipediabot/pywikipedia/families
In directory sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv4585/families

Modified Files:
	wikipedia_family.py 
Log Message:
Interwiki-bot can be used on nn: Wikipedia again!

Index: wikipedia_family.py
===================================================================
RCS file: /cvsroot/pywikipediabot/pywikipedia/families/wikipedia_family.py,v
retrieving revision 1.41
retrieving revision 1.42
diff -C2 -d -r1.41 -r1.42
*** wikipedia_family.py	24 Oct 2005 20:27:09 -0000	1.41
--- wikipedia_family.py	3 Dec 2005 16:13:52 -0000	1.42
***************
*** 107,111 ****
              'hu': ['en'],
              'lb': self.alphabetic,
!             'nn': self.alphabetic,
              'pl': self.alphabetic,
              'simple': self.alphabetic,
--- 107,111 ----
              'hu': ['en'],
              'lb': self.alphabetic,
!             'nn': ['no','nb','sv','da'] + self.alphabetic,
              'pl': self.alphabetic,
              'simple': self.alphabetic,
***************

Re: [wishlist] [patch] Bad wikipages should be skipped

Peter Gervai wrote:
> Hello,
> 
> I write here because SF is seemingly very down, so no bugtrack and
> patchtrack available for me. You may copy it there at will.
> 
> So, there are buggy pages all around, like:
> 
> WARNING: No character set found
> WARNING: No text area found on ia.wikiquote.org/w/index.php?title=Dominio%20public&action=edit.
Maybe the server is down. Retrying in 1 minutes...
> 
> I understand that it would be nice to fix 'em all, but I would 
> prefer the bot not blocking on them forever. I mean:

But if you respond with a fake answer, how should the upper-level
algorithm respond? Imagine what the interwiki bot may do?

Rob

--
Rob W.W. Hooft  ||  rob <at> hooft.net  ||  http://www.hooft.net/people/rob/

Re: [wishlist] [patch] Bad wikipages should be skipped

Peter Gervai wrote:

> To answer the question: the "fake" reply is "page is empty and
> you cannot change that", I don't think this could mess up anything
> above level. I may be wrong since this is only an educated guess.

The interwiki bot will remove any links to that page. Other bots may
fail or mess up in different ways depending on what they want to do with
the page content. Not all bots will download page content only to change
it! The power of many bots is in relationships between pages.

If the wikimedia site is "down", one should not run bots. I agree that
hanging for a long time waiting for the site to become reliable again
may be annoying for you, but crashing is annoying to others that would
like to run bots unattended. A configuration variable to choose between
"hanging" and "crashing" would be possible. Fake answers are not.

Rob

--
Rob W.W. Hooft  ||  rob <at> hooft.net  ||  http://www.hooft.net/people/rob/

pywikipedia family.py,1.125,1.126

Update of /cvsroot/pywikipediabot/pywikipedia
In directory sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv4298

Modified Files:
	family.py 
Log Message:
Added namespace translations for various languages and namespaces

Index: family.py
===================================================================
RCS file: /cvsroot/pywikipediabot/pywikipedia/family.py,v
retrieving revision 1.125
retrieving revision 1.126
diff -C2 -d -r1.125 -r1.126
*** family.py	27 Nov 2005 09:19:13 -0000	1.125
--- family.py	4 Dec 2005 08:46:46 -0000	1.126
***************
*** 245,255 ****
              3: {
                  '_default': u'User talk',
!                 'af': u'GebruikerBespreking',
                  'als': u'Benutzer Diskussion',
                  'bg': u'Потребител беседа',
                  'ca': u'Usuari Discussió',
                  'cs': u'Wikipedista diskuse',
                  'da': u'Bruger diskussion',
                  'de': u'Benutzer Diskussion',
                  'es': u'Usuario Discusión',
                  'hu': u'User vita',
--- 245,259 ----

[ pywikipediabot-Bugs-1343570 ] imagetransfer.py not uploading to local wikis?

Bugs item #1343570, was opened at 2005-10-31 12:16
Message generated for change (Comment added) made by ebola_rulez
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1343570&group_id=93107

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Submitted By: Aurimas Fischer (ebola_rulez)
Assigned to: Nobody/Anonymous (nobody)
Summary: imagetransfer.py not uploading to local wikis?

Initial Comment:
Latest CVS verion as of today.

I have users on both wiki:en, wiki:lt and commons. Bot 
is looged in to all of them.

Scenario 1, transfering image from wiki:en to eiki:lt:
(=> - user input.)

=>C:\wiki>imagetransfer.py 
Image:Flag_of_Vojvodina.svg -tolang:lt -lang:en

Checked for running processes. 1 processes currently 

[ pywikipediabot-Bugs-1336234 ] category.py move: moved category put on last position

Bugs item #1336234, was opened at 2005-10-24 03:34
Message generated for change (Comment added) made by nobody
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1336234&group_id=93107

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: category
Group: None
Status: Open
Resolution: None
Priority: 7
Submitted By: Eskimo (uneskimo)
Assigned to: Nobody/Anonymous (nobody)
Summary: category.py move: moved category put on last position

Initial Comment:
Hi,

I've noticed that your script automatically puts the
moved category in last position in modified articles.

Sometimes, people like to sort categories on articles
by importance, and the script ignores this work. (see
for instance
http://fr.wikipedia.org/w/index.php?title=Przemysl_II&diff=3825339&oldid=3608094
)

The bug is caused by "change_category" in catlib.py (l

[ pywikipediabot-Patches-1375560 ] imagetransfer.py lt translation strings

Patches item #1375560, was opened at 2005-12-07 20:16
Message generated for change (Tracker Item Submitted) made by Item Submitter
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=1375560&group_id=93107

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Submitted By: Aurimas Fischer (ebola_rulez)
Assigned to: Nobody/Anonymous (nobody)
Summary: imagetransfer.py lt translation strings

Initial Comment:
Translated messages for lt.wiki.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=1375560&group_id=93107

-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click

WARNING: No text area found on en