headers
Philip Beach | 1 Feb 2009 01:03
Picon

Site errors caused by load?

Visitors to my wiki are complaining of regularly-occurring 503 "Service
Temporarily Unavailable" errors, or just simply the site not loading through
their browsers. I investigated the errors and they seem to occur
unpredictably every minute or so and only last for 10 seconds or so. If I
open a different browser while the first is getting 503s, the other browser
IS able to connect.

I looked at my load numbers and the site seems to be under load from several
search engine bots. The actual load number is frequently over 20k (which
I've heard is high), sometimes spiking to 40, and a few times I cough it at
over 80!?? My host said I had 200 hits per minute when I asked about the
issue.

My hardware is a quad core 5 series xenon at 2.3ghz, with 6GB of RAM. I have
php's memory limit set to 256mb. My ram never seems to be more than 25%
full.

Could this be causing the random 503s? I am not using a robots.txt file,
could bots be indexing stuff they shouldn't be and in turn slowing the site?

Thanks!
Permalink | Reply | 1 comment |
headers
Rob Lingelbach | 1 Feb 2009 01:06

Re: Site errors caused by load?

Philip, could you perhaps be under the influence of Denial-of-Service  
attacks?

if these accesses are from bots that seem legitimate, you could,  
depending on
your OS, prevent their access via (for example) iptables.

I would suggest turning off access for the bots in iptables (depending  
on your OS)
and then checking the situation.  then you can determine what will be  
the final
solution.

On Feb 1, 2009, at 2:03 AM, Philip Beach wrote:

> Visitors to my wiki are complaining of regularly-occurring 503  
> "Service
> Temporarily Unavailable" errors, or just simply the site not loading  
> through

--
Rob Lingelbach
rob <at> colorist.org
Permalink | Reply | 0 comments |
headers
backspaces | 1 Feb 2009 03:58
Favicon
Gravatar

Re: Tex-less Math via Dynamic Images


Abs Fab!  Worked like a charm.  Thanks.

   -- Owen

Platonides wrote:
> 
> backspaces wrote:
>> My mediawiki installation is on a hosting service, Joyent, which does not
>> provide the latex tools necessary for the Math extension enabled via
>> Texvc.
>> 
>> But, there is an online Tex render, CodeCogs, that I use for my blog. 
>> See
>> this post:
>> http://backspaces.net/tutorials/32/math-on-the-web
>> 
>> The blog post simply creates a dynamic image which I render with an img
>> HTML
>> tag.  The img contains this url as its source:
>> http://www.forkosh.dreamhost.com/mathtex.cgi?{c=\sqrt{\alpha^2+\beta^2}}
>> ..you can cut/paste this into your browser to see what it looks like.
>> 
>> Is there a way for me to also use this online latex rendering within
>> mediawiki?
>> 
>> Basically this translates into being able to generate an img tag within
>> mediawiki which looks something like:
>> img
>> src="http://www.codecogs.com/eq.latex?\int_{-\infty}^{\infty}e^{-x^{2}}dx=\sqrt{\pi}"
(Continue reading)

Permalink | Reply | 0 comments |
headers
Philip Beach | 1 Feb 2009 04:02
Picon

Re: Site errors caused by load?

I already have checked the access logs. It appears that Google and Yahoo are
indeed generating a lot of traffic. Good idea Rob, I've been working on this
for a while.

Just out of curiosity, what should my robots.txt look like for Mediawiki.
Does anything need to be disallowed?

On Sat, Jan 31, 2009 at 8:30 PM, Platonides <Platonides <at> gmail.com> wrote:

> You should check the access logs for which is causing the error.
>
>
> _______________________________________________
> MediaWiki-l mailing list
> MediaWiki-l <at> lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
>
Permalink | Reply | 8 comments |
headers
Benjamin Lees | 1 Feb 2009 07:47
Picon

Re: Site errors caused by load?

Assuming you have Wikimedia-style URLs:
User-agent: *
Disallow: /w/
Disallow: /wiki/Special:Search
Disallow: /wiki/Special:Random

Your server will be able to handle a lot more if you set up as much caching
as you can <http://www.mediawiki.org/wiki/Manual:Cache>.  No sense letting
all that spare RAM rot. :)

On Sat, Jan 31, 2009 at 10:02 PM, Philip Beach <beachboy4231 <at> gmail.com>wrote:

> I already have checked the access logs. It appears that Google and Yahoo
> are
> indeed generating a lot of traffic. Good idea Rob, I've been working on
> this
> for a while.
>
> Just out of curiosity, what should my robots.txt look like for Mediawiki.
> Does anything need to be disallowed?
>
> On Sat, Jan 31, 2009 at 8:30 PM, Platonides <Platonides <at> gmail.com> wrote:
>
> > You should check the access logs for which is causing the error.
> >
> >
> > _______________________________________________
> > MediaWiki-l mailing list
> > MediaWiki-l <at> lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
(Continue reading)

Permalink | Reply | 7 comments |
headers
Philip Beach | 1 Feb 2009 08:06
Picon

Re: Site errors caused by load?

Haha true about rotting RAM, I'll look into that. I am not using wikimedia
style URL's, sadly :( it just didn't happen when the site was first set up
and I can't move it now, for various reasons. All of my files are in the
web-root /. However, through an apache alias, my url is mywiki.com/Pagename.

How would robots.txt look for that? Would I simply drop the preceeding
/wiki, like this?

User-agent: *
Disallow: /Special:Search
Disallow: /Special:Random

Thanks a ton!

On Sun, Feb 1, 2009 at 1:47 AM, Benjamin Lees <emufarmers <at> gmail.com> wrote:

> Assuming you have Wikimedia-style URLs:
> User-agent: *
> Disallow: /w/
> Disallow: /wiki/Special:Search
> Disallow: /wiki/Special:Random
>
> Your server will be able to handle a lot more if you set up as much caching
> as you can <http://www.mediawiki.org/wiki/Manual:Cache>.  No sense letting
> all that spare RAM rot. :)
>
>
> On Sat, Jan 31, 2009 at 10:02 PM, Philip Beach <beachboy4231 <at> gmail.com
> >wrote:
>
(Continue reading)

Permalink | Reply | 6 comments |
headers
Oded Haim Breiner | 1 Feb 2009 09:56
Picon

requiring extensions on localsettings file blanks out the wiki

Requiring extensions on localsettings file blanks out the wiki, can anyone
help?

Oded
Permalink | Reply | 3 comments |
headers
Benjamin Lees | 1 Feb 2009 11:34
Picon

Re: Site errors caused by load?

TryUser-agent: *
Disallow: /index.php
Disallow: /skins/
Disallow: /Special:Search
Disallow: /Special:Random

Some other good rules to include are
Disallow: /MediaWiki:
Disallow: /Template:

and maybe
Disallow: /Category:

On Sun, Feb 1, 2009 at 2:06 AM, Philip Beach <beachboy4231 <at> gmail.com> wrote:

> Haha true about rotting RAM, I'll look into that. I am not using wikimedia
> style URL's, sadly :( it just didn't happen when the site was first set up
> and I can't move it now, for various reasons. All of my files are in the
> web-root /. However, through an apache alias, my url is
> mywiki.com/Pagename.
>
> How would robots.txt look for that? Would I simply drop the preceeding
> /wiki, like this?
>
> User-agent: *
> Disallow: /Special:Search
> Disallow: /Special:Random
>
> Thanks a ton!
>
(Continue reading)

Permalink | Reply | 5 comments |
headers
John Thomson (Stoneway Consulting | 1 Feb 2009 16:05
Picon

Re: requiring extensions on localsettings file blanks out the wiki

To be clear, you added an extension and now you see a blank page? A few 
things to look at:

Try enabling error_reporting from within PHP (php.ini) and see what you 
get.
Confirm your paths and syntax for your new extension call within the 
LocalSettings.php.
Check the discussions tab for the extension you downloaded, do others 
have similar issues?

Good luck.

John

Oded Haim Breiner wrote:
> Requiring extensions on localsettings file blanks out the wiki, can anyone
> help?
>
> Oded
> _______________________________________________
> MediaWiki-l mailing list
> MediaWiki-l <at> lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
>
>
Permalink | Reply | 0 comments |
headers
Addady | 1 Feb 2009 21:50
Picon

Some page are not update

Hello,

Some of my wiki page are not update.  Although those page have newer 
version an old version of the pages is display to guests. It is possible 
to see the new version in the page history or after I login.

It not look like client cache problem. I cleared the browser cache 
(Pressing Shift key + Refresh bottom) and try different type of browsers 
from different ISPs.

Also I disable the my wiki squid proxy.

Please advise

Addady
Permalink | Reply | 2 comments |

Gmane