Re: Updating /mnt/user-store/stats hourly
2009-07-02 12:18:18 GMT
xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
Hello,
why?
Gruß
jan
Von:
toolserver-l-bounces <at> lists.wikimedia.org
[mailto:toolserver-l-bounces <at> lists.wikimedia.org] Im Auftrag von emijrp
Gesendet: Donnerstag, 2. Juli 2009 00:36
An: toolserver-l <at> lists.wikimedia.org
Betreff: [Toolserver-l] Updating /mnt/user-store/stats hourly
Hi;
Can anyone update /mnt/user-store/stats hourly?
Thanks, regards
<div> <p> xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> </p> <div class="Section1"> <p class="MsoNormal"><span>Hello,<p></p></span></p> <p class="MsoNormal"><span><p> </p></span></p> <p class="MsoNormal"><span>why?<p></p></span></p> <p class="MsoNormal"><span><p> </p></span></p> <p class="MsoNormal"><span>Gruß<p></p></span></p> <p class="MsoNormal"><span>jan<p></p></span></p> <p class="MsoNormal"><span><p> </p></span></p> <div> <p class="MsoNormal"><span>Von:</span><span> toolserver-l-bounces <at> lists.wikimedia.org [mailto:toolserver-l-bounces <at> lists.wikimedia.org] Im Auftrag von emijrp<br>Gesendet: Donnerstag, 2. Juli 2009 00:36<br>An: toolserver-l <at> lists.wikimedia.org<br>Betreff: [Toolserver-l] Updating /mnt/user-store/stats hourly<p></p></span></p> </div> <p class="MsoNormal"><p> </p></p> <p class="MsoNormal">Hi;<br><br> Can anyone update /mnt/user-store/stats hourly?<br><br> Thanks, regards<p></p></p> </div> </div>
Re: Updating /mnt/user-store/stats hourly
2009-07-02 12:21:24 GMT
xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
Hello,
/mnt/user-store/stats is updated hourly(e.g.pagecounts-20090702-070000.gz, 02.07.09 07:00:00 -> pagecounts-20090702-080000.gz 02.07.09 08:00:00)
Gruß
jan
Von:
toolserver-l-bounces <at> lists.wikimedia.org
[mailto:toolserver-l-bounces <at> lists.wikimedia.org] Im Auftrag von emijrp
Gesendet: Donnerstag, 2. Juli 2009 00:36
An: toolserver-l <at> lists.wikimedia.org
Betreff: [Toolserver-l] Updating /mnt/user-store/stats hourly
Hi;
Can anyone update /mnt/user-store/stats hourly?
Thanks, regards
<div> <p> xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> </p> <div class="Section1"> <p class="MsoNormal"><span>Hello, <p></p></span></p> <p class="MsoNormal"><span><p> </p></span></p> <p class="MsoNormal"><span lang="EN-US">/mnt/user-store/stats is updated hourly(e.g.pagecounts-20090702-070000.gz, 02.07.09 07:00:00 -> pagecounts-20090702-080000.gz 02.07.09 08:00:00)<p></p></span></p> <p class="MsoNormal"><span lang="EN-US"><p> </p></span></p> <p class="MsoNormal"><span lang="EN-US">Gruß<p></p></span></p> <p class="MsoNormal"><span lang="EN-US">jan</span><span lang="EN-US"><p></p></span></p> <p class="MsoNormal"><span lang="EN-US"><p> </p></span></p> <div> <p class="MsoNormal"><span>Von:</span><span> toolserver-l-bounces <at> lists.wikimedia.org [mailto:toolserver-l-bounces <at> lists.wikimedia.org] Im Auftrag von emijrp<br>Gesendet: Donnerstag, 2. Juli 2009 00:36<br>An: toolserver-l <at> lists.wikimedia.org<br>Betreff: [Toolserver-l] Updating /mnt/user-store/stats hourly<p></p></span></p> </div> <p class="MsoNormal"><p> </p></p> <p class="MsoNormal">Hi;<br><br> Can anyone update /mnt/user-store/stats hourly?<br><br> Thanks, regards<p></p></p> </div> </div>
downtime
2009-07-03 00:39:00 GMT
hi, we lost power for unknown reasons last night, causing an outage of the Toolserver. most of the platform is back up, but s3 (yarrow) remains down. as we had downtime anyway, i took the opportunity to move stable to the new server. the old stable server (willow) is now offline. - river.
Re: downtime
2009-07-03 00:43:58 GMT
River Tarnell wrote: > hi, > > we lost power for unknown reasons last night, causing an outage of the > Toolserver. most of the platform is back up, but s3 (yarrow) remains down. > > as we had downtime anyway, i took the opportunity to move stable to the new > server. the old stable server (willow) is now offline. > > - river. Is new stable good to go or are you still installing packages, so I know if I should beg for some things to get install? -OverlordQ
Re: downtime
2009-07-03 00:47:28 GMT
Q: > Is new stable good to go or are you still installing packages, so I know > if I should beg for some things to get install? if you need software installed please file a bug in the TS project in JIRA. - river.
Re: downtime
2009-07-03 05:01:36 GMT
River Tarnell: > most of the platform is back up, but s3 (yarrow) remains down. more information: it seems yarrow's external disk array did not come back up after the downtime. i am waiting for someone to visit the colo to investigate further. s3 will be offline until then. additionally, commons replication on s1 (rosemary) is offline for the moment due to some kind of data corruption issue; i will be discussing this with Sun, but we may need to reimport commons on that server, which i will do next week if necessary. - river.
Re: Updating /mnt/user-store/stats hourly
2009-07-03 11:02:00 GMT
To update a template similar to {{Popular articles}} of English Wikipedia. Now, I'm downloading one .gz (40 MB) each hour, so, it wouldn't be neccesary if this directory is updated in "real time".
Hello,
why?
Gruß
jan
Von: toolserver-l-bounces <at> lists.wikimedia.org [mailto:toolserver-l-bounces <at> lists.wikimedia.org] Im Auftrag von emijrp
Gesendet: Donnerstag, 2. Juli 2009 00:36
An: toolserver-l <at> lists.wikimedia.org
Betreff: [Toolserver-l] Updating /mnt/user-store/stats hourly
Hi;
Can anyone update /mnt/user-store/stats hourly?
Thanks, regards
_______________________________________________
Toolserver-l mailing list
Toolserver-l <at> lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
<div>
<p>To update a template similar to {{Popular articles}} of English Wikipedia. Now, I'm downloading one .gz (40 MB) each hour, so, it wouldn't be neccesary if this directory is updated in "real time".<br><br></p>
<div class="gmail_quote">2009/7/2 Jan Luca <span dir="ltr"><<a href="mailto:jan <at> jans-seite.de">jan <at> jans-seite.de</a>></span><br><blockquote class="gmail_quote">
<div link="blue" vlink="purple" lang="DE">
<div>
<p><span>Hello,</span></p>
<p><span> </span></p>
<p><span>why?</span></p>
<p><span> </span></p>
<p><span>Gruß</span></p>
<p><span>jan</span></p>
<p><span> </span></p>
<div>
<p><span>Von:</span><span>
<a href="mailto:toolserver-l-bounces <at> lists.wikimedia.org" target="_blank">toolserver-l-bounces <at> lists.wikimedia.org</a>
[mailto:<a href="mailto:toolserver-l-bounces <at> lists.wikimedia.org" target="_blank">toolserver-l-bounces <at> lists.wikimedia.org</a>] Im Auftrag von emijrp<br>Gesendet: Donnerstag, 2. Juli 2009 00:36<br>An: <a href="mailto:toolserver-l <at> lists.wikimedia.org" target="_blank">toolserver-l <at> lists.wikimedia.org</a><br>Betreff: [Toolserver-l] Updating /mnt/user-store/stats hourly</span></p>
</div>
<div class="im">
<p> </p>
<p>Hi;<br><br>
Can anyone update /mnt/user-store/stats hourly?<br><br>
Thanks, regards</p>
</div>
</div>
</div>
<br>_______________________________________________<br>
Toolserver-l mailing list<br><a href="mailto:Toolserver-l <at> lists.wikimedia.org">Toolserver-l <at> lists.wikimedia.org</a><br><a href="https://lists.wikimedia.org/mailman/listinfo/toolserver-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/toolserver-l</a><br><br>
</blockquote>
</div>
<br>
</div>
Re: Updating /mnt/user-store/stats hourly
2009-07-03 12:04:12 GMT
On Fri, Jul 3, 2009 at 1:02 PM, emijrp<emijrp <at> gmail.com> wrote:
> To update a template similar to {{Popular articles}} of English Wikipedia.
> Now, I'm downloading one .gz (40 MB) each hour, so, it wouldn't be neccesary
> if this directory is updated in "real time".
If nothing has changed since last time I checked, it is one of my cron
jobs that does the update, and I am happy to run it every hour if
needed (and if that is not a problem).
By the way, the directory has grown quite a bit and is getting
difficult to use (even an "ls" takes ages to run), so I should
probably change the layout a bit (e.g. having subdirectories for
archives). At some point, we may have to delete the older files, or
compress them (that's what Erik Zachte does for the "official"
statistics), but I think there is enough space for now (let me know if
any of you, especially ts-admins, think otherwise).
One short-term plan is, instead of simply downloading the files, to
replicate part of the infrastucture set up by Erik (provide compressed
and/or processed files) so that it is easier to use the data on the
toolserver. Well, it was a short-term plan in January and then I was
kept away from this work by other comitments...
Frédéric
Re: Updating /mnt/user-store/stats hourly
2009-07-03 12:29:02 GMT
Please, update hourly, to avoid duplicated downloads.
On Fri, Jul 3, 2009 at 1:02 PM, emijrp<emijrp <at> gmail.com> wrote:If nothing has changed since last time I checked, it is one of my cron
> To update a template similar to {{Popular articles}} of English Wikipedia.
> Now, I'm downloading one .gz (40 MB) each hour, so, it wouldn't be neccesary
> if this directory is updated in "real time".
jobs that does the update, and I am happy to run it every hour if
needed (and if that is not a problem).
By the way, the directory has grown quite a bit and is getting
difficult to use (even an "ls" takes ages to run), so I should
probably change the layout a bit (e.g. having subdirectories for
archives). At some point, we may have to delete the older files, or
compress them (that's what Erik Zachte does for the "official"
statistics), but I think there is enough space for now (let me know if
any of you, especially ts-admins, think otherwise).
One short-term plan is, instead of simply downloading the files, to
replicate part of the infrastucture set up by Erik (provide compressed
and/or processed files) so that it is easier to use the data on the
toolserver. Well, it was a short-term plan in January and then I was
kept away from this work by other comitments...
Frédéric
_______________________________________________
Toolserver-l mailing list
Toolserver-l <at> lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
<div>
<p>Please, update hourly, to avoid duplicated downloads.<br><br></p>
<div class="gmail_quote">2009/7/3 Frederic Schutz <span dir="ltr"><<a href="mailto:schutz <at> mathgen.ch">schutz <at> mathgen.ch</a>></span><br><blockquote class="gmail_quote">
<div class="im">On Fri, Jul 3, 2009 at 1:02 PM, emijrp<<a href="mailto:emijrp <at> gmail.com">emijrp <at> gmail.com</a>> wrote:<br><br>
> To update a template similar to {{Popular articles}} of English Wikipedia.<br>
> Now, I'm downloading one .gz (40 MB) each hour, so, it wouldn't be neccesary<br>
> if this directory is updated in "real time".<br><br>
</div>If nothing has changed since last time I checked, it is one of my cron<br>
jobs that does the update, and I am happy to run it every hour if<br>
needed (and if that is not a problem).<br><br>
By the way, the directory has grown quite a bit and is getting<br>
difficult to use (even an "ls" takes ages to run), so I should<br>
probably change the layout a bit (e.g. having subdirectories for<br>
archives). At some point, we may have to delete the older files, or<br>
compress them (that's what Erik Zachte does for the "official"<br>
statistics), but I think there is enough space for now (let me know if<br>
any of you, especially ts-admins, think otherwise).<br><br>
One short-term plan is, instead of simply downloading the files, to<br>
replicate part of the infrastucture set up by Erik (provide compressed<br>
and/or processed files) so that it is easier to use the data on the<br>
toolserver. Well, it was a short-term plan in January and then I was<br>
kept away from this work by other comitments...<br><br>
Frédéric<br><div>
<div></div>
<div class="h5">
<br>
_______________________________________________<br>
Toolserver-l mailing list<br><a href="mailto:Toolserver-l <at> lists.wikimedia.org">Toolserver-l <at> lists.wikimedia.org</a><br><a href="https://lists.wikimedia.org/mailman/listinfo/toolserver-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/toolserver-l</a><br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
RSS Feed