Michael Foord | 2 Mar 14:08 2012
Picon

PyPI download stats stopped updating

Hey folks,



It looks like download stats for packages have stopped updating.

All the best,

Michael Foord

--
http://www.voidspace.org.uk/

May you do good and not evil
May you find forgiveness for yourself and forgive others
May you share freely, never taking more than you give.
-- the sqlite blessing http://www.sqlite.org/different.html
_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig
Donald Stufft | 2 Mar 19:02 2012
Picon

Re: PyPI download stats stopped updating

I've also seen this, Logging on Crate.io shows that no updates have occurred at least since the 28th, I've
gotten reports of it being since the 26th. Curiously the data at pypi.python.org/stats/ *seems* like it might
be updating.

On Friday, March 2, 2012 at 8:08 AM, Michael Foord wrote:

Hey folks,


It looks like download stats for packages have stopped updating.

All the best,

Michael Foord

--
http://www.voidspace.org.uk/

May you do good and not evil
May you find forgiveness for yourself and forgive others
May you share freely, never taking more than you give.
-- the sqlite blessing http://www.sqlite.org/different.html
_______________________________________________
Catalog-SIG mailing list

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig
"Martin v. Löwis" | 4 Mar 00:00 2012
Picon

Re: PyPI download stats stopped updating

> It looks like download stats for packages have stopped updating.

I have now fixed it. After the last dinsdale crash, the postgres WAL
was corrupted. Even though Noah (IIRC) had fixed that, apparently, there
was inconsistencies in the database.

As a consequence, updating the download counter made triggered an
assertion in postgres, which in turn caused the transaction to abort.
I tried reindexing the database, which failed due to a duplicate
primary key in the user table.

I manually removed the duplicate record, reindexed the database, and
ran the stats integration. So now all should be fine.

Regards,
Martin
"Martin v. Löwis" | 13 Mar 21:17 2012
Picon

Mirror selection

We were just talking about PyPI mirror selection at the sprint,
so people asked me to release the current implementation of my
mirror selection algorithm, which is now at

http://www.dcl.hpi.uni-potsdam.de/home/loewis/_mirrorlib.py

The main function is

def find_mirror(start_with='a',
                  good_age = 30*60,
                  slow_mirrors_wait = 5,
                  prefer_fastest = True):
     '''find_mirrors(start_with, good_age, slow_mirrors_wait, 
prefer_fastest)
        -> [(name, family, IP, response_time, last_modified)]

     Find a PyPI mirror matching given criteria.
     start_with indicates the first mirror that should be considered 
(defaults to 'a').
     If prefer_fastest is True, it stops with the first mirror 
responding. Mirrors 'compete'
     against each other in randomly-shuffled batches of 10.
     If this procedure goes on for longer than slow_mirrors_wait 
(default 5s) and prefer_fastest
     is false, return even if not all mirrors have been responding.
     If no matching mirror can be found, the newest one that did 
response is returned.
     If no mirror can be found at all, ValueError is raised'''

Regards,
Martin
"Martin v. Löwis" | 15 Mar 17:33 2012
Picon

PyPI code now on bitbucket

I move the PyPI code to

https://bitbucket.org/loewis/pypi

Regards,
Martin
Noah Kantrowitz | 15 Mar 17:57 2012
Picon

Re: PyPI code now on bitbucket

Any chance we can host that under the PSF organization instead of your personal account? Would help improve
bus factor :-)

--Noah

On Mar 15, 2012, at 9:33 AM, Martin v. Löwis wrote:

> I move the PyPI code to
> 
> https://bitbucket.org/loewis/pypi
> 
> Regards,
> Martin
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG <at> python.org
> http://mail.python.org/mailman/listinfo/catalog-sig

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig
"Martin v. Löwis" | 15 Mar 18:55 2012
Picon

Re: PyPI code now on bitbucket

Am 15.03.12 09:57, schrieb Noah Kantrowitz:
> Any chance we can host that under the PSF organization instead of your personal account? Would help
improve bus factor :-)
>

Richard requested it to be on bitbucket, and he also has admin access to it.

Regards,
Martin
Noah Kantrowitz | 15 Mar 19:14 2012
Picon

Re: PyPI code now on bitbucket

Yes, I mean on Bitbucket but under the official PSF organization. I think it is
https://bitbucket.org/PSF, but Jesper (CC'd) would know for sure.

--Noah

On Mar 15, 2012, at 10:55 AM, Martin v. Löwis wrote:

> Am 15.03.12 09:57, schrieb Noah Kantrowitz:
>> Any chance we can host that under the PSF organization instead of your personal account? Would help
improve bus factor :-)
>> 
> 
> Richard requested it to be on bitbucket, and he also has admin access to it.
> 
> Regards,
> Martin

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig
"Martin v. Löwis" | 15 Mar 19:36 2012
Picon

Re: PyPI code now on bitbucket

Am 15.03.12 11:19, schrieb Jesper Noehr:
> Doug Hellmann sits on the PSF account on our end. :-)

Ah, ok. Who needs to do what to make this happen?

Regards,
Martin
Noah Kantrowitz | 15 Mar 19:39 2012
Picon

Re: PyPI code now on bitbucket

Doug, can you make a PyPI repo under the PSF account and add martin and richard as admins? Then you can just
push there too and all will be well :-) You might want to just remove the copy under your username and fork the
main one after that so it is in the forks list, but the repo under your username can be used for your personal
development while the main one stays stable for deployment.

--Noah

On Mar 15, 2012, at 11:36 AM, Martin v. Löwis wrote:

> Am 15.03.12 11:19, schrieb Jesper Noehr:
>> Doug Hellmann sits on the PSF account on our end. :-)
> 
> Ah, ok. Who needs to do what to make this happen?
> 
> Regards,
> Martin

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig

Gmane