PyPI download stats stopped updating

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig

Re: PyPI download stats stopped updating

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig

Re: PyPI download stats stopped updating

> It looks like download stats for packages have stopped updating.

I have now fixed it. After the last dinsdale crash, the postgres WAL
was corrupted. Even though Noah (IIRC) had fixed that, apparently, there
was inconsistencies in the database.

As a consequence, updating the download counter made triggered an
assertion in postgres, which in turn caused the transaction to abort.
I tried reindexing the database, which failed due to a duplicate
primary key in the user table.

I manually removed the duplicate record, reindexed the database, and
ran the stats integration. So now all should be fine.

Regards,
Martin

Mirror selection

We were just talking about PyPI mirror selection at the sprint,
so people asked me to release the current implementation of my
mirror selection algorithm, which is now at

http://www.dcl.hpi.uni-potsdam.de/home/loewis/_mirrorlib.py

The main function is

def find_mirror(start_with='a',
                  good_age = 30*60,
                  slow_mirrors_wait = 5,
                  prefer_fastest = True):
     '''find_mirrors(start_with, good_age, slow_mirrors_wait, 
prefer_fastest)
        -> [(name, family, IP, response_time, last_modified)]

     Find a PyPI mirror matching given criteria.
     start_with indicates the first mirror that should be considered 
(defaults to 'a').
     If prefer_fastest is True, it stops with the first mirror 
responding. Mirrors 'compete'
     against each other in randomly-shuffled batches of 10.
     If this procedure goes on for longer than slow_mirrors_wait 
(default 5s) and prefer_fastest
     is false, return even if not all mirrors have been responding.
     If no matching mirror can be found, the newest one that did 
response is returned.
     If no mirror can be found at all, ValueError is raised'''

Regards,
Martin

PyPI code now on bitbucket

I move the PyPI code to

https://bitbucket.org/loewis/pypi

Regards,
Martin

Re: PyPI code now on bitbucket

Any chance we can host that under the PSF organization instead of your personal account? Would help improve
bus factor 

--Noah

On Mar 15, 2012, at 9:33 AM, Martin v. Löwis wrote:

> I move the PyPI code to
> 
> https://bitbucket.org/loewis/pypi
> 
> Regards,
> Martin
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG <at> python.org
> http://mail.python.org/mailman/listinfo/catalog-sig

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig

Re: PyPI code now on bitbucket

Am 15.03.12 09:57, schrieb Noah Kantrowitz:
> Any chance we can host that under the PSF organization instead of your personal account? Would help
improve bus factor 
>

Richard requested it to be on bitbucket, and he also has admin access to it.

Regards,
Martin

Re: PyPI code now on bitbucket

Yes, I mean on Bitbucket but under the official PSF organization. I think it is
https://bitbucket.org/PSF, but Jesper (CC'd) would know for sure.

--Noah

On Mar 15, 2012, at 10:55 AM, Martin v. Löwis wrote:

> Am 15.03.12 09:57, schrieb Noah Kantrowitz:
>> Any chance we can host that under the PSF organization instead of your personal account? Would help
improve bus factor 
>> 
> 
> Richard requested it to be on bitbucket, and he also has admin access to it.
> 
> Regards,
> Martin

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig

Re: PyPI code now on bitbucket

Am 15.03.12 11:19, schrieb Jesper Noehr:
> Doug Hellmann sits on the PSF account on our end. 

Ah, ok. Who needs to do what to make this happen?

Regards,
Martin

Re: PyPI code now on bitbucket

Doug, can you make a PyPI repo under the PSF account and add martin and richard as admins? Then you can just
push there too and all will be well  You might want to just remove the copy under your username and fork the
main one after that so it is in the forks list, but the repo under your username can be used for your personal
development while the main one stays stable for deployment.

--Noah

On Mar 15, 2012, at 11:36 AM, Martin v. Löwis wrote:

> Am 15.03.12 11:19, schrieb Jesper Noehr:
>> Doug Hellmann sits on the PSF account on our end. 
> 
> Ah, ok. Who needs to do what to make this happen?
> 
> Regards,
> Martin

_______________________________________________
Catalog-SIG mailing list
Catalog-SIG <at> python.org
http://mail.python.org/mailman/listinfo/catalog-sig