headers
Robert Bradshaw | 21 Mar 2012 22:39
Picon

Re: [Cython] [cython-users] GSoC 2012

On Wed, Mar 21, 2012 at 2:11 PM, Dag Sverre Seljebotn
<d.s.seljebotn <at> astro.uio.no> wrote:
> On 03/21/2012 01:56 PM, Robert Bradshaw wrote:
>>
>> On Sat, Mar 10, 2012 at 10:44 PM, mark florisson
>> <markflorisson88 <at> gmail.com>  wrote:
>>>
>>> On 8 March 2012 14:27, Stefan Behnel<stefan_ml <at> behnel.de>  wrote:
>>>>
>>>> Hi,
>>>>
>>>> I noticed that people start rushing for the next season on Python's GSoC
>>>> mailing lists. Do we have any interested developers here, or general
>>>> ideas
>>>> about suitable topics? I would expect that we'll do as in the last years
>>>> and participate under Python's umbrella.
>>
>>
>> Also, we'd like to see patches from anyone interesting in being a GSoC
>> student, as this will be a requirement as in past years.
>>
>>> I will likely be submitting a proposal for the OpenCL support CEP.
>>
>>
>> OpenCL would be an interesting experiment, but I think still has
>> limited utility. Dag and I were talking the other day about the
>> challenge of generating the best possible code for evaluating array
>> expressions (think inlined memoryview arithmetic) taking into account
>> memory layout, blocking, etc. which Fortran does really well which
>> could be an interesting direction.
(Continue reading)

Permalink | Reply | 0 comments |
headers
Stefan Behnel | 22 Mar 2012 08:18
Picon
Favicon

Re: [Cython] some pull requests for 0.16?

Robert Bradshaw, 21.03.2012 21:24:
> On Wed, Mar 21, 2012 at 6:47 AM, mark florisson wrote:
>> On 20 March 2012 18:51, Stefan Behnel wrote:
>>> mark florisson, 20.03.2012 17:40:
>>>> On 18 March 2012 11:58, Stefan Behnel wrote:
>>>>> I put up two new pull requests on github:
>>>>>
>>>>> Implementation of PEP 380 (yield from):
>>>>> https://github.com/cython/cython/pull/96
>>>>>
>>>>> Rewrite of dict iteration:
>>>>> https://github.com/cython/cython/pull/95
>>>>>
>>>>> Given that the release of 0.16 has currently slowed down a bit, and given
>>>>> that these are really nice features, could someone (and especially Mark, as
>>>>> the responsible release manager) take a look at them and give an opinion
>>>>> regarding their suitability for 0.16?
>>>>
>>>> Sorry about the slowdown, my BT internet connection at home got closed
>>>> off, so working on a release is rather hard, hopefully that will be
>>>> fixed within the next few days.
> 
> Thanks for the status update. Is there a separate release branch, or
> are you working off the github master?

Not currently. I also agree that we should try to get out the release soon.
What about this: I merge my pending pull requests, we test everything in
Sage (it's been normally tested in my dev branch already), and if that
doesn't break anything, we release another beta? If it does break anything,
it's either easy enough to fix, or we can create a release branch at that
(Continue reading)

Permalink | Reply | 3 comments |
headers
Stefan Behnel | 22 Mar 2012 08:34
Picon
Favicon

Re: [Cython] [cython-users] GSoC 2012

Robert Bradshaw, 21.03.2012 21:56:
> On Sat, Mar 10, 2012 at 10:44 PM, mark florisson wrote:
> 2.
>> - profile guided optimizations (using python's profilers and/or a
>> custom profiler that collects data such as types etc, which can be
>> used to specialize variables inside loops (or entire functions) with a
>> fallback to normal mode in case the type changes)
> 4.
>> - better type inference, that would be enabled by default and again
>> handle thing like reassignments of variables and fallbacks to the
>> default object type. With entry caching Cython could build a database
>> of types ((extension) classes, functions, variables) used in the
>> modules and functions that are compiled (also def functions), and
>> infer the types used and specialize on those. Maybe a switch should be
>> added to cython to handle circular dependencies, or maybe with the
>> distutils preprocessing it can run all the type inference first and
>> keep track of unresolved entries, and try to fill those in after
>> building the database. For bonus points the user can be allowed to
>> write plugins to aid the process.
> 
> 
> What I would most like to see is the common component in 2 and 4, i.e.
> the ability to generate optimized code for imperfectly-inferred types,
> with transparent fallback to generic code if conditions are not met at
> runtime (during as well as at entering the optimized code path).

Absolutely. The dict iteration change is pointing exactly in that
direction, but there are so many other places where the same thing applies.

Basically, it has separate C implementations for different cases all folded
(Continue reading)

Permalink | Reply | 0 comments |
headers
mark florisson | 22 Mar 2012 13:40
Picon
Gravatar

Re: [Cython] some pull requests for 0.16?

On 22 March 2012 07:18, Stefan Behnel <stefan_ml@...> wrote:
> Robert Bradshaw, 21.03.2012 21:24:
>> On Wed, Mar 21, 2012 at 6:47 AM, mark florisson wrote:
>>> On 20 March 2012 18:51, Stefan Behnel wrote:
>>>> mark florisson, 20.03.2012 17:40:
>>>>> On 18 March 2012 11:58, Stefan Behnel wrote:
>>>>>> I put up two new pull requests on github:
>>>>>>
>>>>>> Implementation of PEP 380 (yield from):
>>>>>> https://github.com/cython/cython/pull/96
>>>>>>
>>>>>> Rewrite of dict iteration:
>>>>>> https://github.com/cython/cython/pull/95
>>>>>>
>>>>>> Given that the release of 0.16 has currently slowed down a bit, and given
>>>>>> that these are really nice features, could someone (and especially Mark, as
>>>>>> the responsible release manager) take a look at them and give an opinion
>>>>>> regarding their suitability for 0.16?
>>>>>
>>>>> Sorry about the slowdown, my BT internet connection at home got closed
>>>>> off, so working on a release is rather hard, hopefully that will be
>>>>> fixed within the next few days.
>>
>> Thanks for the status update. Is there a separate release branch, or
>> are you working off the github master?
>
> Not currently. I also agree that we should try to get out the release soon.
> What about this: I merge my pending pull requests, we test everything in
> Sage (it's been normally tested in my dev branch already), and if that
> doesn't break anything, we release another beta? If it does break anything,
(Continue reading)

Permalink | Reply | 2 comments |
headers
mark florisson | 22 Mar 2012 13:46
Picon
Gravatar

Re: [Cython] Jenkins down

On 21 March 2012 13:58, Stefan Behnel <stefan_ml@...> wrote:
> Hi,
>
> it seems like the sage.math server is broken again, at least it's lacking
> mounts when I try to log in. I'll restart Jenkins as soon as it's back working.
>
> Stefan
> _______________________________________________
> cython-devel mailing list
> cython-devel@...
> http://mail.python.org/mailman/listinfo/cython-devel

Logging in through ssh seems to work, should I run any of the scripts
from your home directory Stefan? e.g. restart_dead_hudson.sh or
starthudson.sh?
Permalink | Reply | 6 comments |
headers
William Stein | 22 Mar 2012 14:11
Picon
Gravatar

Re: [Cython] sage.math problems?

On Thu, Mar 22, 2012 at 9:04 AM, David Kirkby <david.kirkby@...> wrote:
> On 22 March 2012 12:33, William Stein <wstein@...> wrote:
>> The usb device (for /levi) never appeared after I remotely rebooted sage.math.
>> Physical access is thus probably required.  I've emailed some people who are in
>> Seattle, and we'll see.  (I'm thousands of miles away now, and will
>> only get further away
>> -- to Europe -- until Apr 2, when I'll be back in Seattle.)
>
> I believe any decent IT professional will tell you that you should not
> be using USB drives on servers.

Well I'm definitely currently not using USB drives on this server. :-(

If possible, can the stuff that was being done on /levi (jenkins for
Cython) be moved to /scratch, which is a reasonably fast NFS
filesystem.

 -- William
Permalink | Reply | 27 comments |
headers
mark florisson | 22 Mar 2012 15:21
Picon
Gravatar

Re: [Cython] some pull requests for 0.16?

On 21 March 2012 20:24, Robert Bradshaw <robertwb@...> wrote:
> On Wed, Mar 21, 2012 at 6:47 AM, mark florisson
> <markflorisson88@...> wrote:
>> On 20 March 2012 18:51, Stefan Behnel <stefan_ml@...> wrote:
>>> mark florisson, 20.03.2012 17:40:
>>>> On 18 March 2012 11:58, Stefan Behnel wrote:
>>>>> I put up two new pull requests on github:
>>>>>
>>>>> Implementation of PEP 380 (yield from):
>>>>> https://github.com/cython/cython/pull/96
>>>>>
>>>>> Rewrite of dict iteration:
>>>>> https://github.com/cython/cython/pull/95
>>>>>
>>>>> Given that the release of 0.16 has currently slowed down a bit, and given
>>>>> that these are really nice features, could someone (and especially Mark, as
>>>>> the responsible release manager) take a look at them and give an opinion
>>>>> regarding their suitability for 0.16?
>>>>
>>>> Sorry about the slowdown, my BT internet connection at home got closed
>>>> off, so working on a release is rather hard, hopefully that will be
>>>> fixed within the next few days.
>
> Thanks for the status update. Is there a separate release branch, or
> are you working off the github master? Is there a list of
> issues/blockers somewhere?

I created a release branch called release0.16 (there was a previous
release branch for 0.15.1 which I could have pruned as well).
(Continue reading)

Permalink | Reply | 0 comments |
headers
Robert Bradshaw | 22 Mar 2012 16:59
Picon

Re: [Cython] Jenkins down

Thanks for the offer. One problem I see is that /levi/scratch (a local
disk) has been dismounted (or reconfigured). To save ourselves random
permissions issues, it's probably best to run this script/job as
scoder (I've got sudo).

I'll see what I can do to get it running, assuming the sage.math
issues have been resolved.

- Robert

On Thu, Mar 22, 2012 at 5:46 AM, mark florisson
<markflorisson88@...> wrote:
> On 21 March 2012 13:58, Stefan Behnel <stefan_ml@...> wrote:
>> Hi,
>>
>> it seems like the sage.math server is broken again, at least it's lacking
>> mounts when I try to log in. I'll restart Jenkins as soon as it's back working.
>>
>> Stefan
>> _______________________________________________
>> cython-devel mailing list
>> cython-devel@...
>> http://mail.python.org/mailman/listinfo/cython-devel
>
> Logging in through ssh seems to work, should I run any of the scripts
> from your home directory Stefan? e.g. restart_dead_hudson.sh or
> starthudson.sh?
> _______________________________________________
> cython-devel mailing list
> cython-devel@...
(Continue reading)

Permalink | Reply | 5 comments |
headers
Stefan Behnel | 22 Mar 2012 17:03
Picon
Favicon

Re: [Cython] sage.math problems?

William Stein, 22.03.2012 14:11:
> On Thu, Mar 22, 2012 at 9:04 AM, David Kirkby wrote:
>> On 22 March 2012 12:33, William Stein wrote:
>>> The usb device (for /levi) never appeared after I remotely rebooted sage.math.
>>> Physical access is thus probably required.  I've emailed some people who are in
>>> Seattle, and we'll see.  (I'm thousands of miles away now, and will
>>> only get further away
>>> -- to Europe -- until Apr 2, when I'll be back in Seattle.)
>>
>> I believe any decent IT professional will tell you that you should not
>> be using USB drives on servers.
> 
> Well I'm definitely currently not using USB drives on this server. :-(
> 
> If possible, can the stuff that was being done on /levi (jenkins for
> Cython) be moved to /scratch, which is a reasonably fast NFS
> filesystem.

The whole Jenkins installation was on /levi (maybe not our best idea
ever...). I have backups of the complete configuration, but we'd still
loose the installed plugins and the build history. We'd literally start
from scratch and it would take some time to set it all up again. If it
turns out to be a matter of replugging the USB drive (or something
similarly simple), I would prefer copying the original installation over
(including the build history), rather than rebuilding it.

Also, the sage build directory was on levi and I don't know how that was
set up - Robert would know.

Stefan
(Continue reading)

Permalink | Reply | 25 comments |
headers
Robert Bradshaw | 22 Mar 2012 17:06
Picon

Re: [Cython] sage.math problems?

On Thu, Mar 22, 2012 at 6:11 AM, William Stein <wstein <at> gmail.com> wrote:
> On Thu, Mar 22, 2012 at 9:04 AM, David Kirkby <david.kirkby <at> onetel.net> wrote:
>> On 22 March 2012 12:33, William Stein <wstein <at> gmail.com> wrote:
>>> The usb device (for /levi) never appeared after I remotely rebooted sage.math.
>>> Physical access is thus probably required.  I've emailed some people who are in
>>> Seattle, and we'll see.  (I'm thousands of miles away now, and will
>>> only get further away
>>> -- to Europe -- until Apr 2, when I'll be back in Seattle.)
>>
>> I believe any decent IT professional will tell you that you should not
>> be using USB drives on servers.
>
> Well I'm definitely currently not using USB drives on this server. :-(
>
> If possible, can the stuff that was being done on /levi (jenkins for
> Cython) be moved to /scratch, which is a reasonably fast NFS
> filesystem.

The Cython tests do a lot of disk IO (checking out the Cython
repository, writing .c files, writing .o and .so files, starting
Python, ..). This could be an nsf mount, but is there somewhere
better? I think we'd like to store our configuration information in a
more persistant location.

- Robert
_______________________________________________
cython-devel mailing list
cython-devel <at> python.org
http://mail.python.org/mailman/listinfo/cython-devel
(Continue reading)

Permalink | Reply | 0 comments |

Gmane