buildbot, an automated build tool, development and release announcement list

Terry.Rankine | 4 Sep 2007 05:50

Picon

Picon

Reading output from slave command

Hi

I have a build process that creates files, to which I don't know the
names of.
I want to then upload them back to the buildmaster.

Can I integrate the output from a shellcommand and manipulate its
contents into a string for the upload step?

Would look like:

xmlnmodelScons.addStep(shell.ShellCommand, command=["scons", "-c"],
workdir="build")
xmlnmodelScons.addStep(shell.ShellCommand, command=["scons"],
workdir="build")
xmlnmodelScons.addStep(shell.ShellCommand, command=["scons", "test"],
workdir="build")
xmlnmodelScons.addStep(shell.ShellCommand, command=["scons", "package"],
workdir="build")

getoutput = lastStep.output()
Do stuff to output - extract the_file_name

xmlnmodelScons.addStep(FileUpload, slavesrc="%s" % (the_file_name),
masterdest="%s" %(the_file_name) )

Regards,

Terry Rankine

(Continue reading)

christian unger | 3 Sep 2007 16:45

Picon

new CI plugin on trac.edgewall.org


Hi Brian,

since I just stumbled across this:

http://bitten.edgewall.org/
A continuous integration plugin for Trac.

what's the status of the Trac plugin you're working on?

cu
christian unger

-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/

Hacksaw | 5 Sep 2007 21:41

buildmaster almost starts, but doesn't really

I'm trying to get 0.7.5 going, and I have what I think is a reasonable 
master.cfg. But something must be wrong, because it never finishes starting:

[root <at> asimov Buildbot]# buildbot restart ~/Buildbot/
buildbot process 21680 is dead
now restarting buildbot process..
Following twistd.log until startup finished..
2007/09/05 15:05 -0400 [-] Log opened.
2007/09/05 15:05 -0400 [-] twistd 2.5.0 (/usr/bin/python 2.4.2) starting up
2007/09/05 15:05 -0400 [-] reactor class: <class 
'twisted.internet.selectreactor.SelectReactor'>
2007/09/05 15:05 -0400 [-] Loading buildbot.tac...
2007/09/05 15:05 -0400 [-] Loaded.
2007/09/05 15:05 -0400 [-] loading configuration from 
/home/dtodd/Buildbot/master.cfg
2007/09/05 15:05 -0400 [-] twisted.conch.manhole_ssh.ConchFactory 
starting on 9999
2007/09/05 15:05 -0400 [-] Starting factory 
<twisted.conch.manhole_ssh.ConchFactory instance at 0xb79f10cc>
2007/09/05 15:05 -0400 [-] Manhole listening via SSH on port 
tcp:9999:interface=127.0.0.1
2007/09/05 15:05 -0400 [-] adding new builder componentFramework for 
category None
2007/09/05 15:05 -0400 [-] trying to load status pickle from 
/home/dtodd/Buildbot/full/builder
2007/09/05 15:05 -0400 [-] added builder componentFramework in category None
2007/09/05 15:05 -0400 [-] adding IStatusReceiver <Waterfall on port 
tcp:8010>
2007/09/05 15:05 -0400 [-] twisted.web.server.Site starting on 8010
2007/09/05 15:05 -0400 [-] Starting factory <twisted.web.server.Site

(Continue reading)

Axel Hecht | 6 Sep 2007 13:12

Re: buildmaster almost starts, but doesn't really

2007/9/5, Hacksaw <dtodd@...>:
> I'm trying to get 0.7.5 going, and I have what I think is a reasonable
> master.cfg. But something must be wrong, because it never finishes starting:
>
> [root <at> asimov Buildbot]# buildbot restart ~/Buildbot/
> buildbot process 21680 is dead
> now restarting buildbot process..
> Following twistd.log until startup finished..
> 2007/09/05 15:05 -0400 [-] Log opened.
> 2007/09/05 15:05 -0400 [-] twistd 2.5.0 (/usr/bin/python 2.4.2) starting up
> 2007/09/05 15:05 -0400 [-] reactor class: <class
> 'twisted.internet.selectreactor.SelectReactor'>
> 2007/09/05 15:05 -0400 [-] Loading buildbot.tac...
> 2007/09/05 15:05 -0400 [-] Loaded.
> 2007/09/05 15:05 -0400 [-] loading configuration from
> /home/dtodd/Buildbot/master.cfg
> 2007/09/05 15:05 -0400 [-] twisted.conch.manhole_ssh.ConchFactory
> starting on 9999
> 2007/09/05 15:05 -0400 [-] Starting factory
> <twisted.conch.manhole_ssh.ConchFactory instance at 0xb79f10cc>
> 2007/09/05 15:05 -0400 [-] Manhole listening via SSH on port
> tcp:9999:interface=127.0.0.1
> 2007/09/05 15:05 -0400 [-] adding new builder componentFramework for
> category None
> 2007/09/05 15:05 -0400 [-] trying to load status pickle from
> /home/dtodd/Buildbot/full/builder
> 2007/09/05 15:05 -0400 [-] added builder componentFramework in category None
> 2007/09/05 15:05 -0400 [-] adding IStatusReceiver <Waterfall on port
> tcp:8010>
> 2007/09/05 15:05 -0400 [-] twisted.web.server.Site starting on 8010

(Continue reading)

Kevin Turner | 7 Sep 2007 00:18

Re: buildmaster almost starts, but doesn't really

On Wed, 2007-09-05 at 15:41 -0400, Hacksaw wrote:
> I'm trying to get 0.7.5 going, and I have what I think is a reasonable 
> master.cfg. But something must be wrong, because it never finishes starting:

[...]

> 2007/09/05 15:05 -0400 [-] BuildMaster listening on port tcp:9989
> 2007/09/05 15:05 -0400 [-] configuration update started
> 2007/09/05 15:05 -0400 [-] Unhandled error in Deferred:

I just ran in to this exact same error today.  Using buildbot 0.7.5 as
installed by the ubuntu feisty package.  And Alex, that is the _end_ of
the log, the "interesting" part is curiously missing.

-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/

David Bolen | 7 Sep 2007 07:43

Picon

buildslave keepalive and clock jumps

I'm running a buildslave under FreeBSD within a VMWare image that uses
a vmware-guestd package to keep the clock in sync with the host, since
otherwise the FreeBSD clock runs too slowly. But under load, the clock
can jump in quite large increments in order to sync up (sometimes as
much as a minute or two).

The current slave behavior is to schedule two independent timers, one
to trigger a keepalive to the master in advance of the keepalive
timeout, and the other to check inactivity.  The problem is that if
your clock is subject to jumps, the scheduled gap between them can
shrink, to nothing in some cases, and they can both end up firing back
to back.  In such a case the slave times out the master before there
is even time to get a response back.  In theory scheduling the
keepalive in advance of the overall activity timeout should cover
this, but that falls apart if you have skips in time.

A small change seems to handle this better - if the scheduling of the
activity check is only made once the keepalive has been sent, then it
is relative to the scheduling of the keepalive generation, and slides
forward should clock updates delay execution of the keepalive, always
ensuring enough time for a properly working master to respond.

For example, the attached diff, from a 0.7.5 installation, moves
the activityTimer setup into doKeepalive.

This does perhaps open up more opportunity for an overall slippage of
the keepalive timeout window, but it should be minimal outside of
actual time loss on the system, as nothing within the doKeepalive
routine should block or take a significant amount of time.  It makes
the keepalive checking more robust should clock changes affect the

(Continue reading)

Todd, David | 6 Sep 2007 14:40

Re: buildmaster almost starts, but doesn't really

On 2007/09/06 7:12, "Axel Hecht" <l10n.moz@...> wrote:

> 2007/9/5, Hacksaw <dtodd@...>:
>> I'm trying to get 0.7.5 going, and I have what I think is a reasonable
>> master.cfg. But something must be wrong, because it never finishes starting:
>> 
>> [root <at> asimov Buildbot]# buildbot restart ~/Buildbot/
>> buildbot process 21680 is dead
>> now restarting buildbot process..
>> Following twistd.log until startup finished..
>> 2007/09/05 15:05 -0400 [-] Log opened.
>> 2007/09/05 15:05 -0400 [-] twistd 2.5.0 (/usr/bin/python 2.4.2) starting up
>> 2007/09/05 15:05 -0400 [-] reactor class: <class
>> 'twisted.internet.selectreactor.SelectReactor'>
>> 2007/09/05 15:05 -0400 [-] Loading buildbot.tac...
>> 2007/09/05 15:05 -0400 [-] Loaded.
>> 2007/09/05 15:05 -0400 [-] loading configuration from
>> /home/dtodd/Buildbot/master.cfg
>> 2007/09/05 15:05 -0400 [-] twisted.conch.manhole_ssh.ConchFactory
>> starting on 9999
>> 2007/09/05 15:05 -0400 [-] Starting factory
>> <twisted.conch.manhole_ssh.ConchFactory instance at 0xb79f10cc>
>> 2007/09/05 15:05 -0400 [-] Manhole listening via SSH on port
>> tcp:9999:interface=127.0.0.1
>> 2007/09/05 15:05 -0400 [-] adding new builder componentFramework for
>> category None
>> 2007/09/05 15:05 -0400 [-] trying to load status pickle from
>> /home/dtodd/Buildbot/full/builder
>> 2007/09/05 15:05 -0400 [-] added builder componentFramework in category None
>> 2007/09/05 15:05 -0400 [-] adding IStatusReceiver <Waterfall on port

(Continue reading)

o.rusterholz-goEDY2E6dbVyDzI6CaY1VQ@public.gmane.org | 7 Sep 2007 13:38

Picon

Don't show changes column

Hi,

I'm looking for a possibility to hide the changes column in the 
waterfall display. Is there an easy (or also not so easy) way to do 
that? I've bin looking through the waterfall.py code but it seems to 
be quite complex and before I spend hours on that I rather ask if 
anybody knows something. Perhaps I just have to comment a line or two 
somewhere and missed that... 

Oliver

-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/

Charles Lepple | 7 Sep 2007 19:29

Picon

Re: Don't show changes column

On 9/7/07, o.rusterholz@...
<o.rusterholz@...> wrote:
> I'm looking for a possibility to hide the changes column in the
> waterfall display. Is there an easy (or also not so easy) way to do
> that? I've bin looking through the waterfall.py code but it seems to
> be quite complex and before I spend hours on that I rather ask if
> anybody knows something. Perhaps I just have to comment a line or two
> somewhere and missed that...

Would it work if you set the display mode of the CSS "Changes" class
to none? Or do you not want that information in the waterfall HTML
source at all?

--

-- 
- Charles Lepple

-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/

Kevin Turner | 7 Sep 2007 21:50

Re: buildmaster almost starts, but doesn't really

On Thu, 2007-09-06 at 08:40 -0400, Todd, David wrote:
> >> 2007/09/05 15:05 -0400 [-] Starting factory <twisted.web.server.Site
> >> instance at 0xb790b66c>
> >> 2007/09/05 15:05 -0400 [-] BuildMaster listening on port tcp:9989
> >> 2007/09/05 15:05 -0400 [-] configuration update started
> >> 2007/09/05 15:05 -0400 [-] Unhandled error in Deferred:
[...]
> Sadly, that is exactly the end of the log, I just checked. And I left it
> running all last night. It's sort of working, in that I can see a website,
> (and could a few seconds after it started) but connecting the debugclient to
> it fails.

In my instance, the process is not listening on that port 9989 that it
claimed to be.  According to netstat, the only port the process is
listening on is the one for the waterfall view.

-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/

Group

gmane.comp.python.buildbot.devel.

Project Web Page

buildbot, an automated build tool, development and release announcement list

Search Archive

Page

1 | 2 | 3 | 4 | 5 | 6

Articles in period: 59

September 2007

Language

Change language

Options

Current view: Threads only / Showing only 20 lines / Not hiding cited text.
Change to All messages, whole messages, or hide cited text.

Post a message
NNTP Newsgroup
Classic Gmane web interface
XML

XML

RSS Feed
List Information

About Gmane

Recent entries

get current buildrequest buildsetid from buildstep (24 May 2013)
Twisted exception with Buildbot 0.8.5 + Mercurial hook (24 May 2013)
How to set revlinks (22 May 2013)
User Question: 1 builder -> 2 buildslaves (18 May 2013)
Getting pass/fail status from JSON API (18 May 2013)
Conceptual Questions: Change-based BuildStep (16 May 2013)
e-mail notifications based on scheduler type (16 May 2013)
Tools for GSoC mentors (15 May 2013)
Template folder (15 May 2013)
Buildbot nine template path (15 May 2013)
Grace Hopper Open Source Day (15 May 2013)
How many project per master? (14 May 2013)
subversion push to buildbot (14 May 2013)
Consoldate Build Failure Emails? (10 May 2013)
show hidden/all build steps in web views? (10 May 2013)
HTTP request steps (6 May 2013)
Trouble wiring up a web hook change source. (4 May 2013)
What will happen if I do reconfig when BuildSlaves are building ? Is i (4 May 2013)
[ANN] Project Leadership Committee (2 May 2013)
Configuring ssh keys for buildbot service account (for git) (2 May 2013)
Multi-buildsteps and output environments (24 Apr 2013)

Archives

50	May 2013
89	April 2013
107	March 2013
61	February 2013
101	January 2013
73	December 2012
119	November 2012
87	October 2012
95	September 2012
92	August 2012
83	July 2012
34	June 2012
51	May 2012
87	April 2012
117	March 2012
64	February 2012
36	January 2012
36	December 2011
81	November 2011
77	October 2011
127	September 2011
57	August 2011
103	July 2011
133	June 2011
87	May 2011
83	April 2011
105	March 2011
98	February 2011
160	January 2011
91	December 2010
120	November 2010
82	October 2010
77	September 2010
125	August 2010
118	July 2010
149	June 2010
134	May 2010
147	April 2010
148	March 2010
183	February 2010
236	January 2010
133	December 2009
37	November 2009
37	October 2009
77	September 2009
91	August 2009
235	July 2009
81	June 2009
115	May 2009
93	April 2009
131	March 2009
171	February 2009
117	January 2009
104	December 2008
85	November 2008
72	October 2008
130	September 2008
192	August 2008
148	July 2008
99	June 2008
73	May 2008
121	April 2008
81	March 2008
95	February 2008
134	January 2008
60	December 2007
149	November 2007
66	October 2007
53	September 2007
78	August 2007
107	July 2007
60	June 2007
89	May 2007
89	April 2007
74	March 2007
74	February 2007
78	January 2007
48	December 2006
83	November 2006
90	October 2006
101	September 2006
87	August 2006
36	July 2006
79	June 2006
85	May 2006
129	April 2006
83	March 2006
20	February 2006
68	January 2006
14	December 2005
105	November 2005
63	October 2005
22	September 2005
21	August 2005
59	July 2005
64	June 2005
62	May 2005
86	April 2005
8	March 2005
3	February 2005

Design

Zawodny | Right Menu | Left Menu

Your Own Design

Paste the URL of your CSS below. Download CSS template