Kevin Fenzi | 24 May 23:45
Gravatar

Yet another freeze break: reviewstatus

I'd like to revert puppet commits: 

55103ec6ce3a80234391229f6b10e220fa13e72d
5b131d0e489f5349d5cef6a8e0ffdc2febda0441

This reverts review-stats.py to the version that we had before monday,
which was working with the old python-bugzilla (which we have already
reverted to). 

I've tested it locally and it does only make 6 bugzilla calls when used
with the python-bugzilla version we have reverted to, so we shouldn't
be causing undue load on bugzilla. 

I'd also like to: 

diff --git a/modules/review-stats/manifests/init.pp b/modules/review-stats/manifests/init.pp
index 9a016a5..0376a77 100644
--- a/modules/review-stats/manifests/init.pp
+++ b/modules/review-stats/manifests/init.pp
@@ -57,7 +57,7 @@ class review-stats::build inherits review-stats {
         command => "/usr/bin/python /usr/local/bin/pyGetReviewByFlags.py -t
/usr/local/share/review-stats -d 
         user    => "apache",
         minute  => [ 0, 30 ],
-        ensure => "absent",
+        ensure => "present",
     }

 }

(Continue reading)

skvidal | 24 May 21:28
Favicon
Gravatar

[PATCH] - add db-fas01 to dns - add to puppet - based in larger part off of db01's recipe

From: Seth Vidal <skvidal <at> fedoraproject.org>

---
 manifests/nodes/db-fas01.phx2.fedoraproject.org  |   18 ++++++++++++++++++
 modules/bind/files/master/126.5.10.in-addr.arpa  |    4 ++--
 modules/bind/files/master/phx2.fedoraproject.org |    3 ++-
 3 files changed, 22 insertions(+), 3 deletions(-)
 create mode 100644 manifests/nodes/db-fas01.phx2.fedoraproject.org

diff --git a/manifests/nodes/db-fas01.phx2.fedoraproject.org b/manifests/nodes/db-fas01.phx2.fedoraproject.org
new file mode 100644
index 0000000..ac90bf9
--- /dev/null
+++ b/manifests/nodes/db-fas01.phx2.fedoraproject.org
@@ -0,0 +1,18 @@
+node db01-fas.phx2.fedoraproject.org {
+    $bacula5 = "true"
+    # re-enable this once we have db's setup. 
+    # $backup_db_often = true
+    include phx
+    include db
+    include appDB-el6
+    collectd::collectd { 'log02': }
+    collectd::postgres { 'postgres':
+       databases => ['fas']
+    }
+
+    # Workaround for bug 768055
+    semanage_fcontext { '/usr/lib64/nagios/plugins/check_disk':
+        type => 'nagios_unconfined_plugin_exec_t'
(Continue reading)

seth vidal | 24 May 20:15
Favicon
Gravatar

Freeze Break: shutdown search01-dev on virthost05 - setup db-fas01 on virthost05

This will be a first step to migrate to a private fas postgres instance.

In order to free up mem and procs I would like to shutdown search01-dev
on virthost05 and bring up db-fas01 on there.

The goal would be a private postgres db server for fas alone.

I will be kickstarting a vm on virthost05 and then adding entries to
puppet/dns to accommodate this.

I need some +1's to break the freeze to make this happen.

thanks,
-sv
_______________________________________________
infrastructure mailing list
infrastructure <at> lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Toshio Kuratomi | 24 May 17:01
Picon
Gravatar

[Change Request] Fix pkgdb privileged operations for old python-bugzilla

As part of two situations I've pushed out a hotfix to pkgdb and would like
two +1's for the change.

The situations:
* Continuing work to get our apps working with the old python-bugzilla
  package from yesterday's problems between infrastructure and bugzilla
* Unknown causes of downtime for the fas servers.

We're currently trying to determine what's causing the second situation to
recur ~ every two hours.  As part of that we're trying to fix anything that
is out of the ordinary. So I've pushed this fix out and verified it works
with the reporter.  If I could get two +1's for after the fact application
during change freeze, that would be great.

The change:
When PackageDB makes changes to who owns a package or creates a new package
it needs to login to bugzilla and find out if the new owner has a bugzilla
account.  Those connections were failing for the same reason as fas's
export-bugzilla was failing yesterday: the older version of python-bugzilla
does not know how to get this information out of the new version of
bugzilla.  The fix is the same as yesterday's fix to export-bugzilla: for
now, use the RHBugzilla3 compatibility API to get this information.

https://fedorahosted.org/fedora-infrastructure/ticket/3304

diff --git a/modules/hotfix/files/pkgdb/utils.py b/modules/hotfix/files/pkgdb/utils.py
index 021a80f..8c121c5 100644
--- a/modules/hotfix/files/pkgdb/utils.py
+++ b/modules/hotfix/files/pkgdb/utils.py
@@ -51,7 +51,7 @@ from cherrypy import request
(Continue reading)

cyberworm | 24 May 04:09

Re: Hello to everybody

I am looking forward to introduce myself in the weekly meeting :)

Ivan Garcia 

On Mon, 2012-05-21 at 17:29 +0000,
infrastructure-request <at> lists.fedoraproject.org wrote:
> Send infrastructure mailing list submissions to
> 	infrastructure <at> lists.fedoraproject.org
> 
> To subscribe or unsubscribe via the World Wide Web, visit
> 	https://admin.fedoraproject.org/mailman/listinfo/infrastructure
> or, via email, send a message with subject or body 'help' to
> 	infrastructure-request <at> lists.fedoraproject.org
> 
> You can reach the person managing the list at
> 	infrastructure-owner <at> lists.fedoraproject.org
> 
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of infrastructure digest..."
> 
> 
> Today's Topics:
> 
>    1. Freeze break request: Update python-bugzilla on fas*, bapp01,
>       app* (Kevin Fenzi)
>    2. Re: Introduction (Kevin Fenzi)
>    3. Re: Freeze break request: Update python-bugzilla on fas*,
>       bapp01, app* (seth vidal)
>    4. Re: hello to everybody (Kevin Fenzi)
>    5. Re: Freeze break request: Update python-bugzilla on fas*,
(Continue reading)

Kevin Fenzi | 24 May 01:52
Gravatar

Plan for tomorrow's Fedora Infrastructure meeting (2012-05-24 18UTC)

The infrastructure team will be having it's weekly meeting tomorrow, 
2012-05-24 at 18:00 UTC in #fedora-meeting on the freenode network.

Suggested topics:

#topic New folks introductions and Apprentice tasks.

If any new folks want to give a quick one line bio or any apprentices
would like to ask general questions, they can do so here. 

#topic two factor auth status

#topic Fedora 17 Release tickets

#topic Applications status / discussion

Check in on status of our applications: pkgdb, fas, bodhi, koji,
community, voting, tagger, packager, dpsearch, etc. 
If there's new releases, bugs we need to work around or things to note. 

#topic Upcoming Tasks/Items 

#info 2012-05-08 to 2012-05-29 FINAL FREEZE
#info 2012-05-29 - F17 release
#info 2012-06-01 - nag fi-apprentices.
#info 2011-06-03 - gitweb-cache removal day.
#info 2012-06-04 - class B reboots?
#info 2012-06-05 - class A reboots?
#info 2012-06-08 OOW: osuosl01.fedoraproject.org
#info 2012-06-17 OOW: sign-vault02.phx2.fedoraproject.org
(Continue reading)

Jeremy Davis | 24 May 01:05
Picon

Questions regarding Koji, fedpkg and SCM

Hello List,


I hope I picked the correct mailing list to ask these types of questions.

In my environment we are trying to setup a koji build system using the same structure that you all use for the Fedora project. This involves using fedpkg (modified for our environment) to import the SRPM into the SCM and then tell koji to build. We have everything working with our environment but have to do a couple of things manually. Mainly the SCM creation and adding a tag for the package in koji before the user is allow to add their srpm to the SCM and build with koji (get the error that it can't tag if a tag is not created before hand). Once we create the SCM and add the tag into Koji everything works as it should based on the documentation I have read.

My question is this. Do you by chance have any tools that automate the SCM creation and koji tag adding? Is this how you all manage packages in Fedora? Do you have to manually create SCM and koji tags when a user wants to add a new package to Fedora? Any assistance you could provide would be greatly appreciated. 

Note: This is for an internal package build system for my company and will only be used as such. I am willing to share what I have done as the fedpkg will also be used to push the packages into our Spacewalk environment and also push those packages to systems within Spacewalk (with some custom code that I am adding to fedpkg and renaming that command to fit into our naming convention).

Thank you for your time and have a great day!

Regards,
Jeremy 
_______________________________________________
infrastructure mailing list
infrastructure <at> lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Toshio Kuratomi | 23 May 17:39
Picon
Gravatar

[Freeze break Request] Disable bugzilla integration

The bugzilla admins at redhat notified us that they were having load issues
since the bugzilla upgrade caused by infrastructure's hosts.  It seems that
at least one of our scripts is exercising bugs in the new bugzilla codebase.
They've asked us to turn off all of our cron jobs for now so that they can
stabilise the platform and then we'll go through and see if we can identify
the problem query(-ies)  and fix it either on our side or in bugzilla.

Since this is an emergency, we've disabled the cron jobs first -- sending
the patch here for +1's to break freeze and so we know what to revert when
the time comes.

While these are disabled, the following things will not work:

* changes in user status in fas (users joining and leaving packager or
  fedorabugs) will not be reflected to bugzilla
* The cached review status pages will not update
* The easyfix.fedoraproject.org bugs list will not update
* Changes in package ownership will not propogate from the packagedb to
  bugzilla
* New packages won't be added to bugzilla (although they should be able to
  be added to the packagedb and git).

-Toshio
From af0cabefef3d7264050ca75392bfc14156f4c32d Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?Toshio=20=E3=81=8F=E3=82=89=E3=81=A8=E3=81=BF?= <toshio@...>
Date: Wed, 23 May 2012 15:21:01 +0000
Subject: [PATCH] Disable bugzilla cron jobs

---
 manifests/services/bugzilla.pp             |    2 +-
 modules/fas/manifests/init.pp              |    1 +
 modules/fedora-packagedb/manifests/init.pp |    1 +
 modules/gather-easyfix/manifests/init.pp   |    1 +
 modules/review-stats/manifests/init.pp     |    1 +
 5 files changed, 5 insertions(+), 1 deletions(-)

diff --git a/manifests/services/bugzilla.pp b/manifests/services/bugzilla.pp
index 21b086e..f55a123 100644
--- a/manifests/services/bugzilla.pp
+++ b/manifests/services/bugzilla.pp
@@ -12,7 +12,7 @@ class bugzilla-no-balance {
         command => "/usr/local/bin/bz-make-components.py
'http://git.fedorahosted.org/git/?p=l10n/owners.git;a=blob_plain;f=owners.list;hb=master'
'http://git.fedorahosted.org/git/?p=docs/owners.git;a=blob_plain;f=owners.list;hb=master'
&> /dev/null",
         user => "apache",
         minute => 20,
-        ensure => present,
+        ensure => absent,
         require => Package['fedora-packagedb']
     }
 }
diff --git a/modules/fas/manifests/init.pp b/modules/fas/manifests/init.pp
index f06ef8b..e20ca1f 100644
--- a/modules/fas/manifests/init.pp
+++ b/modules/fas/manifests/init.pp
@@ -372,6 +372,7 @@ class fas::app::nobalance inherits fas::app {
         minute      => 10,
         require     => Package["fas"],
         environment => "MAILTO=root",
+        ensure => "absent",
     }

 }
diff --git a/modules/fedora-packagedb/manifests/init.pp b/modules/fedora-packagedb/manifests/init.pp
index 724080c..1244f1f 100644
--- a/modules/fedora-packagedb/manifests/init.pp
+++ b/modules/fedora-packagedb/manifests/init.pp
@@ -87,6 +87,7 @@ class fedora-packagedb::app::nobalance inherits fedora-packagedb::app {
         command => "/usr/bin/pkgdb-sync-bugzilla > /dev/null 2> /dev/null",
         user => "root",
         minute => 10,
+        ensure => "absent",
     }
 }

diff --git a/modules/gather-easyfix/manifests/init.pp b/modules/gather-easyfix/manifests/init.pp
index aae2b9e..b0be432 100644
--- a/modules/gather-easyfix/manifests/init.pp
+++ b/modules/gather-easyfix/manifests/init.pp
@@ -85,6 +85,7 @@ class gather-easyfix::build inherits gather-easyfix {
         command => "cd /srv/web/gather-easyfix && /usr/bin/python /usr/local/bin/gather_easyfix.py",
         user    => "apache",
         minute  => [ 0, 30 ],
+        ensure => "absent",
     }

 }
diff --git a/modules/review-stats/manifests/init.pp b/modules/review-stats/manifests/init.pp
index 01c51a3..9a016a5 100644
--- a/modules/review-stats/manifests/init.pp
+++ b/modules/review-stats/manifests/init.pp
@@ -57,6 +57,7 @@ class review-stats::build inherits review-stats {
         command => "/usr/bin/python /usr/local/bin/pyGetReviewByFlags.py -t
/usr/local/share/review-stats -d /srv/web/review-stats/",
         user    => "apache",
         minute  => [ 0, 30 ],
+        ensure => "absent",
     }

 }
--

-- 
1.7.2.1

_______________________________________________
infrastructure mailing list
infrastructure <at> lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure
pingou | 23 May 16:50
Picon
Gravatar

[PATCH] No cookie for easyfix

From: Pierre-Yves Chibon <pingou <at> pingoured.fr>

---
 modules/gather-easyfix/files/gather_easyfix.py |    3 ++-
 1 files changed, 2 insertions(+), 1 deletions(-)

diff --git a/modules/gather-easyfix/files/gather_easyfix.py b/modules/gather-easyfix/files/gather_easyfix.py
index 9a42777..4a6cd3e 100755
--- a/modules/gather-easyfix/files/gather_easyfix.py
+++ b/modules/gather-easyfix/files/gather_easyfix.py
@@ -38,7 +38,8 @@ from kitchen.text.converters import to_bytes
 from jinja2 import Template

 __version__ = '0.1.1'
-bzclient = RHBugzilla(url='https://bugzilla.redhat.com/xmlrpc.cgi')
+bzclient = RHBugzilla(url='https://bugzilla.redhat.com/xmlrpc.cgi', 
+   cookiefile=None)
 # So the bugzilla module has some way to complain
 logging.basicConfig()

--

-- 
1.7.2.1

_______________________________________________
infrastructure mailing list
infrastructure <at> lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure
pingou | 23 May 16:40
Picon
Gravatar

[PATCH] Typos...

From: Pierre-Yves Chibon <pingou <at> pingoured.fr>

---
 modules/review-stats/files/review-stats.py |    2 +-
 1 files changed, 1 insertions(+), 1 deletions(-)

diff --git a/modules/review-stats/files/review-stats.py b/modules/review-stats/files/review-stats.py
index 0afe64b..ea5b89a 100755
--- a/modules/review-stats/files/review-stats.py
+++ b/modules/review-stats/files/review-stats.py
@@ -180,7 +180,7 @@ def run_query(bz):
         querydata['v1'] = 'fedora-review' + i
         b1 = bz.query(querydata)
         for bug in b1:
-            b1.last_change_time = datetime.datetime.strptime(b1.last_change_time.value, "%Y%m%dT%H:%M:%S")
+            bug.last_change_time = datetime.datetime.strptime(bug.last_change_time.value, "%Y%m%dT%H:%M:%S")
             bugdata[bug.bug_id] = {}
             bugdata[bug.bug_id]['hidden'] = 0
             bugdata[bug.bug_id]['blocks'] = []
--

-- 
1.7.2.1

_______________________________________________
infrastructure mailing list
infrastructure <at> lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Kevin Fenzi | 21 May 18:38
Gravatar

Freeze break request: Update python-bugzilla on fas*, bapp01, app*

After the bugzilla upgrade this weekend a few things we run related to
bugzilla are having issues: 

1) on fas01, the script that sets fedorabugs and fedora_contrib on users
in those fedora groups isn't working. 

2) on bapp01, the cron job that gathers easyfix bugzilla bugs is not
working. 

3) pkgdb, which runs on app servers isnt' able to handle adding new
packages. (we aren't sure what the error here is, but is likely bz
related). 

I have taken a snapshot of python-bugzilla and built a package of it. 
Changes: 
http://git.fedorahosted.org/git/?p=python-bugzilla.git
Scratch build: 
http://koji.fedoraproject.org/koji/taskinfo?taskID=4091680
(This is just a git head checkout build)

1) I have tested on fas01.stg the script that sets permissions
against partner-bugzilla.redhat.com and the updated python-bugzilla. It
no longer errors and completes normally. 

2) gather easyfix needs more changes and is not fixed by
python-bugzilla update. Look for fix after this email from pingou. 

3) We aren't sure the new python-bugzilla will fix the pkgdb adding
packages issue, but should get us closer to a fix. 

I would like to add the new python-bugzilla to our infrastructure repo
(for now until there's an official one in epel) and update fas*,
bapp01, and app*. In the event of failure, we can downgrade back to the
previous version with a yum downgrade. 

+1s?

kevin
_______________________________________________
infrastructure mailing list
infrastructure <at> lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Gmane