Thomas K. Adamcik | 1 Feb 2010 10:17
Picon
Picon

Re: SV: Jabber dispatcher clogs the whole alertqueue

On Tue, Jan 26, 2010 at 04:00:37PM +0100, Stokkenes Vidar wrote:
> Are there any modifications planned to maybe supress queued up SMS messages
> after a crash?

Created https://bugs.launchpad.net/nav/+bug/515403 to address this issue.

--

-- 
mvh
Thomas Kongevold Adamcik

Thomas K. Adamcik | 1 Feb 2010 10:10
Picon
Favicon
Gravatar

Re: Jabber dispatcher clogs the whole alertqueue

On Mon, Jan 25, 2010 at 12:45:31PM +0100, Ingeborg Hellemo wrote:
> Is it possible to add a timeout or something to  jabber_dispatcher.py to
> prevent this to happen?

Created https://bugs.launchpad.net/nav/+bug/515400 for this issue and
subscribed you to the bug. Should have a workaround or fix within the
day :)

--

-- 
mvh
Thomas Kongevold Adamcik

Geir Inge Jensen | 2 Feb 2010 10:17
Picon

Module mapping problems

Hi,

 

I thought I should give NAV a tryout in a large service provider network. After some initial problems fetching the device information for some devices (had to remove the OSPF oid) I was finally up and running. I had to add all my device types but that was easily done (I have mostly Cisco 7600 and 7300 series devices). However, NAV has a huge problem trying to figure out which module each port belongs to (especially the 10Gb ports). Attached is a device info screen grab of one of my modules (module 5), and as you can see NAV things the module has ports from module 1, 2, 4 (and 5) as well as loopbacks and vlans. Other parts of NAV seems to get things correct (the explorer) however because of these problems they can’t detect where the port connects to (link type “none”). Which sadly makes NAV useless. Is there a way I can fix this?

 

Whenever the device info is able to pinpoint which module the port belongs to it is also able to detect the device the port connects to (including the 10Gb ports). However, that seems to be the exception and not the rule.

 

FYI, the screen grab is from a 7609 running SRD1.

 

Regards,

Geir Inge Jensen

 

Stokkenes Vidar | 5 Feb 2010 10:27
Picon

Observing Voice VLAN enabled ports?

Hello everyone,

I am wondering if anyone have found a way to use NAV to see if a certain port is voice vlan enabled? I submitted a
LP ticket about this quite some time back, but I didn't receive a reply or any feedback on it
(https://bugs.launchpad.net/nav/+bug/362233) Typically we have VoIP-people dropping by our office
asking "Is Port44 on switch-2.hostname.com voice enabled, and which voice vlan?" I thought maybe IP
Device Info would show this in forms of another vlan, but it doesn't.

It would be to great value for us atleast :-)

------------------------------------------------------
Vidar Stokkenes

Morten Brekkevold | 5 Feb 2010 13:47
Picon
Picon
Gravatar

Re: SV: Jabber dispatcher clogs the whole alertqueue

On Tue, 26 Jan 2010 16:00:37 +0100 Stokkenes Vidar
<Vidar.Stokkenes@...> wrote:

> Not entirely related, but I might as well mention it..
>
> I hope the developers can add some kind of logics to supress queued
> SMS messages in the alert queue after restarting smsd after a
> crash. We've had situations where smsd has pushed out 100-200 SMS
> messages after a restart, often more than 20 messages to one mobile
> phone.
>
> Are there any modifications planned to maybe supress queued up SMS messages after a crash?

All queued SMS messages can be suppressed manually prior to a
restart using the -c option to smsd.py  See "smsd.py -h" for more help
on command line options to the daemon.

--

-- 
Morten Brekkevold
UNINETT

Morten Brekkevold | 16 Feb 2010 13:14
Picon
Picon
Gravatar

Announcement: NAV 3.5.5 released

NAV 3.5.5 is now available for download at Launchpad:
https://launchpad.net/nav/3.5/3.5.5

This release fixes 17 bugs in NAV 3.5.  The log of all changes to the
3.5 series is attached to this message.

A binary package for Debian 4 and 5 (Etch and Lenny) will be made
available as soon as possible. The Debian package is maintained by
Morten Werner Forsbring, on commission From UNINETT.

At the same time I would like to apologize for lack of responses to
mailing list posts the last few months.  We were hoping to have NAV
3.6 ready by now, but everything has been delayed due to the fact that
I was away from work for more than two months (beginning around 20th
November).

Happy NAVing everyone!

-- 
Morten Brekkevold
UNINETT

Version 3.5.5
(released 16 February 2010)

Bugfixes:

  * LP#383854 (Netmap RRD-values does not look for high speed data)
  * LP#390606 (Radius-GUI menu-tabs doesn't show)
  * LP#392475 (No such file or directory: '/etc/nav/rrdBrowser.conf')
  * LP#395091 (cleanrrds.pl does not support timeformat from gfind)
  * LP#395185 (Adding new components to a existing maintenance task forces you
               to create a new task)
  * LP#410168 (Alert Profiles crashes on filter deletion)
  * LP#412996 (Invalid Reports URL after login)
  * LP#416833 (Switch port report's links to machinetracker are faulty)
  * LP#419750 (Multiple Cheetah templates fail to compile due to wrong
               encoding)
  * LP#436589 (Radius link to session-details lead to wrong session)
  * LP#450279 (UnboundLocalErrors cause smsd crash)
  * LP#485725 (uninettmaildispatcher plugin throws python NameError on SMTP
               server error)
  * LP#485785 (Alertengine requires SMTP server on localhost)
  * LP#492188 (Missing 404.html - Django error in NAV-3.5.4)
  * LP#494036 (AlertEngine does not handle inconsistent database state)
  * LP#515400 (Jabber dispatcher blocks due to hanging jabber-server blocking
               alertengine)
  * LP#520505 (Alertengine reinitialises handlers for every send)

Version 3.5.4
(released 14 May 2009)

Regressions:

  * LP#376430 (Web login fails under Python >= 2.5)

Version 3.5.3
(released 13 May 2009)

New feature:

  * getBoksMacs (the camlogger) will attempt to retrieve the list of active
    VLANs on a Cisco device directly, to ensure it has an updated and accurate
    list of separate forwarding databases.  This should mostly solve the
    problem described in the currently last question of the NAV FAQ.

Bugfixes:

  * LP#276248 (Small css rendering bug in MachineTracker)
  * LP#324769 (netmap: lines do not terminate on the router)
  * LP#338638 (DC service checker doesn't work)
  * LP#338649 (DNS service checker doesn't work)
  * LP#338715 (RPC service checker doesn't work)
  * LP#338725 (SMB service checker doesn't work)
  * LP#341575 (ipdevinfo service list crashes)
  * LP#344140 (dnsMismatch shown as Downtime in IP Device Info)
  * LP#345783 (IP Device Availability shown as N/A, should be 100%)
  * LP#345853 (DataIOExceptions from Netmap when using Windows)
  * LP#347226 (AlertEngine mailbombs: AlertQueueMessage matching query does
               not exist)
  * LP#347776 (logengine crash on log messages with years in their timestamps)
  * LP#348853 (AttributeError on Alert Profiles permissions page)
  * LP#348892 (AlertEngine fails to confirm SMS privilege for non-admin users)
  * LP#351499 (Advanced search in reports crashes in Internet Explorer)
  * LP#352236 ("Delete selected" button on My SMS page, but there's nothing to
               delete.)
  * LP#352316 (Servicemon dies without a trace)
  * LP#353121 (No alert information when alerttype is missing from
               alertmsg.conf)
  * LP#366032 (Service availability shown as N/A, should be 100%)

Version 3.5.2
(released 17 March 2009)

 Security fixes:

  * LP#340516 (XSS on login-page)
  * LP#340542 (Possible XSS in Arnold)

 Bugfixes:

  * LP#285349 (ranked stat should include router ports)
  * LP#285352 (ranked stat sysuptime does not provide link to cricket)
  * LP#319590 (Cannot delete quarantine vlans in Arnold)
  * LP#319594 (Duplicate quarantine vlans can be registered in Arnold)
  * LP#334789 (Arnold crash when enabling missing port)
  * LP#341099 (Most alerts queued for daily or weekly dispatch are
               never dispatched)
  * LP#341561 (Servicemon crashes when service checker init fails)
  * LP#341617 (DummyChecker crashes servicemon in NAV 3.5.1)
  * LP#341619 (PostgreSQLChecker crashes servicemon in NAV 3.5.1)
  * LP#341733 (Multiple simultaneous pping processes)

Version 3.5.1
(released 09 March 2009)

Bugfixes:

  * LP#285362 (netmap: link to ipdevinfo port view on links)
  * LP#290192 (getBoksMacs syntax error SQLExceptions)
  * LP#322328 (Netmap backend fails when nav session id is missing)
  * LP#323087 (Parsing of VLAN routing interfaces is case sensitive)
  * LP#328451 (snmptrapd idles in db transactions)
  * LP#328544 (a hyphen in the organisation name results in an exception in
               useradmin)
  * LP#328959 (AlertEngine errormail storm on empty alert address)
  * LP#330058 (TypeError in IP Device Info)
  * LP#330062 (NullPointer and DataIOExceptions from Netmap)
  * LP#330425 (Undocumented dependency to python-xmpp)
  * LP#330426 (AlertEngine mailbombs admin on plugin failure)
  * LP#330436 (AlertEngine Jabber plugin crashes on missing config)
  * LP#330464 (Alerts sent outside of timeperiod)
  * LP#330513 (NameErrors in t1000.py)
  * LP#330914 (ipdevinfo crashes when room or org id contains spaces)
  * LP#330981 (SMTP service checker effectively DOSes SMTP server)
  * LP#335326 (Multiple simultaneous servicemon processes)
  * LP#335412 (Missing port number results in no Cricket stats for port)
  * LP#335462 (Status page crashes under PostgreSQL 8.3)
  * LP#335474 (Duplicate alerts sent to same address)
  * LP#337220 (smsd and snmptrapd don't clean up their pidfiles)
  * LP#337694 (radiusparser crash with UnboundLocalError)
  * LP#338254 (AlertEngine crashes when profile with queued alerts is
               deactivated)

Version 3.5.0
(released 22 January 2009)

  * LP#294191 (Useradmin and Userinfo gives Page not found (404))
  * LP#300649 (snmptrapd logs crash as normal exit)
  * LP#300657 (snmptrapd crashes while parsing a trap)
  * LP#302740 (autoenable in Arnold is not working)
  * LP#303120 (Machine Tracker switch search by IP address produces
               erroneous results)
  * LP#308943 (Quarantine VLAN dropdown list does not appear)
  * LP#309287 (Attempt to move or delete filter in filter group
               crashes Alert Profiles)
  * LP#309290 (Attempt to confirm filter expression deletion does not
               work)
  * LP#309703 (Freetext search in maintenance does not work with IE)
  * LP#315380 (No SMS alerts sent in NAV 3.5.0b3)
  * LP#316281 (snmptrapd crashes on SIGHUP signal)
  * LP#317028 (Undocumented dependency to pyrad)
  * LP#317413 (Missing argument to changePortStatus in arnold library)

Version 3.5.0b3
(release 04 December 2008)

#####################################################################
##  WARNING  WARNING  WARNING  WARNING  WARNING  WARNING  WARNING  ##
#####################################################################
##                                                                 ##
## This release makes changes to the NAV database. If you are      ##
## upgrading from a previous release you also need to upgrade your ##
## database schema. For information on how to upgrade the database ##
## schema, please take a look in doc/sql/upgrades for more         ##
## information.  See also the release NOTES for upgrade info.      ##
##                                                                 ##
#####################################################################

 Bugfixes:

  * LP#285360 (netmap: interfaces swapped in popup view)
  * LP#285361 (netmap: use domain_suffix for shorter names)
  * LP#286922 (Netmap displays layer 2 links as layer 3 links)
  * LP#291551 (Alerts queued for daily dispatch are never sent)
  * LP#293519 (Radius accounting log search crashes on blank username
               or iprange)
  * LP#293531 (ipdevinfo does not redirect directly to ipdevice when
               domain_suffix is not given)
  * LP#293624 (AlertEngine crashes with UnboundLocalError for local
               variable 'num_sent_alerts')
  * LP#294075 (Alter the popup text order on ports in ipdevinfo)
  * LP#294191 (Useradmin and Userinfo gives Page not found (404))
  * LP#294578 (AlertEngine crashes with UnboundLocalError for local
               variable 'queued_alerts')
  * LP#294590 ("connected to" missing from GSW port details in ipdevinfo)
  * LP#298034 (ipdevinfo crash on missing availability stats)
  * LP#298039 (3.5 sql upgrade script does not flush old alerts from db)
  * LP#299851 (Cannot view public filters and filter groups)
  * LP#300449 (Make metanav and launchpad links more accessible)
  * LP#302412 (Add link from alert queue to alerts table)
  * LP#303967 (AlertEngine crash: global name 'TimePeriod' is not defined)
  * LP#303969 (AlertEngine crash: AlertEngine crash: object has no
               attribute 'timperiod_set')
  * LP#303977 (navTemplate.py missing from NAV 3.5 betas)
  * LP#305159 (Report advanced search form cannot be opened)

Version 3.5.0b2
(released 03 November 2008)

#####################################################################
##  WARNING  WARNING  WARNING  WARNING  WARNING  WARNING  WARNING  ##
#####################################################################
##                                                                 ##
## This release makes changes to the NAV database. If you are      ##
## upgrading from a previous release you also need to upgrade your ##
## database schema. For information on how to upgrade the database ##
## schema, please take a look in doc/sql/upgrades for more         ##
## information.  See also the release NOTES for upgrade info.      ##
##                                                                 ##
#####################################################################

 New features and improvements:

  * Radius accounting module added.  Enables NAV to store accounting logs from
    FreeRADIUS servers in the database, and search this data in the web
    interface.

  * HP SwitchStack support removed.  This functionality would cause much grief
    for those who have non-SwitchStack devices from HP.  See release NOTES for
    more information about migrating to this version if you monitor HP
    devices.

  * The report tool now displays the timestamp of report results.  This
    enables the user to see whether the results are retrieved live or from the
    report cache.  The cache is now also invalidated immediately if the report
    configuration files are changed.

 Bugfixes:

  * LP#273030 (getDeviceData crashes with ConcurrentModificationException)
  * LP#276225 (Local reports crash)
  * LP#276230 (Report name missing from automated report list)
  * LP#276246 (Report's advanced search form cannot be closed)
  * LP#277569 (Duplicate result rows in Machine Tracker)
  * LP#280145 (getDeviceData and eventEngine stop working after PostgreSQL
               disconnect)
  * LP#283102 (ARP records are wrongly associated with scope/static/reserved
               prefixes)
  * LP#284939 (AlertEngine resends alerts over and over)
  * LP#284950 (AlertEngine re-sends SMS messages indefinitely)
  * LP#284952 (AlertEngine logs are too verbose at loglevel INFO)
  * LP#285328 (ipdevinfo crashes with TypeError traceback)
  * LP#285331 (Duplicate RRD file references)
  * LP#286309 (Add new subscription should check for missing alertaddres and
               filtergroups)
  * LP#287434 (DEFAULT_FROM_EMAIL setting missing from nav.conf example)
  * LP#289823 (AlertEngine idles in transactions)
  * LP#289825 (AlertEngine eats RAM)

 
Version 3.5.0b1
(released 07 October 2008)

#####################################################################
##  WARNING  WARNING  WARNING  WARNING  WARNING  WARNING  WARNING  ##
#####################################################################
##                                                                 ##
## This release makes substantial changes to the NAV database. If  ##
## you are upgrading from a previous release you also need to      ##
## upgrade your database schema. For information on how to upgrade ##
## the database schema, please take a look in                      ##
## doc/sql/upgrades/README . See also the release NOTES for more   ##
## upgrade info.                                                   ##
##                                                                 ##
#####################################################################

 Launchpad.net has replaced SourceForge.net as NAV's project site
 provider.  All bug/feature number references from here on are
 prefixed with 'LP#'.

 New features and improvements:

  * The four NAV databases are merged into a single database.

  * IP Device Center is replaced by IP Device Info, written from
    scratch using Django.

  * Alert Profiles, user admin, user info and network explorer web
    tools rewritten from scratch using Python/Django.

  * AlertEngine har been rewritten from scratch using Python.

  * Netmap replaces the old Traffic Map solution.

  * Tomcat and PHP are no longer needed by NAV.

  * The report tool now supports local site reports using
    report.local.conf, while the report.conf distributed with NAV can
    be kept untouched.

  * Reports can now be configured to display column sum totals.

  * All available reports can now be listed, so they'll be available
    even if someone forgot to update the front.html configuration
    file.

  * More flexible location/room/device lookups and selects in the
    maintenance and device management interfaces.

  * LP#258331 (Warn user when port activity interval is larger than
               the actual data set)
  * LP#258340 (Additional information on switch ports)
  * LP#263610 (List more info about SRVs)
  * LP#263897 (Add a duplex mismatch report)
  * LP#263899 (Add a spanning tree blocked ports report)

 Bugfixes:

  * LP#262301 (Machine tracker links to ipdevinfo using wrong sysname
               for old records)
  * LP#258304 (Bug in color legend, browse/activity port view)

===========================
 Release notes for NAV 3.5
===========================
Please report bugs at https://bugs.launchpad.net/nav

If you are upgrading from versions of NAV older than 3.4, please refer
to the release notes of the in-between versions before reading any
further.

Netmap vs. Traffic Map
======================

The Traffic Map has been superseded by the Netmap.  Netmap does not
require a Java servlet backend, and in combination with a rewrite of
Network Explorer this means Tomcat is no longer needed for a NAV
installation.

If, for any reason, you really miss the old Traffic Map, you can find
it as a contrib under contrib/trafficmap/.  Refer to
contrib/trafficmap/README for installation instructions.

Jabber alerts
=============
The newly rewritten AlertEngine includes support for dispatching
alerts using Jabber.  Edit alertengine.conf to configure NAV's Jabber
ID and password.  The Jabber alert plugin will not register for a new
account, so you must create the account referred to by the JID setting
before attempting to use Jabber alerts.

Upgrading from NAV 3.4
======================

Database changes
----------------
Whereas NAV 3.4 used four separate PostgreSQL databases (manage,
navprofiles, logger and arnold) to store its data, NAV 3.5 uses a
single database.

Before running the normal SQL upgrade procedure (i.e. SQL scripts from
doc/sql/upgrades/), you MUST merge your four existing NAV databases
into a single nav database.  The shell script doc/sql/mergedb.sh can
help you with this.  Se doc/sql/upgrades/README for more information.

Removed HP SwitchStack support
------------------------------
Support for HP SwitchStacks has been removed from NAV.  The support
was implemented in a hackish way, and disrupted support for any HP
devices that weren't SwitchStacks.

If you do monitor HP equipment with NAV, you will likely find some
problems with HP data collected by your old NAV version.  You may
experience that HP modules are reported as down, statistics for
existing interfaces may cease to be updated, and NAV may register
duplicate interfaces on your HP devices.

These problems can be resolved by making NAV forget about all
previously registered modules on HP devices, and let it rediscover
them from scratch.  An SQL script is provided to do just that.

This script can be found as doc/sql/upgrades/3.5.0b2-hpfix.sql.
Please refer to the instructions in the comments in that file.

Dependency changes
------------------
The following dependencies are new to NAV 3.5:

* python-django >= 1.0 (http://www.djangoproject.com)
* psycopg2 (in addition to psycopg1,
  http://www.initd.org/pub/software/psycopg/)

The following are no longer dependencies in NAV 3.5:

* Tomcat
* PHP
* The Perl modules DBD::Pg and SNMP_Session
* The Python module forgetHTML

A dependency to the python module pyrad was previously undocumented.
This module is required if you wish to monitor radius servers using
NAV's service monitor.  The module can be found at
http://www.wiggy.net/code/pyrad/ .

Files to remove
---------------
These files and directories should be removed from your installation
after the upgrade:

apache/tools/editdb.tool
apache/tools/vlanPlot.tool
apache/tools/navAdmin.tool
apache/webroot/editdb/
apache/webroot/js/editdbTemplate.js
apache/webroot/style/editdbTemplate.css
apache/webroot/images/toolbox/tools/editdb.png
lib/python/nav/web/templates/editdbTemplate.py
etc/alertengine.cfg

You should rename etc/editdb.conf to etc/seeddb.conf if you have any
local changes to editdb.conf.

These files and directories are all prefixed with /usr/local/nav/ in a
default configuration, but your mileage may vary.

Configuration changes
---------------------
A jabber message class has been added to alertmsg.conf, so don't
forget to update this config file with changes from the package if you
want to use Jabber alerts.

You can now add local reports and changes to existing reports in the
report.local.conf file.  This means you will not have to sew together
any upstream report changes with your own changes to report.conf.

nav.conf has been updated with at least two more options.
DEFAULT_FROM_EMAIL configures what email address is used as the
originating address for email alerts (this was previously configured
in alertengine.cfg).  More parts of NAV are being implemented using
Django, so a DJANGO_DEBUG setting has been added to nav.conf.  This is
a True/False setting which controls whether Django will output debug
information when errors occur.
Morten Werner Forsbring | 23 Feb 2010 15:02
Picon
Favicon

Re: Announcement: NAV 3.5.5 released

Morten Brekkevold <morten.brekkevold@...> writes:

> A binary package for Debian 4 and 5 (Etch and Lenny) will be made
> available as soon as possible. The Debian package is maintained by
> Morten Werner Forsbring, on commission From UNINETT.

Both Etch and Lenny packages are available from the usual places
now. I've also update the installation instructions to include Debian
Lenny [1].

Please note that security support for Debian Etch was terminated [2] on
February 15th 2010. You should strongly consider upgrading from Etch to 
Lenny. We have documented an upgrade path [3], but this "guide" does not
take other packages/services into consideration.

As usual, please report problems/bugs/comments to this mailinglist or me
directly. :)

- Werner

[1] http://pkg-nav.alioth.debian.org/
[2] http://www.debian.org/News/2010/20100121
[3] http://pkg-nav.alioth.debian.org/upgrade-path-etch-lenny.html

Geir_Wendelborg | 23 Feb 2010 21:09
Picon
Favicon

RE: Announcement: NAV 3.5.5 released

Hei Morten,

Jeg får en del spørsmål fra høyskoler og universitet om hvilken NAV versjon som har den nye
arkitekturen dere planlegger? Er det 3.6?

Med vennlig hilsen / Best regards, 
Geir Wendelborg
Solutions Consultant 
___________________________________________________________
Dell AS
Hoffsveien 1D, Postboks 270 Skøyen, 0275 Oslo
Sentralbord: +47 67116800  Faks: +47 22928241
Mob: +47 90987646   E-mail: geir_wendelborg@... 

Dell AS, Hoffsveien 1D, Postboks 270 Skøyen, N-0275 Oslo,  Norway  
Org. nr: NO 861 272 702 MVA   

Morten Brekkevold | 24 Feb 2010 12:09
Picon
Picon
Gravatar

Patching forgetSQL on Python 2.5/2.6

Hi all,

forgetSQL is an unmaintained piece of shi^H^Hoftware that NAV versions
up to 3.5 depend on.  While we have removed this dependency from the
coming NAV 3.6, some will experience warnings when running NAV under
Python 2.5, and outright failures on Python 2.6, due to problems with
the forgetSQL module.

The forgetSQL module raises string exceptions in three places, and
these are deprecated in Python 2.5, and not supported in 2.6.  You may
see error messages such as these:

 /var/lib/python-support/python2.5/forgetSQL.py:212: DeprecationWarning: raising a string
exception is deprecated
   raise "NotFound"

or

 File "/var/lib/python-support/python2.6/forgetSQL.py", line 212, in __new__
   raise "NotFound"

 TypeError: exceptions must be classes or instances, not str

I'm attaching a quick forgetSQL patch I've written to overcome these
problems until NAV 3.6 has reached a stable release.

--

-- 
Morten Brekkevold
UNINETT

Morten Brekkevold | 24 Feb 2010 12:17
Picon
Picon
Gravatar

Re: Announcement: NAV 3.5.5 released

On Tue, 23 Feb 2010 21:09:39 +0100 <Geir_Wendelborg@...> wrote:

> Jeg får en del spørsmål fra høyskoler og universitet om hvilken NAV
> versjon som har den nye arkitekturen dere planlegger? Er det 3.6?

Hi Geir,

Please use English when replying to the list.

And the answer to your question is: Yes :-)

--

-- 
Morten Brekkevold
UNINETT


Gmane