bmwgeuro | 16 Jun 2003 15:03
Picon
Favicon

Bechmarking methology of basic OSPF convergence

Hi,

i need information and test result about the Bechmarking methodology for bacic OSPF Convergence.

Thanks,

Igor
Manral, Vishwas | 16 Jun 2003 17:04

RE: Bechmarking methology of basic OSPF convergence

Hi Igor,

I am not sure which implementation you want the results for.

We have done tests on our implementation, however I am not sure we can
disclose it. Similar tests done on Cisco are however at the page: -
Experience in Black-box OSPF Measurement 
http://www.research.att.com/%7Ealbert/papers/sigcom-imw01/mes-ws01-paper.pdf

Thanks,
Vishwas

-----Original Message-----
From: bmwgeuro [mailto:bmwgeuro <at> libero.it]
Sent: Monday, June 16, 2003 18:33
To: bmwg
Subject: [bmwg] Bechmarking methology of basic OSPF convergence

Hi,

i need information and test result about the Bechmarking methodology for
bacic OSPF Convergence.

Thanks,

Igor
Kevin Dubray | 17 Jun 2003 14:47
Favicon

WG Last Call: OSPF Control plane convergence

BMWG'ers:

A WG Last Call period for the Internet-Drafts regarding
OSPF convergence benchmarking terminology, methodology, and
benchmark applicability:

<draft-ietf-bmwg-ospfconv-term-04.txt>,
<draft-ietf-bmwg-ospfconv-intraarea-05.txt>,
<draft-ietf-bmwg-ospfconv-applicability-03.txt>

will be open from 17 June 2003 until 1 July 2003.

Input from previous WG Last Calls have been incorporated in the I-Ds; the
editors believe the I-Ds are ready for advancement.

Please weigh in on whether or not you feel each individual draft
should not be given to the Area Directors for consideration in 
progressing the draft to an Informational RFC. Send your comments to 
this list or
kdubray <at> juniper.net.

URLs for the Internet-Drafts are:

http://www.ietf.org/internet-drafts/draft-ietf-bmwg-ospfconv-term-04.txt
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-ospfconv-intraarea-05.txt
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-ospfconv-applicability-03.txt
Scott Poretsky | 17 Jun 2003 16:10

RE: Bechmarking methology of basic OSPF convergence

Igor,

Do you want convergence time as observed by network customers?  The 
referenced paper below  deals with only a few components of the overall 
convergence time for a single router.  That is why you see results in 
milliseconds presented.  Of course, under network conditions, network 
customers observe IGP convergence times in seconds and BGP convergence 
times in tens of seconds.  It would be great to have a single source on the 
web to compare convergence time for various routers, but there is not.  You 
could ask your vendor, but chances are you will get a number under optimum 
conditions that are not realistic for your network.  The best way to obtain 
convergence times is to measure it in your lab under your simulated network 
conditions.

Scott

At 11:04 AM 6/16/2003 -0400, Manral, Vishwas wrote:
>Hi Igor,
>
>I am not sure which implementation you want the results for.
>
>We have done tests on our implementation, however I am not sure we can
>disclose it. Similar tests done on Cisco are however at the page: -
>Experience in Black-box OSPF Measurement
>http://www.research.att.com/%7Ealbert/papers/sigcom-imw01/mes-ws01-paper.pdf
>
>Thanks,
>Vishwas
>
>-----Original Message-----
(Continue reading)

Takumi Kimura | 18 Jun 2003 05:05
Picon

Draft modification on Benchmarking Terminology for Protection Performance

Hello,

I submitted a modified draft on Benchmarking Terminology for Protection
Performance:
http://www.ietf.org/internet-drafts/draft-kimura-protection-term-01.txt.

The summary of changes:
  - More description on the types of recover paths is added
    to avoid dependence on a specific sub-IP layer protection
    technology.

  - Loss of Service, Out-of-Order Packet and Duplicated Packet
    are deleted to avoid confusion for first one and to avoid
    redefinition for last two ones.

Please send any discussion comments on this draft to the list.

Thanks,

Takumi
Kevin Dubray | 19 Jun 2003 17:45
Favicon

New BMWG Goal: Router SALT benchmarking

The result of the call for the BMWG to consider undertaking goals described
in the associated proposal, dated 9 APR 03, is that the WG will add
the production of a terminology and methodology set of drafts specifying 
the benchmarking of router software under accelerated stress conditions 
to the
WG docket.  The appropriate milestones will be added to the BMWG charter 
page.

Scott Poretsky (sporetsky <at> avici.com) is the primary editor.
Al Morton | 19 Jun 2003 18:48
Picon
Favicon

New BMWG Goal: IGP/Dataplane Convergence benchmarking

The result of the call for the BMWG to consider undertaking goals described
in the subject proposal, dated 23 APR 03, is that the WG will add
the production of applicability, terminology, and methodology drafts that 
specify the benchmarking of IGP convergence in routers and systems under 
test to the WG docket.  The appropriate milestones will be added to the 
BMWG charter page.

Scott Poretsky (sporetsky <at> avici.com) is the primary editor.
Internet-Drafts | 20 Jun 2003 13:32
Picon
Favicon

I-D ACTION:draft-ietf-bmwg-igp-dataplane-conv-meth-00.txt

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology Working Group of the IETF.

	Title		: Benchmarking Methodology for IGP Data Plane Route 
                          Convergence
	Author(s)	: S. Poretsky, B. Imhoff
	Filename	: draft-ietf-bmwg-igp-dataplane-conv-meth-00.txt
	Pages		: 10
	Date		: 2003-6-19
	
This draft describes the methodology for benchmarking IGP Route 
Convergence.  The applicability of this testing is described in 
[1] and the new terminology that it introduces is defined in [2].
Service Providers use IGP Convergence time as a key metric of 
router design and architecture.  Customers of Service Providers 
observe convergence time by packet loss.  IGP Route Convergence 
is a Direct Measure of Quality (DMOQ) when benchmarking the data 
plane and not the control plane.  The test cases in this document 
are black-box tests that emulate the network events that cause 
route convergence, as described in [1].  Black-box test design 
accounts for all of the factors for route convergence time, as
provided in [1].  The methodology and terminology is to be used 
for benchmarking route convergence and can be applied to any
link-state IGP such as ISIS [3] and OSPF [4].

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-igp-dataplane-conv-meth-00.txt

To remove yourself from the IETF Announcement list, send a message to 
ietf-announce-request with the word unsubscribe in the body of the message.
(Continue reading)

Internet-Drafts | 20 Jun 2003 13:32
Picon
Favicon

I-D ACTION:draft-ietf-bmwg-igp-dataplane-conv-term-00.txt

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology Working Group of the IETF.

	Title		: Terminology for Benchmarking IGP Data Plane Route 
                          Convergence
	Author(s)	: S. Poretsky
	Filename	: draft-ietf-bmwg-igp-dataplane-conv-term-00.txt
	Pages		: 9
	Date		: 2003-6-19
	
This draft describes the terminology for benchmarking IGP Route 
Convergence.  The motivation and applicability for this 
benchmarking is provided in [1].  The methodology to be used for 
this benchmarking is described in [2].  The methodology and 
terminology to be used for benchmarking route convergence can be 
applied to any link-state IGP such as ISIS [3] and OSPF [4].  The 
data plane is measured to obtain the convergence benchmarking metrics.  
The purpose of this document is to introduce new terms required to 
complete execution of the IGP Route Convergence Methodology [2].

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-igp-dataplane-conv-term-00.txt

To remove yourself from the IETF Announcement list, send a message to 
ietf-announce-request with the word unsubscribe in the body of the message.

Internet-Drafts are also available by anonymous FTP. Login with the username
"anonymous" and a password of your e-mail address. After logging in,
type "cd internet-drafts" and then
	"get draft-ietf-bmwg-igp-dataplane-conv-term-00.txt".
(Continue reading)

Internet-Drafts | 20 Jun 2003 13:32
Picon
Favicon

I-D ACTION:draft-ietf-bmwg-igp-dataplane-conv-app-00.txt

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology Working Group of the IETF.

	Title		: Benchmarking Applicability for IGP Data Plane Route 
                          Convergence
	Author(s)	: S. Poretsky
	Filename	: draft-ietf-bmwg-igp-dataplane-conv-app-00.txt
	Pages		: 5
	Date		: 2003-6-19
	
This draft describes the applicability of IGP Route Convergence 
benchmarking methodology [1] and IGP Route Convergence bechmarking
terminology [2].  The methodology and terminology is to be used 
for benchmarking route convergence and can be applied to any
link-state IGP such as ISIS [3] and OSPF [4].  The data plane is 
measured to obtain the convergence benchmarking metrics described 
in [1].

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-igp-dataplane-conv-app-00.txt

To remove yourself from the IETF Announcement list, send a message to 
ietf-announce-request with the word unsubscribe in the body of the message.

Internet-Drafts are also available by anonymous FTP. Login with the username
"anonymous" and a password of your e-mail address. After logging in,
type "cd internet-drafts" and then
	"get draft-ietf-bmwg-igp-dataplane-conv-app-00.txt".

A list of Internet-Drafts directories can be found in
(Continue reading)


Gmane