Re: Comments on draft-ietf-bmwg-protection-meth-04.txt

Hi Jerry,

I believe the attached posting to the mailing list provided
clarification.

Scott

-----Original Message-----
From: bmwg-bounces <at> ietf.org [mailto:bmwg-bounces <at> ietf.org] On Behalf Of
Jerry Perser
Sent: Saturday, February 28, 2009 1:58 PM
To: bmwg <at> ietf.org
Subject: Re: [bmwg] Comments on draft-ietf-bmwg-protection-meth-04.txt

Scott,

My view is both.

One, the BWMG focus is on a SUT/DUT.  If you can draw a box around what 
you are testing and some of the network is outside the box, then it 
falls under the BMWG.  If you can't draw a box around what you are 
testing or none of the network is outside the box, then is falls under 
the IPPM.  My notion of what a DUT is was destroyed by a company called 
Avici Systems.  Those guys can take 14 routers, each in their own rack, 
and connect them to look like a single DUT.  From the networks point of 
view, the routers look like a single DUT.  If your draft can not support

SUT, you should be clear about it.  I assumed that the draft supported 
both SUT and DUT.  Please clarify if we need another draft for SUT.

Preparing bmwg Agenda for IETF-74

BMWG members,

The main point of our face-to-face meetings is to have
real interaction and reach agreements quickly, so that
we accomplish our milestones on time...

If you would like to request time on the bmwg agenda
to *lead a discussion* on technical issues related
to a working group draft, please respond to me with
the topic and the description of technical issues.

 >>>> Please use the following format (this will help me greatly):

TOPIC: <name or title>
Discussion GOALS: <as above>
Draft file name, or preferably the complete URL: <draft-ietf-bmwg-foo>
Presenter: <name of the person who will be in Dublin>

 >>>>

IF none of the authors of a WG draft will be at IETF-74,
BMWG still needs the status/details for each work area!!!

 >>>>

As always, I will try to make some meeting time available
for proposed work at the end of the agenda.  Let me
know what proposals you would like to discuss, and how
the bmwg can help with specific areas of draft development.
I may have to do some triage on these requests,

I-D Action:draft-ietf-bmwg-sip-bench-meth-00.txt

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology Working Group of the IETF.

	Title           : Methodology for Benchmarking SIP Networking Devices
	Author(s)       : S. Poretsky, et al.
	Filename        : draft-ietf-bmwg-sip-bench-meth-00.txt
	Pages           : 18
	Date            : 2009-03-04

This document describes the methodology for benchmarking Session
Initiation Protocol (SIP) performance as described in SIP
benchmarking terminology document.  The methodology and terminology
are to be used for benchmarking signaling plane performance with
varying signaling and media load.  Both scale and establishment rate
are measured by signaling plane performance.  The SIP Devices to be
benchmarked may be a single device under test (DUT) or a system under
test (SUT).  Benchmarks can be obtained and compared for different
types of devices such as SIP Proxy Server, SBC, P-CSCF, and Server
paired with a Firewall/NAT device.

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-sip-bench-meth-00.txt

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/

Below is the data which will enable a MIME compliant mail reader
implementation to automatically retrieve the ASCII version of the
Internet-Draft.

I-D Action:draft-ietf-bmwg-sip-bench-term-00.txt

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology Working Group of the IETF.

	Title           : Terminology for Benchmarking Session Initiation Protocol (SIP) Networking Devices
	Author(s)       : S. Poretsky, et al.
	Filename        : draft-ietf-bmwg-sip-bench-term-00.txt
	Pages           : 34
	Date            : 2009-03-04

This document provides a terminology for benchmarking SIP performance
in networking devices.  Terms are included for test components, test
setup parameters, and performance benchmark metrics for black-box
benchmarking of SIP networking devices.  The performance benchmark
metrics are obtained for the SIP control plane and media plane.  The
terms are intended for use in a companion methodology document for
complete performance characterization of a device in a variety of
conditions making it possible to compare performance of different
devices.  It is critical to provide test setup parameters and a
methodology document for SIP performance benchmarking because SIP
allows a wide range of configuration and operational conditions that
can influence performance benchmark measurements.  It is necessary to
have terminology and methodology standards to ensure that reported
benchmarks have consistent definition and were obtained following the
same procedures.  Benchmarks can be applied to compare performance of
a variety of SIP networking devices.

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-sip-bench-term-00.txt

Internet-Drafts are also available by anonymous FTP at:

Draft Agenda for IETF-74

Comments and updates are welcome, all the revised drafts
should be available at the links below after the submission
deadline ...

Benchmarking Methodology WG (bmwg)

THURSDAY, March 26, 2009
1300-1500  Afternoon Session I
Franciscan A

CHAIR(s): Al Morton <acmorton <at> att.com>

Please help contribute to a successful meeting by reading the drafts
and references *before* we meet.

AGENDA:   Draft as of 3/8/2009 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

0.  Agenda bashing (if we need to shuffle a few items)
     See https://datatracker.ietf.org/meeting/74/materials.html
     for Agenda updates and Slides

     Check the BMWG mail archive for comments:
     http://www.ietf.org/mail-archive/working-groups/bmwg/current/

1.  Working Group Status (Chair)

Topics/Drafts not covered by presentations below:

MPLS Forwarding (this should be covered on the agenda!!!)

New Version Notification for draft-ietf-bmwg-protection-meth-05

A new version of I-D, draft-ietf-bmwg-protection-meth-05.txt has been successfuly submitted by Scott
Poretsky and posted to the IETF repository.

Filename:	 draft-ietf-bmwg-protection-meth
Revision:	 05
Title:		 Methodology for benchmarking MPLS protection mechanisms
Creation_date:	 2009-03-08
WG ID:		 bmwg
Number_of_pages: 29

Abstract:
This draft describes the methodology for benchmarking  MPLS 
Protection mechanisms for link and node protection as defined in 
[MPLS-FRR-EXT].  This document provides test methodologies and 
testbed setup for measuring failover times while considering  
all dependencies that might impact faster recovery of real-time 
applications bound to MPLS based traffic engineered tunnels.  
The benchmarking terms used in this document are defined in 
[TERM-ID].

The IETF Secretariat.

FW: New Version Notification for draft-ietf-bmwg-protection-term-06

A new version of I-D, draft-ietf-bmwg-protection-term-06.txt has been successfuly submitted by Scott
Poretsky and posted to the IETF repository.

Filename:	 draft-ietf-bmwg-protection-term
Revision:	 06
Title:		 Benchmarking Terminology for Protection Performance
<draft-ietf-bmwg-protection-term-06.txt >
Creation_date:	 2009-03-08
WG ID:		 bmwg
Number_of_pages: 28

Abstract:
This document provides common terminology and metrics for benchmarking 
  the performance of sub-IP layer protection mechanisms. The performance 
  benchmarks are measured at the IP-Layer, avoiding dependence on 
  specific sub-IP protection mechanisms. The benchmarks and terminology 
  can be applied in methodology documents for different sub-IP layer 
  protection mechanisms such as Automatic Protection Switching (APS), 
  Virtual Router Redundancy Protocol (VRRP), Stateful High Availability 
  (HA), and Multi-Protocol Label Switching Fast Reroute (MPLS-FRR).

  Protection Performance

The IETF Secretariat.

I-D Action:draft-ietf-bmwg-protection-term-06.txt

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology Working Group of the IETF.

	Title           : Benchmarking Terminology for Protection Performance
<draft-ietf-bmwg-protection-term-06.txt >
	Author(s)       : S. Poretsky, J. Karthik
	Filename        : draft-ietf-bmwg-protection-term-06.txt
	Pages           : 28
	Date            : 2009-03-08

This document provides common terminology and metrics for benchmarking 
  the performance of sub-IP layer protection mechanisms. The performance 
  benchmarks are measured at the IP-Layer, avoiding dependence on 
  specific sub-IP protection mechanisms. The benchmarks and terminology 
  can be applied in methodology documents for different sub-IP layer 
  protection mechanisms such as Automatic Protection Switching (APS), 
  Virtual Router Redundancy Protocol (VRRP), Stateful High Availability 
  (HA), and Multi-Protocol Label Switching Fast Reroute (MPLS-FRR).

  Protection Performance

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-protection-term-06.txt

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/

Below is the data which will enable a MIME compliant mail reader
implementation to automatically retrieve the ASCII version of the
Internet-Draft.

I-D Action:draft-ietf-bmwg-protection-meth-05.txt

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology Working Group of the IETF.

	Title           : Methodology for benchmarking MPLS protection mechanisms
	Author(s)       : S. Poretsky, S. Rao
	Filename        : draft-ietf-bmwg-protection-meth-05.txt
	Pages           : 29
	Date            : 2009-03-08

This draft describes the methodology for benchmarking  MPLS 
Protection mechanisms for link and node protection as defined in 
[MPLS-FRR-EXT].  This document provides test methodologies and 
testbed setup for measuring failover times while considering  
all dependencies that might impact faster recovery of real-time 
applications bound to MPLS based traffic engineered tunnels.  
The benchmarking terms used in this document are defined in 
[TERM-ID].

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-protection-meth-05.txt

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/

Below is the data which will enable a MIME compliant mail reader
implementation to automatically retrieve the ASCII version of the
Internet-Draft.

I-D Action:draft-ietf-bmwg-mpls-forwarding-meth-02.txt

A New Internet-Draft is available from the on-line Internet-Drafts directories.
This draft is a work item of the Benchmarking Methodology Working Group of the IETF.

	Title           : MPLS Forwarding Benchmarking Methodology for IP Flows
	Author(s)       : A. Akhter, et al.
	Filename        : draft-ietf-bmwg-mpls-forwarding-meth-02.txt
	Pages           : 29
	Date            : 2009-03-08

This document describes a methodology specific to the benchmarking
of Multi-Protocol Label Switching (MPLS) forwarding devices, limited
to the most common MPLS packet forwarding scenarios and delay
measurements for each, considering IP flows. It builds upon the
tenets set forth in RFC2544, RFC1242 and other IETF Benchmarking
Methodology Working Group (BMWG) efforts.  This document seeks to
extend these efforts to the MPLS paradigm.

A URL for this Internet-Draft is:
http://www.ietf.org/internet-drafts/draft-ietf-bmwg-mpls-forwarding-meth-02.txt

Internet-Drafts are also available by anonymous FTP at:
ftp://ftp.ietf.org/internet-drafts/

Below is the data which will enable a MIME compliant mail reader
implementation to automatically retrieve the ASCII version of the
Internet-Draft.

_______________________________________________