Henning Rogge | 13 Oct 2009 17:41

Default metric in OLSRv2

Hello,

I know this mail comes a little bit early (metrics have not been merged into 
OLSRv2 draft), but I would like to like to argue for more than "include 
generic metric support in OLSRv2".

Two weeks ago (just before the OLSR Interop 2009 in Vienna) I visited a 
conference about military communications. There were a couple of presentations 
which used OLSR as a mesh net protocol and they can be summarized as: "OLSR 
does not work well". When I tried to get some more facts about this I quickly 
recognized that all of them used hopcount metrics "because it's the default 
described in the RFC".

I think this was a mistake in the OLSRv1 RFC, it described a protocol that did 
not work very well in the real world because of hopcount metrics. No amount of 
great research for new metric or improved features have changed this later, 
because most people USING OLSR for their research will use the stuff described 
in the default RFC. We should not do the same mistake in the OLSRv2 RFC.

My suggestion is:
include a simple version of ETX as an example metric into the OLSRv2 RFC.

Why ETX ? Why not ETT/SNR/MIC/.... ?

ETX is not the best metric out there, it's a very basic one. But it's VERY 
easy to describe and implement, it's independant from the layer 1/2 below OLSR 
and it allows to build much better real world networks than hopcount. I know 
no other metric that can provide these three advantages.

We should add a few sentences into the chapter that this will be just the 
(Continue reading)

L. Aaron Kaplan | 13 Oct 2009 17:59
Gravatar

Re: Default metric in OLSRv2

>
>
> What do you think ?
>
ACK!!

---
there's no place like 127.0.0.1

(üäö)
Dearlove, Christopher (UK | 14 Oct 2009 10:32

Re: Default metric in OLSRv2

I do not believe that a specific metric such as ETX should
be in the base OLSRv2 draft. As you say, the first question
would be "why ETX?". But not that the default will be a metric
whose meaning is implementation specific, not hop count (which
would be the default default so to speak if no one includes
any metric information). 

But that said, I would be delighted to see an Internet Draft
(which could be adopted and taken all the way to RFC in parallel
if that is the WG consensus) which described ETX, and maybe one
or two other, metrics and how to adopt them to the OLSRv2 metrics
TLV. This work could even start now referencing
draft-dearlove-olsrv2-metrics, to be updated to reference OLSRv2
when folded in to that. This would be valuable support for the
metric concept.

--

-- 
Christopher Dearlove
Technology Leader, Communications Group
Networks, Security and Information Systems Department
BAE Systems Advanced Technology Centre
West Hanningfield Road, Great Baddow, Chelmsford, CM2 8HN, UK
Tel: +44 1245 242194  Fax: +44 1245 242124

BAE Systems (Operations) Limited
Registered Office: Warwick House, PO Box 87,
Farnborough Aerospace Centre, Farnborough, Hants, GU14 6YU, UK
Registered in England & Wales No: 1996687

-----Original Message-----
(Continue reading)

Dearlove, Christopher (UK | 14 Oct 2009 10:35

Re: Default metric in OLSRv2

In my third line below not should be note.

I also omitted to say that an initial draft on specific
metrics could provide more background (such as "why ETX"
and references to what's been done) than would be
appropriate in the main OLSRv2 specification.

-- 
Christopher Dearlove
Technology Leader, Communications Group
Networks, Security and Information Systems Department
BAE Systems Advanced Technology Centre
West Hanningfield Road, Great Baddow, Chelmsford, CM2 8HN, UK
Tel: +44 1245 242194  Fax: +44 1245 242124

BAE Systems (Operations) Limited
Registered Office: Warwick House, PO Box 87,
Farnborough Aerospace Centre, Farnborough, Hants, GU14 6YU, UK
Registered in England & Wales No: 1996687

-----Original Message-----
From: manet-bounces <at> ietf.org [mailto:manet-bounces <at> ietf.org] On Behalf
Of Dearlove, Christopher (UK)
Sent: 14 October 2009 09:32
To: Henning Rogge; manet <at> ietf.org
Subject: Re: [manet] Default metric in OLSRv2

                    *** WARNING ***

  This message has originated outside your organisation,
(Continue reading)

Emmanuel Baccelli | 14 Oct 2009 11:18
Picon
Picon
Favicon

Re: Default metric in OLSRv2

Hi Chris,


I guess that what Henning was saying is: it would be nice to have a simple example of metric other than hop-count in the core doc. I also think it is a good idea. It is also necessary to have a companion doc that will be more exhaustive about metrics. 

But I agree with Henning: it would be unfortunate that people implementing the core spec may get the wrong impression about performance just because the hop-count metric is used because no-one gives them the hint "see, you can try other metrics too". As far as I'm concerned ETX is not a bad choice for such an example. 

I'm OK with other metrics too, as long as they are indeed simple to implement and all-terrain (independant of lower layers).

Cheers, 

Emmanuel


On Wed, Oct 14, 2009 at 10:35 AM, Dearlove, Christopher (UK) <Chris.Dearlove <at> baesystems.com> wrote:
In my third line below not should be note.

I also omitted to say that an initial draft on specific
metrics could provide more background (such as "why ETX"
and references to what's been done) than would be
appropriate in the main OLSRv2 specification.

--
Christopher Dearlove
Technology Leader, Communications Group
Networks, Security and Information Systems Department
BAE Systems Advanced Technology Centre
West Hanningfield Road, Great Baddow, Chelmsford, CM2 8HN, UK
Tel: +44 1245 242194  Fax: +44 1245 242124

BAE Systems (Operations) Limited
Registered Office: Warwick House, PO Box 87,
Farnborough Aerospace Centre, Farnborough, Hants, GU14 6YU, UK
Registered in England & Wales No: 1996687

-----Original Message-----
From: manet-bounces <at> ietf.org [mailto:manet-bounces <at> ietf.org] On Behalf
Of Dearlove, Christopher (UK)
Sent: 14 October 2009 09:32
To: Henning Rogge; manet <at> ietf.org
Subject: Re: [manet] Default metric in OLSRv2


                   *** WARNING ***

 This message has originated outside your organisation,
 either from an external partner or the Global Internet.
     Keep this in mind if you answer this message.


I do not believe that a specific metric such as ETX should
be in the base OLSRv2 draft. As you say, the first question
would be "why ETX?". But not that the default will be a metric
whose meaning is implementation specific, not hop count (which
would be the default default so to speak if no one includes
any metric information).

But that said, I would be delighted to see an Internet Draft
(which could be adopted and taken all the way to RFC in parallel
if that is the WG consensus) which described ETX, and maybe one
or two other, metrics and how to adopt them to the OLSRv2 metrics
TLV. This work could even start now referencing
draft-dearlove-olsrv2-metrics, to be updated to reference OLSRv2
when folded in to that. This would be valuable support for the
metric concept.

--
Christopher Dearlove
Technology Leader, Communications Group
Networks, Security and Information Systems Department
BAE Systems Advanced Technology Centre
West Hanningfield Road, Great Baddow, Chelmsford, CM2 8HN, UK
Tel: +44 1245 242194  Fax: +44 1245 242124

BAE Systems (Operations) Limited
Registered Office: Warwick House, PO Box 87,
Farnborough Aerospace Centre, Farnborough, Hants, GU14 6YU, UK
Registered in England & Wales No: 1996687

-----Original Message-----
From: manet-bounces <at> ietf.org [mailto:manet-bounces <at> ietf.org] On Behalf
Of Henning Rogge
Sent: 13 October 2009 16:41
To: manet <at> ietf.org
Subject: [manet] Default metric in OLSRv2

Hello,

I know this mail comes a little bit early (metrics have not been merged
into
OLSRv2 draft), but I would like to like to argue for more than "include
generic metric support in OLSRv2".

Two weeks ago (just before the OLSR Interop 2009 in Vienna) I visited a
conference about military communications. There were a couple of
presentations
which used OLSR as a mesh net protocol and they can be summarized as:
"OLSR
does not work well". When I tried to get some more facts about this I
quickly
recognized that all of them used hopcount metrics "because it's the
default
described in the RFC".

I think this was a mistake in the OLSRv1 RFC, it described a protocol
that did
not work very well in the real world because of hopcount metrics. No
amount of
great research for new metric or improved features have changed this
later,
because most people USING OLSR for their research will use the stuff
described
in the default RFC. We should not do the same mistake in the OLSRv2 RFC.

My suggestion is:
include a simple version of ETX as an example metric into the OLSRv2
RFC.

Why ETX ? Why not ETT/SNR/MIC/.... ?

ETX is not the best metric out there, it's a very basic one. But it's
VERY
easy to describe and implement, it's independant from the layer 1/2
below OLSR
and it allows to build much better real world networks than hopcount. I
know
no other metric that can provide these three advantages.

We should add a few sentences into the chapter that this will be just
the
"lowest common metric" which should work with all OLSRv2 agents and that
there
are much better and more specialized metrics described in other
documents and
research papers. But if we do not put a real metric into the RFC we will
have
people saying "OLSRv2 does not work well" in years, just because they do
their
comparision based on the RFC implementation (hopcount).

If there is a consensus on this I can easily write description of a
simple
Hello-Message based ETX implementation with a single tuning parameter
for the
draft.

What do you think ?

Henning Rogge

********************************************************************
This email and any attachments are confidential to the intended
recipient and may also be privileged. If you are not the intended
recipient please delete it from your system and notify the sender.
You should not copy it or use it for any purpose nor disclose or
distribute its contents to any other person.
********************************************************************

_______________________________________________
manet mailing list
manet <at> ietf.org
https://www.ietf.org/mailman/listinfo/manet

_______________________________________________
manet mailing list
manet <at> ietf.org
https://www.ietf.org/mailman/listinfo/manet

_______________________________________________
manet mailing list
manet <at> ietf.org
https://www.ietf.org/mailman/listinfo/manet
Henning Rogge | 14 Oct 2009 11:43

Re: Default metric in OLSRv2

Am Mittwoch 14 Oktober 2009 10:32:26 schrieb Dearlove, Christopher (UK):
> I do not believe that a specific metric such as ETX should
> be in the base OLSRv2 draft. As you say, the first question
> would be "why ETX?". But not that the default will be a metric
> whose meaning is implementation specific, not hop count (which
> would be the default default so to speak if no one includes
> any metric information).
> 
> But that said, I would be delighted to see an Internet Draft
> (which could be adopted and taken all the way to RFC in parallel
> if that is the WG consensus) which described ETX, and maybe one
> or two other, metrics and how to adopt them to the OLSRv2 metrics
> TLV. This work could even start now referencing
> draft-dearlove-olsrv2-metrics, to be updated to reference OLSRv2
> when folded in to that. This would be valuable support for the
> metric concept.
I don't think this will work well for OLSRv2. Most people using OLSRv2 for 
research (instead of doing research on OLSRv2) will continue to use the "basic 
RFC implementation" of OLSR... if the basic RFC does only contain hopcount 
they will use hopcount "to have comparable results to other experiments". 
Which will give them "still does not work well".

I think we really need an appendix in the core document (similar to the 
appendix with an example MPR algorithm) that contains a simple metric 
algorithm. Without this "RFC conform OLSRv2" will still be nearly unusable.

We could use any kind of metric algorithm for this appendix, but ETX is the 
only one (I'm aware of) that is
a) independant of layer 1/2
b) easy to implement
c) creates working mesh networks

Hopcount does not provice c).

Henning Rogge
_______________________________________________
manet mailing list
manet <at> ietf.org
https://www.ietf.org/mailman/listinfo/manet
Dearlove, Christopher (UK | 14 Oct 2009 11:48

Re: Default metric in OLSRv2

> I don't think this will work well for OLSRv2. Most people using OLSRv2
for 
> research (instead of doing research on OLSRv2) will continue to use
the "basic 
> RFC implementation" of OLSR... if the basic RFC does only contain
hopcount

That is not the proposal. See what's written in the metrics draft.
(I agree what you indicate would not be acceptable. But that's why
that isn't it.)

The proposal is that the default is an additive metric of unspecified
"real world" meaning. But it's still a metric, and not just hopcount.
It's just not a specific ETC/delay/whatever metric. At least not
specified as such. In a given deployment if you agree in advance that
this is ETX, fine. But if you definitely want ETX then get an allocation
of one of the reserved metric code points specifically for that purpose
and use that.

********************************************************************
This email and any attachments are confidential to the intended
recipient and may also be privileged. If you are not the intended
recipient please delete it from your system and notify the sender.
You should not copy it or use it for any purpose nor disclose or
distribute its contents to any other person.
********************************************************************
Dearlove, Christopher (UK | 14 Oct 2009 11:53

Re: Default metric in OLSRv2

Can people please read the draft. Use of just hop count is NOT what
is in the proposal. You only get hop count if you don't even use the
metric TLV (so you get a default value, and all values default is - for
any metric - equivalent to hop count, just not one per hop).
 
And adding more to the base draft is not the way to go. (In fact in an
ideal world I'd go in exactly the opposite direction and break the base
draft into about three modular pieces.) A specific discussion of the
particular merits of specific metrics, and reservation of a code point
(group of TLV type extensions) is highly suited as a separate document.

--
Christopher Dearlove
Technology Leader, Communications Group
Networks, Security and Information Systems Department
BAE Systems Advanced Technology Centre
West Hanningfield Road, Great Baddow, Chelmsford, CM2 8HN, UK
Tel: +44 1245 242194  Fax: +44 1245 242124

BAE Systems (Operations) Limited
Registered Office: Warwick House, PO Box 87,
Farnborough Aerospace Centre, Farnborough, Hants, GU14 6YU, UK
Registered in England & Wales No: 1996687

 

From: manet-bounces <at> ietf.org [mailto:manet-bounces <at> ietf.org] On Behalf Of Emmanuel Baccelli
Sent: 14 October 2009 10:18
To: manet <at> ietf.org
Subject: Re: [manet] Default metric in OLSRv2

*** WARNING *** This message has originated outside your organisation, either from an external partner or the Global Internet. Keep this in mind if you answer this message. Hi Chris,

I guess that what Henning was saying is: it would be nice to have a simple example of metric other than hop-count in the core doc. I also think it is a good idea. It is also necessary to have a companion doc that will be more exhaustive about metrics. 

But I agree with Henning: it would be unfortunate that people implementing the core spec may get the wrong impression about performance just because the hop-count metric is used because no-one gives them the hint "see, you can try other metrics too". As far as I'm concerned ETX is not a bad choice for such an example. 

I'm OK with other metrics too, as long as they are indeed simple to implement and all-terrain (independant of lower layers).

Cheers, 

Emmanuel


On Wed, Oct 14, 2009 at 10:35 AM, Dearlove, Christopher (UK) <Chris.Dearlove <at> baesystems.com> wrote:
In my third line below not should be note.

I also omitted to say that an initial draft on specific
metrics could provide more background (such as "why ETX"
and references to what's been done) than would be
appropriate in the main OLSRv2 specification.

--
Christopher Dearlove
Technology Leader, Communications Group
Networks, Security and Information Systems Department
BAE Systems Advanced Technology Centre
West Hanningfield Road, Great Baddow, Chelmsford, CM2 8HN, UK
Tel: +44 1245 242194  Fax: +44 1245 242124

BAE Systems (Operations) Limited
Registered Office: Warwick House, PO Box 87,
Farnborough Aerospace Centre, Farnborough, Hants, GU14 6YU, UK
Registered in England & Wales No: 1996687

-----Original Message-----
From: manet-bounces <at> ietf.org [mailto:manet-bounces <at> ietf.org] On Behalf
Of Dearlove, Christopher (UK)
Sent: 14 October 2009 09:32
To: Henning Rogge; manet <at> ietf.org
Subject: Re: [manet] Default metric in OLSRv2


                   *** WARNING ***

 This message has originated outside your organisation,
 either from an external partner or the Global Internet.
     Keep this in mind if you answer this message.


I do not believe that a specific metric such as ETX should
be in the base OLSRv2 draft. As you say, the first question
would be "why ETX?". But not that the default will be a metric
whose meaning is implementation specific, not hop count (which
would be the default default so to speak if no one includes
any metric information).

But that said, I would be delighted to see an Internet Draft
(which could be adopted and taken all the way to RFC in parallel
if that is the WG consensus) which described ETX, and maybe one
or two other, metrics and how to adopt them to the OLSRv2 metrics
TLV. This work could even start now referencing
draft-dearlove-olsrv2-metrics, to be updated to reference OLSRv2
when folded in to that. This would be valuable support for the
metric concept.

--
Christopher Dearlove
Technology Leader, Communications Group
Networks, Security and Information Systems Department
BAE Systems Advanced Technology Centre
West Hanningfield Road, Great Baddow, Chelmsford, CM2 8HN, UK
Tel: +44 1245 242194  Fax: +44 1245 242124

BAE Systems (Operations) Limited
Registered Office: Warwick House, PO Box 87,
Farnborough Aerospace Centre, Farnborough, Hants, GU14 6YU, UK
Registered in England & Wales No: 1996687

-----Original Message-----
From: manet-bounces <at> ietf.org [mailto:manet-bounces <at> ietf.org] On Behalf
Of Henning Rogge
Sent: 13 October 2009 16:41
To: manet <at> ietf.org
Subject: [manet] Default metric in OLSRv2

Hello,

I know this mail comes a little bit early (metrics have not been merged
into
OLSRv2 draft), but I would like to like to argue for more than "include
generic metric support in OLSRv2".

Two weeks ago (just before the OLSR Interop 2009 in Vienna) I visited a
conference about military communications. There were a couple of
presentations
which used OLSR as a mesh net protocol and they can be summarized as:
"OLSR
does not work well". When I tried to get some more facts about this I
quickly
recognized that all of them used hopcount metrics "because it's the
default
described in the RFC".

I think this was a mistake in the OLSRv1 RFC, it described a protocol
that did
not work very well in the real world because of hopcount metrics. No
amount of
great research for new metric or improved features have changed this
later,
because most people USING OLSR for their research will use the stuff
described
in the default RFC. We should not do the same mistake in the OLSRv2 RFC.

My suggestion is:
include a simple version of ETX as an example metric into the OLSRv2
RFC.

Why ETX ? Why not ETT/SNR/MIC/.... ?

ETX is not the best metric out there, it's a very basic one. But it's
VERY
easy to describe and implement, it's independant from the layer 1/2
below OLSR
and it allows to build much better real world networks than hopcount. I
know
no other metric that can provide these three advantages.

We should add a few sentences into the chapter that this will be just
the
"lowest common metric" which should work with all OLSRv2 agents and that
there
are much better and more specialized metrics described in other
documents and
research papers. But if we do not put a real metric into the RFC we will
have
people saying "OLSRv2 does not work well" in years, just because they do
their
comparision based on the RFC implementation (hopcount).

If there is a consensus on this I can easily write description of a
simple
Hello-Message based ETX implementation with a single tuning parameter
for the
draft.

What do you think ?

Henning Rogge

********************************************************************
This email and any attachments are confidential to the intended
recipient and may also be privileged. If you are not the intended
recipient please delete it from your system and notify the sender.
You should not copy it or use it for any purpose nor disclose or
distribute its contents to any other person.
********************************************************************

_______________________________________________
manet mailing list
manet <at> ietf.org
https://www.ietf.org/mailman/listinfo/manet

_______________________________________________
manet mailing list
manet <at> ietf.org
https://www.ietf.org/mailman/listinfo/manet

_______________________________________________
manet mailing list
manet <at> ietf.org
https://www.ietf.org/mailman/listinfo/manet
L.Aaron | 14 Oct 2009 12:09

Default metric in OLSRv2





(re-sending due to 25KB limit on the mailing list).

On Oct 14, 2009, at 11:53 AM, Dearlove, Christopher (UK) wrote:

Can people please read the draft. Use of just hop count is NOT what
is in the proposal. You only get hop count if you don't even use the
metric TLV (so you get a default value, and all values default is - for
any metric - equivalent to hop count, just not one per hop).
 
And adding more to the base draft is not the way to go. (In fact in an
ideal world I'd go in exactly the opposite direction and break the base
draft into about three modular pieces.) A specific discussion of the
particular merits of specific metrics, and reservation of a code point
(group of TLV type extensions) is highly suited as a separate document.


Maybe from the design point of documents you are right (adding stuff just creates big clogs).
But - try to read it from the perspective of OLSR implementors.
They will - as you stated above - try to read as little as possible ;))

So, I am also in favor of ETX *as an example* for how to add metrics but *within the v2* draft.
In that example section then you can point to further documents. 
It is also about how people read it.


a.


---
there's no place like 127.0.0.1

(üäö)

_______________________________________________
manet mailing list
manet <at> ietf.org
https://www.ietf.org/mailman/listinfo/manet
Thomas Heide Clausen | 14 Oct 2009 12:24

Re: Default metric in OLSRv2

All,

Can I make a couple of rush observations and a suggestion here,  
without taking side in this discussion just yet?

Observations:

	o	We agree that additive metrics should be in OLSRv2.

			=> 	They will be, we've got consensus on that,
				the metrics I-D contains that and it will be
				(I believe that I can safely engage all the authors)
				folded into the OLSRv2 specification as the WG
				has decided.

	o	ETX is a valuable example of a metric. There are existence
		proofs (plural) hereof from operational networks. It's hard
		to argue against that. It's also hard to argue that ETX is the
		be-all-end-all metric (but I think that nobody has suggested
		that either).

	o	Regardless of if ETX is to be included in the OLSRv2 spec
		or published as an independent spec (and I see and recognize
		arguments for and against both of these options), there's no
		current (IETF) specification of ETX. Consequently:

			=>	It's difficult for the WG to pronounce itself on the
				issue

			=>	There's no ETX-text to propose folding in to any
				specification, or to advance as a supplementary
				document (i.e. for the WG to adopt and to advance
				for publication).

Suggestion:

	o	Someone with experience in ETX and OLSR(v2) produce
		an individual I-D (short is good, shorter is better), and post
		to manet <at> ietf.org for further discussion.

Informally, as I know that Henning and Aaron have significant  
operational experience with ETX in OLSR(v2) networks, I'd think it  
interesting and a good idea if you were to produce such a document.  
I'd be happy [as OLSRv2 co-author] to help out, as will Emmanuel (he  
just confirmed this, as he's next to me) -- and I am sure that so will  
others.

I am sure that once a document exists, it will be a lot easier to  
understand what it is that we're discussing, what the right path for  
the content is etc.

Thoughts?

Thomas

On Oct 14, 2009, at 11:48 AM, Dearlove, Christopher (UK) wrote:

>> I don't think this will work well for OLSRv2. Most people using  
>> OLSRv2
> for
>> research (instead of doing research on OLSRv2) will continue to use
> the "basic
>> RFC implementation" of OLSR... if the basic RFC does only contain
> hopcount
>
> That is not the proposal. See what's written in the metrics draft.
> (I agree what you indicate would not be acceptable. But that's why
> that isn't it.)
>
> The proposal is that the default is an additive metric of unspecified
> "real world" meaning. But it's still a metric, and not just hopcount.
> It's just not a specific ETC/delay/whatever metric. At least not
> specified as such. In a given deployment if you agree in advance that
> this is ETX, fine. But if you definitely want ETX then get an  
> allocation
> of one of the reserved metric code points specifically for that  
> purpose
> and use that.
>
> ********************************************************************
> This email and any attachments are confidential to the intended
> recipient and may also be privileged. If you are not the intended
> recipient please delete it from your system and notify the sender.
> You should not copy it or use it for any purpose nor disclose or
> distribute its contents to any other person.
> ********************************************************************
>
> _______________________________________________
> manet mailing list
> manet <at> ietf.org
> https://www.ietf.org/mailman/listinfo/manet

Gmane