SIP work feedback from Prague
Vijay K. Gurbani <vkg <at> bell-labs.com>
2011-04-22 18:20:16 GMT
Scott: Thank you for your comments on the SIP work during
BMWG meeting in Prague. Here is an attempt to close
the open issues.
To wit, you had indicated the following issues:
1) The 50% step rate --- clarify that the decrease in certain
test cases of 50% applies to decreasing the previous rate
by 50%, not the base rate one starts with.
2) When testing, do not stop at the first error, and instead,
use a time slice to conduct the test. This allows other
latent behaviour in the device to become manifest, that would
otherwise not if the testing stopped at the first error.
3) Indicate that the idea of the SIP tests is to run the tests
with a middle box device from Vendor-A and repeat the tests
with a middle box device from Vendor-B to obtain a comparison
of performance between Vendors A and B.
Issue (1) is fairly cut and dry; indeed, we will do the changes
you suggest. The same goes for (3).
Carol and I had a long chat about issue (2). The intent of the SIP
work in bmwg is to discover the highest request rate that can be
successfully processed by a system or device before the load overwhelms
the system or device. In this thinking, we are interested in knowing
the maximum number of SIP requests (registrations, invitations with
and without media, instant messages, etc.) that a system or device
can process before the load overwhelms the system or device such that