U.S. patent application number 11/111193 was filed with the patent office on 2006-10-26 for simulating time-varying conditions in a wireless network.
This patent application is currently assigned to Azimuth Systems, Inc.. Invention is credited to Raymond Cronin, Fanny I. Mlinarsky, Jeremy Spilman, John E. Ziegler.
Application Number | 20060239198 11/111193 |
Document ID | / |
Family ID | 37186756 |
Filed Date | 2006-10-26 |
United States Patent
Application |
20060239198 |
Kind Code |
A1 |
Mlinarsky; Fanny I. ; et
al. |
October 26, 2006 |
Simulating time-varying conditions in a wireless network
Abstract
Time-varying conditions in a wireless network are simulated
using an architecture that includes an enclosure for shielding a
wireless device under test ("DUT") from electromagnetic
interference, including other wireless devices; and at least one
of: (1) a communications traffic generating device operable to
generate communications traffic having selected characteristics;
and (2) at least one dynamically adjustable attenuator in
communication with the wireless device and the traffic generator.
Embodiments of the architecture include wireless test equipment for
testing operating range, roaming and capacity. The attenuator is
used to adjustably attenuate signals between the device and the
traffic generator over time during a test, whereby motion of the
device is simulated. By connecting multiple access points, each
associated with a dynamically adjustable attenuator, it is possible
to force the DUT to roam between access points. The communications
traffic generating device can be used to vary traffic over time
during a test in order to test capacity, prioritization and
admission control. For example, the communications traffic
generator may include phone and data client emulators which
simulate different traffic types that can be independently varied
over time during a test.
Inventors: |
Mlinarsky; Fanny I.;
(Bolton, MA) ; Ziegler; John E.; (Westborough,
MA) ; Cronin; Raymond; (North Easton, MA) ;
Spilman; Jeremy; (Shirley, MA) |
Correspondence
Address: |
McGUINNESS & MANARAS LLP
125 NAGOG PARK
ACTON
MA
01720
US
|
Assignee: |
Azimuth Systems, Inc.
|
Family ID: |
37186756 |
Appl. No.: |
11/111193 |
Filed: |
April 21, 2005 |
Current U.S.
Class: |
370/241 ;
370/252 |
Current CPC
Class: |
H04W 24/00 20130101;
H04W 24/06 20130101 |
Class at
Publication: |
370/241 ;
370/252 |
International
Class: |
H04L 12/26 20060101
H04L012/26; H04J 1/16 20060101 H04J001/16 |
Claims
1. Apparatus for testing a wireless device under test ("DUT")
comprising: an enclosure for shielding the DUT from electromagnetic
interference; a communications traffic generating device in
communication with the DUT, the traffic generating device operable
to generate communications traffic; and a dynamically adjustable
attenuator in communication with the DUT and the traffic generating
device, the attenuator being operable to adjustably attenuate
signals between the DUT and the traffic generating device over time
during a test, whereby motion of the DUT relative to the traffic
generating device is simulated.
2. The apparatus of claim 1 further including a monitoring device
operable to monitor communications between the DUT and the traffic
generating device, whereby operating range can be tested.
3. The apparatus of claim 2 wherein the monitoring device measures
at least one of: quality of service, packet loss, delay and
jitter.
4. The apparatus of claim 3 wherein the monitoring device provides
data indicative of at least one of: quality of service, packet
loss, delay and jitter, as a function of at least one of: call
load, background load, distance, path loss, roam, and rate of
simulated motion.
5. The apparatus of claim 1 wherein the communications traffic
generating device emulates at least one client device.
6. The apparatus of claim 1 wherein the communications traffic
generating device is a real wireless device in a separate shielded
enclosure.
7. The apparatus of claim 1 further including at least one access
point connected between the DUT and traffic generating device.
8. The apparatus of claim 1 wherein the dynamically adjustable
attenuator is further operable to adjustably attenuate signals at
variable rates over time, whereby changes in rate of motion of the
DUT are simulated.
9. The apparatus of claim 1 wherein the dynamically adjustable
attenuator is further operable to adjustably increase and decrease
signal strength over time, whereby changes in direction of motion
of the DUT are simulated.
10. The apparatus of claim 9 further including at least two
communications paths which can be operated upon independently by
the dynamically adjustable attenuator, whereby changes in direction
of motion of the DUT can be simulated.
11. The apparatus of claim 1 further including a pair of
dynamically adjustable attenuators connected in series with a tap
connected therebetween, and a monitor connected to the tap.
12. A method for testing a wireless device under test ("DUT")
comprising the steps of: shielding the DUT from electromagnetic
interference; generating communications traffic with a
communications traffic generating device that is in communication
with the DUT; and dynamically attenuating signals communicated to
and from the DUT over time during a test, thereby simulating motion
of the DUT relative to the communications traffic generating
device.
13. The method of claim 12 further including a monitoring device,
and including the further step of monitoring communications between
the DUT and the traffic generating device with the monitoring
device, whereby operating range can be tested.
14. The method of claim 13 including the further step of measuring
at least one of: quality of service, packet loss, delay and
jitter.
15. The method of claim 14 including the further step of providing
data indicative of at least one of: quality of service, packet
loss, delay and jitter, as a function of at least one of: call
load, background load, distance, path loss, roam, and rate of
simulated motion.
16. The method of claim 12 wherein the communications traffic
generating device emulates at least one client device.
17. The method of claim 12 wherein the communications traffic
generating device is a real wireless device in a separate shielded
enclosure.
18. The method of claim 12 further including at least one access
point connected between the DUT and traffic generating device.
18. The method of claim 12 including the further step of adjustably
attenuating signals at variable rates over time, whereby changes in
rate of motion of the DUT are simulated.
19. The method of claim 12 including the further step of adjustably
increasing and decreasing signal strength over time, whereby
changes in direction of motion of the DUT are simulated.
20. The method of claim 19 including the further step of
establishing at least two communications paths which can be
operated upon independently by the dynamically adjustable
attenuator, whereby changes in direction of motion of the DUT can
be simulated in two dimensions.
21. The method of claim 12 further including a pair of dynamically
adjustable attenuators connected in series with a tap connected
therebetween, and including the further step of monitoring signals
at the tap.
22. Apparatus for testing roaming of a wireless device between
access points comprising: an enclosure for shielding the wireless
device from electromagnetic interference; a communications traffic
generating device in communication with the wireless device, the
traffic generating device operable to generate communications
traffic; a plurality of access points, each in a communications
path between the wireless device and the communications traffic
generating device; and at least one dynamically adjustable
attenuator operable to individually and adjustably attenuate
signals between the wireless device and the traffic generating
device via each communication path over time during a test, whereby
roaming of the wireless device between access points can be tested
by varying path loss between the wireless device and access
points.
23. The apparatus of claim 22 further including, for each access
point, a pair of dynamically adjustable attenuators connected in
series with a tap connected therebetween, and a monitor connected
to the tap.
24. The apparatus of claim 22 further including a device operable
to measure at least one of: roaming time, quality of service,
packet loss, delay and jitter.
25. The apparatus of claim 24 wherein the device provides data
indicative of at least one of: roaming time, quality of service,
packet loss, delay and jitter, as a function of at least one of:
call load, background load, distance, path loss, roam, and rate of
simulated motion.
26. The apparatus of claim 22 wherein the dynamically adjustable
attenuator is further operable to adjustably attenuate signals at
variable rates over time, whereby changes in rate of motion of the
wireless device are simulated.
27. The apparatus of claim 22 wherein the dynamically adjustable
attenuator is further operable to adjustably increase and decrease
signal strength over time, whereby changes in direction of motion
of the wireless device are simulated.
28. The apparatus of claim 22 further including a device in
communication with the dynamically adjustable attenuator, the
device being operable to control operation of the attenuator in a
predetermined manner.
29. A method for testing roaming of a wireless device between
access points comprising the steps of: shielding the wireless
device from electromagnetic interference; generating communications
traffic with a communications traffic generating device in
communication with the wireless device; providing a plurality of
communications paths between the wireless device and the
communications traffic generating device, each path associated with
an access point; and individually, dynamically, adjustably
attenuating signals between the wireless device and the traffic
generating device via each communication path over time during a
test with at least one attenuator, whereby roaming of the wireless
device between access points can be tested by varying path loss
between the wireless device and access points.
30. The method of claim 29 further including, for each access
point, a pair of dynamically adjustable attenuators connected in
series with a tap connected therebetween, and including the further
step of monitoring signals at the tap.
31. The method of claim 29 further including the step of measuring
at least one of: roaming time, quality of service, packet loss,
delay and jitter.
32. The method of claim 29 further including the step of providing
data indicative of at least one of: roaming time, quality of
service, packet loss, delay and jitter, as a function of at least
one of: call load, background load, distance, path loss, roam, and
rate of simulated motion.
33. The method of claim 29 including the further step of adjustably
attenuating signals at variable rates over time, whereby changes in
rate of motion of the wireless device are simulated.
34. The method of claim 29 including the further step of adjustably
increasing and decreasing signal strength over time, whereby
changes in direction of motion of the wireless device are
simulated.
35. The method of claim 29 further including a device in
communication with the dynamically adjustable attenuator, the
device being operable to control operation of the attenuator in a
predetermined manner.
36. Apparatus for testing capacity of a wireless device under test
("DUT") comprising: an enclosure for shielding the DUT from
electromagnetic interference; and a communications traffic
generating device in communication with the DUT, the communications
traffic generating device being operable to generate traffic in
amounts which are variable over time during a test; whereby
capacity of the DUT can be tested by varying communications
traffic.
37. The apparatus of claim 36 wherein the traffic generating device
includes a phone emulator which generates packets carrying voice
traffic and a data client emulator which generates packets not
carrying voice traffic, and being operable to generate
communications traffic representative of a selected, variable
number of voice traffic devices and data client devices.
38. The apparatus of claim 36 wherein the traffic generating device
is operable to generate traffic of at least first and second types,
where the first traffic type has a higher priority than the second
traffic type, whereby prioritization support may be tested.
39. The apparatus of claim 38 wherein the higher priority traffic
is increased during the test.
40. The apparatus of claim 38 wherein the lower priority traffic is
increased during the test.
41. The apparatus of claim 36 further including a second real
device in a separate shielded enclosure in communication with the
DUT.
42. The apparatus of claim 37 wherein the communications traffic
generator is operable to increase the number of simulated phones
during a test.
43. The apparatus of claim 37 wherein the communications traffic
generator is operable to increase the number of simulated data
clients during a test.
44. The apparatus of claim 36 further including a measurement
device operable to measure at least one of: roaming time, quality
of service, packet loss, delay and jitter.
45. The apparatus of claim 36 wherein the monitoring device
provides data indicative of at least one of: roaming time, quality
of service, packet loss, delay and jitter, as a function of at
least one of: call load, background load, distance, path loss,
roam, and rate of simulated motion.
46. The apparatus of claim 36 further including at least one
dynamically adjustable attenuator operable to individually and
adjustably attenuate signals between the DUT and the communications
traffic generating device over time during a test.
47. The apparatus of claim 46 wherein the dynamically adjustable
attenuator is further operable to adjustably attenuate signals at
variable rates over time, whereby changes in rate of motion of the
DUT are simulated.
48. The apparatus of claim 46 wherein the dynamically adjustable
attenuator is further operable to adjustably increase and decrease
signal strength over time, whereby changes in direction of motion
of the DUT are simulated.
49. The apparatus of claim 36 further including a pair of
dynamically adjustable attenuators connected in series with a tap
connected therebetween, and a monitor connected to the tap.
50. A method for testing capacity of a wireless device under test
("DUT") comprising the steps of: shielding the DUT from
electromagnetic interference; and generating communications traffic
representative of a traffic load which varies during a test;
whereby capacity can be tested by varying communications
traffic.
51. The method of claim 50 wherein the traffic generating device
includes a phone emulator, and including the further step of
generating packets carrying voice traffic, and wherein the traffic
generating device includes a data client emulator, and including
the further step of generating packets not carrying voice traffic,
the traffic generating device being operable to generate
communications traffic representative of a selected, variable
number of voice traffic devices and data client devices.
52. The method of claim 50 including the further step of
generating, by the traffic generating device, traffic of at least
first and second types, where the first traffic type has a higher
priority than the second traffic type, whereby prioritization
support may be tested.
53. The method of claim 52 including the further step of increasing
the higher priority traffic during the test.
54. The method of claim 52 including the further step of increasing
the lower priority traffic during the test.
55. The method of claim 50 further including a second real device
in a separate shielded enclosure in communication with the DUT.
56. The method of claim 51 including the further step of increasing
the number of simulated phones during a test.
57. The method of claim 51 including the further step of increasing
the number of simulated data clients during a test.
58. The method of claim 50 further including a measurement device,
and including the further step of employing the measurement device
for measuring at least one of: roaming time, quality of service,
packet loss, delay and jitter.
59. The method of claim 50 including the further step of providing
data indicative of at least one of: roaming time, quality of
service, packet loss, delay and jitter, as a function of at least
one of: call load, background load, distance, path loss, roam, and
rate of simulated motion.
60. The method of claim 50 further including at least one
dynamically adjustable attenuator, and including the further step
of individually and adjustably attenuating signals between the DUT
and the communications traffic generating device over time during a
test.
61. The method of claim 60 including the further step of
dynamically adjustably attenuating signals at variable rates over
time, whereby changes in rate of motion of the DUT are
simulated.
62. The method of claim 60 including the further step of
dynamically adjustably increasing and decreasing signal strength
over time, whereby changes in direction of motion of the DUT are
simulated.
63. The method of claim 50 further including a pair of dynamically
adjustable attenuators connected in series with a tap connected
therebetween, and including the further step of monitoring signals
at the tap.
64. Apparatus for testing roaming of a wireless device associated
with changing traffic conditions comprising: an enclosure for
shielding the device from electromagnetic interference; a
communications traffic generating device in communication with the
wireless device, the communications traffic generating device being
operable to generate traffic in amounts which are variable over
time during a test; and a plurality of access points, each in a
communications path between the wireless device and the
communications traffic generating device; whereby roaming of the
wireless device between access points can be tested by varying
traffic.
65. The apparatus of claim 64 further including at least one
dynamically adjustable attenuator operable to individually and
adjustably attenuate signals between the wireless device and the
traffic generating device via each communication path over time
during a test.
66. The apparatus of claim 64 wherein the traffic generating device
includes a phone emulator which generates packets carrying voice
traffic and a data client emulator which generates packets not
carrying voice traffic, and being operable to generate
communications traffic representative of a selected, variable
number of voice traffic devices and data client devices.
67. The apparatus of claim 64 wherein the traffic generating device
is operable to generate traffic of at least first and second types,
where the first traffic type has a higher priority than the second
traffic type, whereby prioritization support may be tested.
68. The apparatus of claim 67 wherein the higher priority traffic
is increased during the test.
69. The apparatus of claim 67 wherein the lower priority traffic is
increased during the test.
70. The apparatus of claim 64 further including a second real
device in a separate shielded enclosure in communication with the
wireless device.
71. The apparatus of claim 66 wherein the communications traffic
generator is operable to increase the number of simulated phones
during a test.
72. The apparatus of claim 66 wherein the communications traffic
generator is operable to increase the number of simulated data
clients during a test.
73. The apparatus of claim 64 further including a measurement
device operable to measure at least one of: roaming time, quality
of service, packet loss, delay and jitter.
74. The apparatus of claim 73 wherein a device provides data
indicative of at least one of: roaming time, quality of service,
packet loss, delay and jitter, as a function of at least one of:
call load, background load, distance, path loss, roam, and rate of
simulated motion.
75. The apparatus of claim 64 further including at least one
dynamically adjustable attenuator operable to individually and
adjustably attenuate signals between the wireless device and the
communications traffic generating device over time during a
test.
76. The apparatus of claim 75 wherein the dynamically adjustable
attenuator is further operable to adjustably attenuate signals at
variable rates over time, whereby changes in rate of motion of the
DUT are simulated.
77. The apparatus of claim 75 wherein the dynamically adjustable
attenuator is further operable to adjustably increase and decrease
signal strength over time, whereby changes in direction of motion
of the DUT are simulated.
78. The apparatus of claim 64 further including a pair of
dynamically adjustable attenuators connected in series with a tap
connected therebetween, and a monitor connected to the tap.
79. A method for testing roaming of a wireless device associated
with changing traffic conditions comprising the steps of: shielding
the wireless device from electromagnetic interference; generating,
with a communications traffic generating device in communication
with the wireless device, traffic in amounts which are variable
over time during a test; and monitoring communications between the
wireless device and a plurality of access points, each in a
communications path between the wireless device and the
communications traffic generating device; whereby roaming of the
wireless device between access points can be tested by varying
traffic.
80. The method of claim 79 further including at least one
dynamically adjustable attenuator operable to individually and
adjustably attenuate signals between the wireless device and the
traffic generating device via each communication path over time
during a test.
81. The method of claim 79 wherein the traffic generating device
includes a phone emulator which generates packets carrying voice
traffic and a data client emulator which generates packets not
carrying voice traffic, and being operable to generate
communications traffic representative of a selected, variable
number of voice traffic devices and data client devices.
82. The method of claim 79 including the further step of generating
traffic of at least first and second types, where the first traffic
type has a higher priority than the second traffic type, whereby
prioritization support may be tested.
83. The method of claim 82 including the further step of increasing
the higher priority traffic is increased during the test.
84. The method of claim 82 including the further step of increasing
the lower priority traffic during the test.
85. The method of claim 79 further including a second real device
in a separate shielded enclosure in communication with the wireless
device.
86. The method of claim 81 further including the step of increasing
the number of simulated phones during a test.
87. The method of claim 81 further including the step of increasing
the number of simulated data clients during a test.
88. The method of claim 79 including the further step of measuring
at least one of: roaming time, quality of service, packet loss,
delay and jitter.
89. The method of claim 88 including the further step of providing
data indicative of at least one of: roaming time, quality of
service, packet loss, delay and jitter, as a function of at least
one of: call load, background load, distance, path loss, roam, and
rate of simulated motion.
90. The method of claim 79 further including at least one
dynamically adjustable attenuator, and including the further step
of individually and adjustably attenuating signals between the
wireless device and the communications traffic generating device
over time during a test.
91. The method of claim 90 including the further step of adjustably
attenuating signals at variable rates over time, whereby changes in
rate of motion of the wireless device are simulated.
92. The method of claim 90 including the further step of adjustably
increasing and decreasing signal strength over time, whereby
changes in direction of motion of the DUT are simulated.
93. The method of claim 79 further including a pair of dynamically
adjustable attenuators connected in series with a tap connected
therebetween, and including the further step of monitoring at the
tap.
Description
FIELD OF THE INVENTION
[0001] This invention relates generally to the field of test
equipment, and more particularly to testing responses to
time-varying conditions in a wireless network.
BACKGROUND OF THE INVENTION
[0002] New wireless technology is being developed and deployed to
provide support for voice and multimedia services in both
residential and enterprise environments. Wireless Local Area
Network ("WLAN") devices, for example, are being developed in
conjunction with IEEE 802.11 standards to support packetized voice
communications such as Voice over Internet Protocol ("VoIP"). There
are technological hurdles that must be overcome in order to support
voice and multimedia on WLANs because the technology was initially
designed to support simple data communications. In particular,
voice and multimedia applications can be more sensitive to jitter,
delay and packet loss than data communications applications. IEEE
802.11 specifies protocols and techniques for overcoming some of
these technological hurdles.
[0003] Because the costs associated with developing, purchasing,
selling and deploying a new wireless technology are often quite
high, it is common to conduct testing to mitigate the risk that the
technology will fail to perform as planned. However, wireless
devices are notoriously difficult to test because they can be
affected by ambient sources of interference. Further, the different
combinations of conditions to which a wireless device may be
subjected in actual use is so great in number that it is difficult
and time-consuming to create all of those conditions in a test
environment. It is known, for example, to simulate some wireless
network operations by manually moving a wireless device through a
building in which wireless access devices are strategically
situated. However, this technique is too labor intensive and
imprecise to simulate a wide variety of traffic conditions,
distances between access points and rates of motion in a practical
manner. Further, such a manual, open-air test can be rendered
invalid by transient interference from a microwave, RADAR or other
RF source. More recently it has become known to simulate a wireless
network by enclosing devices in EMI-shielded containers which are
in communication via wired connections. Attenuators and combiners
are employed to simulate a selected distance between devices. Such
a system is disclosed in U.S. Pat. No. 6,724,730, which is
incorporated herein by reference.
SUMMARY OF THE INVENTION
[0004] In accordance with the invention, technology for simulating
time-varying conditions in a wireless network includes an enclosure
for shielding a wireless device under test ("DUT") from
electromagnetic interference; a communications traffic generator
operable to generate communications test traffic having selected
characteristics; and a dynamically adjustable attenuator in
communication with the wireless device and the traffic generator,
the attenuator being operable to adjustably attenuate signals
between the device and the traffic generator over time during a
test, whereby motion of the device is simulated. By connecting
multiple access points, at least one of which is in communication
with a separate dynamically adjustable attenuator, it is possible
to force the DUT to roam between access points. Further, phone and
data client emulators can be employed to simulate support of
variable numbers of client devices which can be changed during a
test, including individual motions of those devices.
[0005] One advantage of the invention is the ability to simulate
motion in order to test range. Manually testing response to motion
in open-air is time consuming and inaccurate. Further, static tests
carried out at a series of distances can be automated, but fail to
account for the effects of rate of motion. Hence, the present
invention offers the efficiency and accuracy of an automated test
and also simulates selectable rates of motion.
[0006] Another advantage of the invention is the ability to use
simulated motion to cause and test roaming. Roaming time is a
significant metric to voice communications because each time a
phone roams it is subjected to a burst of lost packets. In general,
bursty packet loss has a more deleterious effect on voice quality
than uniform, distributed packet loss because CODECS are capable of
correcting or regenerating limited numbers of lost packets in a
given portion of a transmission. This is significant because in
WiFi networks where the density of access points is relatively high
roaming can occur every few seconds at normal walking velocity,
potentially resulting in unacceptable performance. In order to
reduce the deleterious effects of bursty packet loss caused by
roaming the IEEE and the WiFi Alliance may specify a 50-msec limit
on roaming time. To meet the 50-mSec roaming time requirement, the
IEEE is developing a new standard, 802.11r, which will define a
fast roaming algorithm. 802.11r in turn relies on another new
standard, 802.11k, which helps the phone discover neighboring
access points and query their status in preparation for a fast
roam. 802.11r also relies on the security standard, 802.11i, to
support pre-authentication so that the lengthy authentication
process can be avoided during a fast roam. The present invention
provides an efficient, accurate and automated technology for
testing both equipment and communications protocols.
[0007] Yet another advantage of the invention is the ability to
simulate a load of both data and voice clients, and to change the
number of clients during a test in order to test capacity, e.g.,
access point capacity. One aspect of the protocols developed to
support voice communications on WLANs is implementation of Quality
of Service ("QoS") controls. QoS controls include admission control
protocols to limit the number of simultaneous calls though a single
access point, and priority protocols to process packets according
to assigned levels of priority. For example, an admission control
protocol may prevent admittance of a new voice or data client if
there is insufficient bandwidth to support that new client.
Similarly, in the case of packet forwarding and drop decisions
preference may be given to voice packets because voice applications
tend to be more susceptible to packet loss, delay and jitter. By
simulating selectable numbers of voice and data clients, and
changing the number of clients during a test, the invention
advantageously facilitates testing such protocols and the devices
in which the protocols are implemented.
[0008] Another advantage of the invention is the ability to combine
real and emulated devices, and also to emulate motion and to
monitor the behavior of devices under test at the same time. For
example, a single real device can be tested under controlled
conditions using an emulated device. Alternatively, interactions
between multiple real devices may be tested under controlled
conditions while observing interactions of the devices in the
absence of an emulated device.
BRIEF DESCRIPTION OF THE FIGURES
[0009] FIG. 1A illustrates an architecture for simulating changes
in distance between an access point and a wireless device under
test, which can be used for testing operating range.
[0010] FIG. 1B illustrates test results obtained from the
architecture of FIG. 1A, plotted in terms of voice quality versus
path loss.
[0011] FIG. 1C illustrates test results obtained from the
architecture of FIG. 1A, plotted in terms of average jitter versus
path loss.
[0012] FIG. 1D illustrates test results obtained from the
architecture of FIG. 1A, plotted in terms of packet loss versus
path loss.
[0013] FIG. 1E illustrates test results obtained from the
architecture of FIG. 1A, plotted in terms of average delay versus
path loss.
[0014] FIG. 2A illustrates an architecture for simulating roaming
of a wireless device under test between access points.
[0015] FIG. 2B illustrates signal strength over a test cycle
associated with the architecture of FIG. 2A.
[0016] FIG. 2C is a timing diagram of communications and protocols
over a test cycle associated with the architecture of FIG. 2A.
[0017] FIG. 2D illustrates test results obtained from the
architecture of FIG. 2A, plotted in terms of roam time for
successive roam events.
[0018] FIG. 2E illustrates roam time distribution over a test cycle
associated with the architecture of FIG. 2A.
[0019] FIG. 3A illustrates an architecture for simulating changes
in the amount of voice and data traffic, changes in the number of
voice and data devices associated with a wireless device under
test, and changes in distance between the voice and data devices
and the wireless device under test.
[0020] FIG. 3B illustrates voice quality in terms of MOS versus
number of calls produced from the architecture of FIG. 3A.
[0021] FIG. 3C illustrates % frames loss versus number of calls
produced from the architecture of FIG. 3A.
[0022] FIG. 3D illustrates delay versus number of calls produced
from the architecture of FIG. 3A.
[0023] FIG. 3E illustrates jitter versus number of calls produced
from the architecture of FIG. 3A.
[0024] FIG. 3F illustrates background traffic throughput versus
number of calls produced from the architecture of FIG. 3A.
DETAILED DESCRIPTION
[0025] A Device Under Test ("DUT") can be any sort of device,
without limitation, including but not limited to an access point, a
client, multiple access points, multiple clients, and any
combinations thereof.
[0026] FIG. 1A illustrates an architecture for simulating changes
in distance between an access point (100) and a wireless DUT (102)
such as a phone, PDA or personal computer. A switch (104) such as a
10/100 Ethernet switch is connected between the access point and a
call gateway (106). A test console (108), which is connected to the
switch, may be employed to control the test in whole or in part. In
particular, the test console may control a dynamically adjustable
and programmable attenuator (110) which is connected between the
access point and the DUT. In order to establish communication and
generate traffic a call is initiated through the call gateway to
the DUT, e.g., with phone (111). An audio input may be used to
produce bi-directional traffic that is not simply indicative of
silence. The test console and specialized monitoring test modules
monitor traffic between the call gateway and the DUT on the 802.11
and on the 802.3 interfaces. The wireless devices, i.e., the DUT
and the access point, are enclosed in housings (112) which shield
against EMI and also isolate devices in the test bed from one
another. The wireless devices are isolated by at least 110 dB in
the entire frequency range of operation in order to substantially
eliminate any signal paths other than through the intended cables,
attenuators, combiners and switches in the test systems.
Connectivity between the wireless devices and other elements of the
architecture is non-wireless, e.g., electrical or optical.
[0027] Changes in distance between the access point (100) and the
device (102) under test are simulated by changing the path loss
between the access point and DUT. In particular, the path loss is
changed during a test. Received signal strength relative to
transmitted signal strength, i.e., path loss, is a reasonably
accurate indicator of distance between wireless devices in the
absence of shielding structures and interference. The dynamically
adjustable attenuator (110) is operable in response to signaling
from the test console (108) to attenuate signals between the DUT
and the access point in a preprogrammed manner. In other words, an
operator may design a test regimen using the test console which
causes the attenuator (110) to increase and decrease path loss to
selectable magnitudes and at selectable rates of change over time
in accordance with a predetermined schedule to simulate various
changes in distance, i.e., motion.
[0028] Referring now to FIGS. 1A through 1E, changes in operation
of the device (102) under test in response to simulated changes in
distance are monitored. Any measurable characteristics of the
communications generated by the DUT may be monitored and stored,
but in the illustrated embodiment the test console and monitoring
devices together monitor and store communications characteristics
including jitter, packet loss and delay which can be used to
generate an indication of communications quality versus path loss.
Various indicators of communications quality are known. In the case
of voice communications, the communications quality may be
expressed in terms including but not limited to Mean Opinion Score
("MOS"), Perceptual Speech Quality ("PESQ"), and Rating Factor
("R-Factor"), each of which is known in the art. R-Factor, for
example, is computed as a function of delay, packet loss and other
parameters such as noise, echo and path loss, which would be
monitored and stored. Those skilled in the art will recognize that
the invention may be modified to provide any measurable or
calculable quality metrics.
[0029] FIG. 1B illustrates voice quality expressed in terms of MOS
versus path loss as a result of testing a wireless phone with the
architecture of FIG. 1A. MOS, which is a subjective standard with
scoring from 1 to 5 that can be produced using people listening to
sound, can also be approximated using R-Factor as specified in
ITU-T G.107. The illustrated data indicates that voice quality in
terms of MOS for a VoIP phone operating over a WLAN may degrade
rapidly at a given distance from the access point at which path
loss is approximately 78 dB. It should be noted that the response
of a device to dynamically changing distance, i.e., motion, may
differ from responses to static tests at those same distances.
Static tests can simulate performance of the device at a series of
different distances from the access point, but do not simulate
different rates of change in distance which may effect performance
of the DUT. This could be significant if, for example, particular
phones or the protocols which support voice communications on the
WLAN are sensitive to particularly rapid or slow changes in
distance between the phone and access point.
[0030] FIG. 2A illustrates an architecture for simulating roaming
of a wireless device (102) between access points (200, 202). In
this architecture a dynamically adjustable attenuator matrix (204)
is connected between two access points (200, 202) and the device
(102) under test. The attenuator matrix (204) includes four
dynamically adjustable and programmable attenuators (206, 208, 210,
212) and a combiner (214). One pair of attenuators, i.e., (206 and
208) or (210 and 212), is connected in series between each access
point and the device. Taps (216, 218) are employed to enable
connection of monitors (220, 222).
[0031] Operation of the device (102) when in range of both access
points (200, 202) can be observed by setting the attenuators (206,
208, 210, 212) such that the device (102) is capable of
communications with either access point. This might be desirable,
for example, to observe initial association selections as a
function of relative signal strength. By connecting the taps in the
illustrated manner the monitors can also monitor traffic, e.g.,
signals or packets, from the DUT (102) and the access points (200,
202) even when the DUT and access points are not in communication,
e.g., because of attenuator settings. Further, the device can be
placed in a condition which is likely to trigger a roam from one
access point to another by attenuating the signal of the currently
associated access point and at the same time amplifying the signal
between the DUT and another access point.
[0032] Referring now to FIGS. 2A, 2B and 2C, the dynamically
adjustable attenuators are controlled in a manner which
simultaneously changes the signal strength between both access
points (200, 202) and the DUT (102) in order to simulate motion and
trigger roaming. The example illustrated in FIG. 2B shows the
signal from the first access point (200) being reduced at the same
rate as the signal from the second access point (202) increases.
This scenario simulates movement from the first access point to the
second access point. At some point the device (102) under test
disassociates from the first access point and associates with the
second access point. The timing of such a roaming transition, which
is illustrated in detail in FIG. 2C, is a function of the specific
design of the DUT and the communications protocols being utilized.
For example, roaming may be prompted by actual failure of
communications between the device (102) and access point (200), by
an anticipation of imminent failure, or by a determination that an
alternate access point (202) will provide better quality service.
It should be noted that the relative rates of change in signal
strengths may differ from the illustrated example. For example,
greater rates of change would simulate faster movement between
access points. Further, different rates of change in signal
strength simulate movement in a path other than a line between the
access points. For example, the signal strength of access point
(200) might be decreased at a greater rate than the signal strength
of access point (202) is increased, simulating the effect of an
obstruction coming between the access point and the DUT, for
example, or non-linear motion. Mathematic functions for calculating
attenuation values in order to simulate motion in any desired path
or paths, and at any desired rate or rates, in one, two and
three-dimensional space relative to the access points are well
understood by those skilled in the art.
[0033] Because of the importance of roaming time to voice
communications technology, data such as that illustrated in FIG. 2C
may be monitored and stored. For a device (102) providing voice
service, i.e., a phone, each roam event subjects the device to a
burst of lost packets. In general, bursty packet loss adversely
impacts voice quality more significantly than uniform packet loss
because of the function of CODECS used to support voice
communications. In WiFi networks where the density of access points
is relatively high, e.g., every 2-3 meters, roaming can occur every
few seconds at normal walking velocity. In order to reduce the
adverse impact of bursty packet loss caused by roaming it is
desirable to minimize roaming time. For example, the IEEE and the
WiFi Alliance may specify a 50-msec limit on roaming time. To meet
the 50-msec roaming time requirement, the IEEE is developing a new
standard, 802.11r, which will define a fast roaming algorithm.
802.11r in turn relies on another new standard, 802.11k, which
helps the phone discover the neighboring access points and query
their status in preparation for a fast roam. 802.11r also relies on
the security standard, 802.11i, to support pre-authentication so
that the lengthy authentication process can be avoided during a
fast roam. Therefore, the test console and monitoring devices may
be configured to monitor, store and display test data indicative of
performance relative to each of the relevant standards associated
with roaming, including but not limited to the data types
illustrated in FIGS. 2C in which each phase of the roaming process
is displayed. As access point (200) is moved out of range of the
phone, the data rate of the phone transitions down
(t.sub.TRANSITION). When access point (200) is completely out of
range, the phone starts to scan for another access point
(t.sub.SCAN). Eventually the phone associates with access point
(202). The time used to associate with access point (202)
(t.sub.ASSOCIATE) and the time used to resume data transitions
(t.sub.DATA) are also shown. The roaming time (t.sub.ROAM) is the
time between the last data transmission prior to roam and the first
data transmission following the roam. All of this data may be
plotted, analyzed and exported via the test console (108). As
illustrated in FIGS. 2D and 2E, test results may be plotted in
terms of number of roam events completed in less than a
predetermined time, and roam time distribution over a test
cycle.
[0034] FIG. 3A illustrates an architecture for simulating changes
in the amount of voice and data traffic, changes in the number of
voice and data devices associated with a wireless access point
under test, and changes in distance between the voice and data
devices and the wireless DUT. The architecture includes a phone
emulator/analyzer (400) and a data client emulator (402) which are
connected in parallel between the switch (104) and the access point
(100). The phone emulator and data client emulator are each capable
of simulating association and disassociation of multiple devices,
and individual motions of those devices relative to the access
point.
[0035] The phone emulator (400) includes a dynamically adjustable
attenuator (404) and voice traffic generator (406). The voice
traffic generator is capable of simulating multiple voice devices,
including adding and subtracting voice devices from the simulation
during a test. Further, the characteristics of traffic from each
voice device may be configured and changed, e.g., to simulate
periods of silence or lack of silence. The dynamically programmable
attenuator is operable to individually attenuate signals from each
device simulated by the voice traffic generator. Hence, the phone
emulator can simulate individual movements of voice devices, as
well as changing the number of devices associated with the access
point.
[0036] The data client emulator (402) includes a dynamically
adjustable attenuator (408) and a background traffic generator
(410). The background traffic generator is capable of simulating
multiple data client devices, including adding and subtracting data
client devices from the simulation during a test. Further, the
characteristics of traffic from each data client device may be
configured and changed, e.g., to simulate bursts of data
transmissions. The dynamically programmable attenuator is operable
to individually attenuate signals from each data client device
simulated by the background traffic generator. Hence, the data
client emulator can simulate individual movements of data client
devices, as well as changing the number of devices associated with
the access point.
[0037] The phone emulator (400) and data client emulator (402) can
be employed to test operation of the access point (100) and
communications protocols. One feature of the protocols developed to
support voice communications on WLANs is control of Quality of
Service ("QoS"). QoS can be controlled in-part by implementing
admission control protocols to limit the number of simultaneous
calls through a single AP, and priority protocols to process
packets according to assigned levels of priority. For example, an
admission control protocol may prevent admittance of a new voice or
data client if there is insufficient bandwidth to support that new
client. Similarly, in the case of packet forwarding and drop
decisions preference may be given to voice packets because voice
applications tend to be more susceptible to packet loss, delay and
jitter. It will therefore be appreciated that the architecture is
well suited to testing such protocols and the devices in which the
protocols are implemented.
[0038] Referring now to FIGS. 3A through 3F, the test console (108)
is operable to plot data such as voice quality versus number of
calls, % frames loss versus number of calls, delay versus number of
calls, jitter versus number of calls, and background traffic
throughput versus number of calls. Such data may be useful when
testing the ability of access points, switches and other WLAN
infrastructure devices to forward and prioritize voice traffic in
the presence of background data traffic. Important metrics for
qualifying equipment include call capacity and call quality as a
function of traffic congestion and number of active stations. To
measure voice quality as a function of call capacity and background
traffic, WiFi calls and low priority background traffic from
multiple clients are generated through the DUT, e.g., access point
(100). Further, to test an access point's ability to prioritize
voice packets and to manage the number of active calls, the client
emulators support WME and Admission Control. While sending traffic,
forwarding rate, packet loss, delay and jitter on the voice packet
streams going through the infrastructure under test are measured.
Call capacity is measured by having the phone emulator (400)
generate multiple voice calls at a high voice priority while the
data client emulator (402) is generating background traffic from
conventional PC clients.
[0039] While the invention is described through the above exemplary
embodiments, it will be understood by those of ordinary skill in
the art that modification to and variation of the illustrated
embodiments may be made without departing from the inventive
concepts herein disclosed. Moreover, while the preferred
embodiments are described in connection with various illustrative
structures, one skilled in the art will recognize that the system
may be embodied using a variety of specific structures.
Accordingly, the invention should not be viewed as limited except
by the scope and spirit of the appended claims.
* * * * *