The TR-398 Issue 2 WiFi Performance test plan by the Broadband forum
provides a comprehensive set of tests to qualify the performance of WiFi
access points (APs) designed for residential and small office
environments. Radio performance, Throughput, Connection Stability,
Airtime Fairness, AP Co-existence, Mu_MIMO Performance, Spatial
Consistency and Long-term Stability are some of the test areas covered
in this test plan. The test plan is designed for service providers
deploying in home WiFi APs to qualify the APs in the lab before
deployment and for equipment makers to test during the development of
the APs. Candela Technologies offers a fully automated TR-398 Issue 2
test system. The user can select from the list of tests available. Most
tests can run fully automated, though some require user interaction.
Measurements are made and compared to the specified PASS/FAIL criteria
in the TR-398 Issue 2 test plan and this report will show the summary
PASS/FAIL results followed more detailed results for each test.
Quality of Service Test intends to verify the capability of Wi-Fi device
to ensure higher priority traffic gets prioritized over lower priority
traffic. Best Effort QoS TCP traffic is used to determine maximum
capacity of the station. Then combinations of VO, VI, BE, BK QoS UDP
traffic is requested to run at 75% of the TCP throughput. This
overdrives the AP and causes it to drop frames. The pass/fail criteria
is that the higher QoS stream gets more priority (but not too much
priority) than the lower QoS stream, while maintaining good over-all
throughput.
For each combination of QoS, calculate the ratio of
connection_1_throughput / connection_2_throughput:
The Candela Score for Quality of Service Test is calculated as the
percentage sub-tests that passed the pass/fail criteria.
Type
|
Result
|
Value
|
P/F Value
|
Notes
|
Configuration NOTE
|
INFO
|
|
|
Traffic duration is set to: 60s, default is 120s
|
Configuration NOTE
|
INFO
|
|
|
Configured to skip 2.4Ghz band test.
|
AX 5Ghz STA1 Best-Effort
|
INFO
|
|
|
Reported TCP throughput: 722.35 Mbps
|
AX 5Ghz VO + VI Total Throughput
|
FAIL
|
51
|
650
|
VO: Tput 51.10 Mbps Req: 541.76 Drop: 90.41% STA-RSSI: -45
Rx-Rate: 1.201G Tx-Rate: 245M 802.11an-AX-80-2x2 VI: Tput 0 Req:
541.76 Mbps Drop: 99.82%
|
AX 5Ghz VO + VI Range Check
|
FAIL
|
∞
|
1.50
|
High priority traffic got too much priority.
|
AX 5Ghz VO + BE Total Throughput
|
FAIL
|
58
|
650
|
VO: Tput 51.21 Mbps Req: 541.76 Drop: 90.40% STA-RSSI: -44
Rx-Rate: 1.201G Tx-Rate: 245M 802.11an-AX-80-2x2 BE: Tput 6.70
Req: 541.76 Mbps Drop: 98.56%
|
AX 5Ghz VO + BE Range Check
|
FAIL
|
7.65
|
1.50
|
High priority traffic got too much priority.
|
AX 5Ghz VO + BK Total Throughput
|
FAIL
|
51
|
650
|
VO: Tput 51.02 Mbps Req: 541.76 Drop: 90.42% STA-RSSI: -44
Rx-Rate: 1.201G Tx-Rate: 245M 802.11an-AX-80-2x2 BK: Tput 0.30
Req: 541.76 Mbps Drop: 99.94%
|
AX 5Ghz VO + BK Range Check
|
FAIL
|
172.25
|
3.00
|
High priority traffic got too much priority.
|
AX 5Ghz VI + BE Total Throughput
|
PASS
|
801
|
650
|
VI: Tput 395.39 Mbps Req: 541.76 Drop: 23.87% STA-RSSI: -44
Rx-Rate: 1.201G Tx-Rate: 245M 802.11an-AX-80-2x2 BE: Tput 405.35
Req: 541.76 Mbps Drop: 23.63%
|
AX 5Ghz VI + BE Range Check
|
FAIL
|
0.98
|
1.10
|
High priority traffic did not get enough priority.
|
AX 5Ghz VI + BK Total Throughput
|
FAIL
|
646
|
650
|
VI: Tput 538.28 Mbps Req: 541.76 Drop: 0.15% STA-RSSI: -44
Rx-Rate: 1.201G Tx-Rate: 245M 802.11an-AX-80-2x2 BK: Tput 107.65
Req: 541.76 Mbps Drop: 79.43%
|
AX 5Ghz VI + BK Range Check
|
FAIL
|
5.00
|
3.00
|
High priority traffic got too much priority.
|
AX 5Ghz BE + BK Total Throughput
|
FAIL
|
638
|
650
|
BE: Tput 534.10 Mbps Req: 541.76 Drop: 0.01% STA-RSSI: -44
Rx-Rate: 1.201G Tx-Rate: 245M 802.11an-AX-80-2x2 BK: Tput 103.68
Req: 541.76 Mbps Drop: 80.42%
|
AX 5Ghz BE + BK Range Check
|
FAIL
|
5.15
|
3.00
|
High priority traffic got too much priority.
|
Configuration NOTE
|
INFO
|
|
|
Configured to skip 2.4Ghz band test.
|
Configuration NOTE
|
INFO
|
|
|
Configured to skip N/AC test.
|
Test configuration and LANforge software version
|
Auto-Helper
|
true
|
Use Issue-3 Behaviour
|
false
|
Allow-11w (MFP/PMF)
|
false
|
Skip 2.4Ghz Tests
|
true
|
Skip 5Ghz Tests
|
false
|
Duration-120
|
30
|
Duration-60
|
30
|
Channel 2Ghz
|
1
|
Channel 5Ghz
|
36
|
Extra Download Path-loss
|
0
|
TX Power
|
20
|
DUT TX Power 2.4G
|
20
|
DUT TX Power 5G
|
23
|
Multi-Conn
|
10
|
ToS
|
0
|
Upstream Port
|
1.2.2 eth2 Firmware: 0x80000aef, 1.1876.0 Resource: ct523c-3b89
|
Alien Upstream Port
|
1.2.2 eth2 Firmware: 0x80000aef, 1.1876.0 Resource: ct523c-3b89
|
Turn-Table Chamber
|
TR-398
|
Configured 2m 2.4Ghz RSSI
|
-26
|
Configured 2m 5Ghz RSSI
|
-30
|
Opposite-Speed:
|
20000
|
Allow Maximum NSS
|
false
|
Max-CX Offered Load:
|
1000000
|
Max-CX 2Ghz N rate:
|
2000000
|
Max-CX 2Ghz AX rate:
|
3000000
|
Max-CX 5Ghz AC rate:
|
8000000
|
Max-CX 5Ghz AX rate:
|
10000000
|
Throughput N 2Ghz rate:
|
100000000
|
Throughput AC 5Ghz rate:
|
560000000
|
Throughput AX 2Ghz rate:
|
200000000
|
Throughput AX 5Ghz rate:
|
720000000
|
Skip 4x4 5Ghz test
|
false
|
RvR issue 3
|
false
|
Throughput AX 2Ghz rate:
|
300000000
|
Throughput AX 2x2 5Ghz rate:
|
1100000000
|
Throughput AX 4x4 5Ghz rate:
|
1100000000
|
ATF Max NSS:
|
2
|
ATF Attenuation:
|
0
|
Max allowed packet loss%:
|
0.05
|
Assoc/Disassoc Traffic %:
|
99
|
Requested Rx-Sens Speed
|
65%
|
RxSens Rotation Degrees:
|
45
|
RxSens Start Step:
|
4
|
Attenuation Adjustment
|
0
|
Stop RX-Sens at pass
|
false
|
Pause on zero throughput
|
false
|
Spatial issue 3
|
true
|
Multiple STA issue 3
|
true
|
Use Virtual AX Stations
|
false
|
Use AX Radios for AC tests
|
false
|
Auto-Calibrate Interferer
|
true
|
Use 40Mhz DUT to Avoid DFS
|
false
|
Calibrate Alien with DUT Down
|
false
|
LANforge-AP is Interferer
|
true
|
Use AP-Coex Alien radios
|
true
|
Use AP-Coex Alien Tx-Power
|
true
|
User Interaction
|
true
|
Interferer AC 5G-80Mhz:
|
195.00 Mbps
|
Interferer AC 5G-40Mhz:
|
90.00 Mbps
|
Interferer AC 2.4G-20Mhz:
|
32.00 Mbps
|
Interferer AX 5G-80Mhz:
|
195.00 Mbps
|
Interferer AX 5G-40Mhz:
|
90.00 Mbps
|
Interferer AX 2.4G-20Mhz:
|
32.00 Mbps
|
2Ghz Alien AP Radio:
|
1.4.3 wiphy0
|
5Ghz Alien AP Radio:
|
1.4.3 wiphy0
|
Alien AP TxPower:
|
0 dBm
|
2Ghz Alien STA Radio:
|
1.4.4 wiphy1
|
5Ghz Alien STA Radio:
|
1.4.4 wiphy1
|
Alien STA TxPower:
|
0 dBm
|
Spatial Rotation Degrees:
|
30
|
Test Retries:
|
0
|
Stability Duration-180
|
60
|
Stability Max-Iterations
|
5
|
Stability UDP Duration
|
5 m
|
Calibration Mode:
|
4
|
Calibration NSS:
|
1
|
2.4Ghz LANforge AP Calibration Radio:
|
1.4.3 wiphy0
|
5Ghz LANforge AP Calibration Radio:
|
1.4.4 wiphy1
|
2.4Ghz Mesh Node-1 LANforge AP Calibration Radio:
|
1.5.3 wiphy0
|
5Ghz Mesh Node-1 LANforge AP Calibration Radio:
|
1.5.3 wiphy0
|
2.4Ghz Mesh Node-2 LANforge AP Calibration Radio:
|
1.6.3 wiphy0
|
5Ghz Mesh Node-2 LANforge AP Calibration Radio:
|
1.6.4 wiphy1
|
Calibrate against LANforge AP
|
true
|
Background Scan Module
|
simple
|
Background Short Interval
|
30
|
Background Long Interval
|
300
|
Background RSSI Threshold
|
-65
|
WiFi Radio 0
|
1.1.5 wiphy1 Resource: ct523c-3b29
|
WiFi Radio 1
|
1.1.4 wiphy0 Resource: ct523c-3b29
|
WiFi Radio 2
|
1.1.7 wiphy3 Resource: ct523c-3b29
|
WiFi Radio 3
|
1.1.6 wiphy2 Resource: ct523c-3b29
|
WiFi Radio 4
|
1.1.9 wiphy5 Resource: ct523c-3b29
|
WiFi Radio 5
|
1.1.8 wiphy4 Resource: ct523c-3b29
|
WiFi AX Radio 0
|
1.2.wiphy0 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 1
|
1.2.wiphy1 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 2
|
1.2.wiphy2 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 3
|
1.2.wiphy3 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 4
|
1.2.wiphy4 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 5
|
1.2.wiphy5 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 6
|
1.2.wiphy6 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 7
|
1.2.wiphy7 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 8
|
1.2.wiphy8 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 9
|
1.2.wiphy9 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 10
|
1.2.wiphy10 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 11
|
1.2.wiphy11 Firmware: release/core68::058653f6 Resource: ct523c-3b89
|
WiFi AX Radio 12
|
1.3.wiphy0 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 13
|
1.3.wiphy5 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 14
|
1.3.wiphy10 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 15
|
1.3.wiphy15 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 16
|
1.3.wiphy1 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 17
|
1.3.wiphy6 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 18
|
1.3.wiphy11 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 19
|
1.3.wiphy16 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 20
|
1.3.wiphy2 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 21
|
1.3.wiphy7 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 22
|
1.3.wiphy12 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 23
|
1.3.wiphy17 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 24
|
1.3.wiphy3 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 25
|
1.3.wiphy8 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 26
|
1.3.wiphy13 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 27
|
1.3.wiphy18 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 28
|
1.3.wiphy4 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 29
|
1.3.wiphy9 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 30
|
1.3.wiphy14 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi AX Radio 31
|
1.3.wiphy19 Firmware: release/core68::058653f6 Resource: ct523c-de7c
|
WiFi Mesh Radio 0
|
1.3.18 wiphy21 Firmware: release/core68::058653f6 Resource:
ct523c-de7c
|
WiFi Mesh Radio 1
|
1.3.18 wiphy21 Firmware: release/core68::058653f6 Resource:
ct523c-de7c
|
Attenuator 0
|
rssi-0-2.4Ghz: -22 rssi-0-5Ghz: -41 atten: 1.1.3094.0
|
Attenuator 1
|
rssi-0-2.4Ghz: -22 rssi-0-5Ghz: -41 atten: 1.1.3094.1
|
Attenuator 2
|
rssi-0-2.4Ghz: -22 rssi-0-5Ghz: -41 atten: 1.1.3094.2
|
Attenuator 3
|
rssi-0-2.4Ghz: -22 rssi-0-5Ghz: -41 atten: 1.1.3094.3
|
Attenuator 4
|
rssi-0-2.4Ghz: -27 rssi-0-5Ghz: -43 atten: 1.1.3102.0
|
Attenuator 5
|
rssi-0-2.4Ghz: -27 rssi-0-5Ghz: -43 atten: 1.1.3102.1
|
Attenuator 6
|
rssi-0-2.4Ghz: -27 rssi-0-5Ghz: -43 atten: 1.1.3099.0
|
Attenuator 7
|
rssi-0-2.4Ghz: -27 rssi-0-5Ghz: -43 atten: 1.1.3099.1
|
Attenuator 8
|
rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -43 atten: 1.1.3102.2
|
Attenuator 9
|
rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -43 atten: 1.1.3102.3
|
Attenuator 10
|
rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -43 atten:
|
Attenuator 11
|
rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -43 atten:
|
AX Attenuator 0
|
AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -44 atten: 1.1.3100.3
|
AX Attenuator 1
|
AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -44 atten: 1.1.3100.2
|
AX Attenuator 2
|
AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -44 atten: NA
|
AX Attenuator 3
|
AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -44 atten: NA
|
AX Attenuator 4
|
AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -42 atten: 1.1.3100.1
|
AX Attenuator 5
|
AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -42 atten: 1.1.3100.0
|
AX Attenuator 6
|
AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -42 atten:
|
AX Attenuator 7
|
AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -42 atten:
|
AX Attenuator 8
|
AX rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -45 atten: 1.1.3099.3
|
AX Attenuator 9
|
AX rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -45 atten: 1.1.3099.2
|
AX Attenuator 10
|
AX rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -45 atten:
|
AX Attenuator 11
|
AX rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -45 atten:
|
AX Attenuator 12
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 13
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 14
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 15
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 16
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 17
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 18
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 19
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 20
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 21
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 22
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 23
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 24
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 25
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 26
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 27
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 28
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 29
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 30
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
AX Attenuator 31
|
AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
|
Mesh Attenuator 0
|
Mesh rssi-0-2.4Ghz: -43 rssi-0-5Ghz: -63 atten: 1.1.3249.0
|
Mesh Attenuator 1
|
Mesh rssi-0-2.4Ghz: -43 rssi-0-5Ghz: -63 atten: 1.1.3249.1
|
Mesh Attenuator 2
|
Mesh rssi-0-2.4Ghz: -43 rssi-0-5Ghz: -63 atten: 1.1.3249.2
|
Mesh Attenuator 3
|
Mesh rssi-0-2.4Ghz: -43 rssi-0-5Ghz: -63 atten: 1.1.3249.3
|
Mesh Attenuator 4
|
Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -60 atten: 1.1.3232.0
|
Mesh Attenuator 5
|
Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -60 atten: 1.1.3232.1
|
Mesh Attenuator 6
|
Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -60 atten:
|
Mesh Attenuator 7
|
Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -60 atten:
|
Mesh Attenuator 8
|
Mesh rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -41 atten: 1.1.3232.2
|
Mesh Attenuator 9
|
Mesh rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -41 atten: 1.1.3232.3
|
Mesh Attenuator 10
|
Mesh rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -41 atten:
|
Mesh Attenuator 11
|
Mesh rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -41 atten:
|
Mesh Attenuator 12
|
Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -46 atten: 1.1.3263.0
|
Mesh Attenuator 13
|
Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -46 atten: 1.1.3263.1
|
Mesh Attenuator 14
|
Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -46 atten:
|
Mesh Attenuator 15
|
Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -46 atten:
|
Mesh Attenuator 16
|
Mesh rssi-0-2.4Ghz: -52 rssi-0-5Ghz: -59 atten: 1.1.3256.0
|
Mesh Attenuator 17
|
Mesh rssi-0-2.4Ghz: -52 rssi-0-5Ghz: -59 atten: 1.1.3256.1
|
Mesh Attenuator 18
|
Mesh rssi-0-2.4Ghz: -52 rssi-0-5Ghz: -59 atten: 1.1.3256.2
|
Mesh Attenuator 19
|
Mesh rssi-0-2.4Ghz: -52 rssi-0-5Ghz: -59 atten: 1.1.3256.3
|
Mesh Attenuator 20
|
Mesh rssi-0-2.4Ghz: -38 rssi-0-5Ghz: -59 atten: 1.1.3263.2
|
Mesh Attenuator 21
|
Mesh rssi-0-2.4Ghz: -38 rssi-0-5Ghz: -59 atten: 1.1.3263.3
|
Mesh Attenuator 22
|
Mesh rssi-0-2.4Ghz: -38 rssi-0-5Ghz: -59 atten:
|
Mesh Attenuator 23
|
Mesh rssi-0-2.4Ghz: -38 rssi-0-5Ghz: -59 atten:
|
Show Events
|
true
|
Build Date
|
Tue 19 Jul 2022 07:33:09 PM PDT
|
Git Version
|
1e4f6e387d4ca74f665f4590b1c8d27ecf151e3b
|