blob: 94b7facd05683213b823113b7e6a7e29576d8578 [file] [log] [blame]
Hardik Windlassa3d04b92020-02-17 15:06:05 +00001# Copyright 2017 - present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
14# FIXME Can we use the same test against BBSim and Hardware?
15
16*** Settings ***
17Documentation Test various end-to-end scenarios
18Suite Setup Setup Suite
19Test Setup Setup
20Test Teardown Teardown
21Suite Teardown Teardown Suite
22Library Collections
23Library String
24Library OperatingSystem
25Library XML
26Library RequestsLibrary
27Library ../../libraries/DependencyLibrary.py
28Resource ../../libraries/onos.robot
29Resource ../../libraries/voltctl.robot
30Resource ../../libraries/voltha.robot
31Resource ../../libraries/utils.robot
32Resource ../../libraries/k8s.robot
33Resource ../../variables/variables.robot
Suchitra Vemuri1d8e8172020-06-17 17:43:56 -070034Resource ../../libraries/power_switch.robot
Hardik Windlassa3d04b92020-02-17 15:06:05 +000035
36*** Variables ***
37${POD_NAME} flex-ocp-cord
38${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
39${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs
40#${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
41${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml
42${HELM_CHARTS_DIR} ~/helm-charts
43${VOLTHA_POD_NUM} 8
44${NAMESPACE} voltha
45# For below variable value, using deployment name as using grep for
46# parsing radius pod name, we can also use full radius pod name
47${RESTART_POD_NAME} radius
Suchitra Vemurie9c6ca62020-07-27 16:44:53 -070048${timeout} 360s
Hardik Windlassa3d04b92020-02-17 15:06:05 +000049${of_id} 0
50${logical_id} 0
Andrea Campanella86e24062020-08-05 19:09:18 +020051${uprate} 0
52${dnrate} 0
Hardik Windlassa3d04b92020-02-17 15:06:05 +000053${has_dataplane} True
Hardik Windlassffbf0602020-04-24 23:14:45 +053054${teardown_device} True
Hardik Windlassa3d04b92020-02-17 15:06:05 +000055${scripts} ../../scripts
56
Andy Baviere19991a2020-05-08 10:42:40 -070057# For dataplane bandwidth testing
58${upper_margin_pct} 105 # Allow 5% over the limit
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080059${lower_margin_pct} 90 # Allow 8% under the limit
Andy Baviere19991a2020-05-08 10:42:40 -070060${udp_rate_multiplier} 1.10 # Send UDP at bw profile limit * rate_multiplier
Andy Bavierc80a2742020-08-28 10:59:05 -070061${udp_packet_bytes} 1470 # UDP payload in bytes
Andy Baviere19991a2020-05-08 10:42:40 -070062
Hardik Windlassa3d04b92020-02-17 15:06:05 +000063# Per-test logging on failure is turned off by default; set this variable to enable
64${container_log_dir} ${None}
65
66*** Test Cases ***
Suchitra Vemuri1d8e8172020-06-17 17:43:56 -070067Reboot DT ONUs Physically
68 [Documentation] This test reboots ONUs physically before execution all the tests
69 ... Test case runs only on the PODs that are configured with PowerSwitch that
70 ... controls the power off/on ONUs/OLT remotely (simulating a physical reboot)
Hardik Windlassd6aa0822020-06-29 20:18:12 +053071 [Tags] functionalDt PowerSwitch RebootAllDTONUs
Suchitra Vemuri1d8e8172020-06-17 17:43:56 -070072 [Setup] Start Logging RebootAllDTONUs
73 [Teardown] Run Keywords Collect Logs
74 ... AND Stop Logging RebootAllDTONUs
75 Power Switch Connection Suite ${web_power_switch.ip} ${web_power_switch.user} ${web_power_switch.password}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080076 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri1d8e8172020-06-17 17:43:56 -070077 ${src}= Set Variable ${hosts.src[${I}]}
78 ${dst}= Set Variable ${hosts.dst[${I}]}
79 Disable Switch Outlet ${src['power_switch_port']}
80 Sleep 60s
81 Enable Switch Outlet ${src['power_switch_port']}
82 Sleep 60s
83 END
84
Hardik Windlassa3d04b92020-02-17 15:06:05 +000085Sanity E2E Test for OLT/ONU on POD for DT
86 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
87 ... Validate successful DHCP/E2E ping (no EAPOL and DHCP flows) for the tech profile that is used
88 ... Traffic sent with same vlan from different RGs,
89 ... should reach the NNI port on the OLT with the expected double tagged vlan ids
90 ... Inner vlans from the RG should not change
Suchitra Vemurif2388ad2020-03-15 21:44:44 -070091 [Tags] sanityDt
Andy Baviere187eda2020-04-20 15:00:02 -070092 [Setup] Run Keywords Start Logging SanityTestDt
Hardik Windlassa3d04b92020-02-17 15:06:05 +000093 ... AND Setup
94 [Teardown] Run Keywords Collect Logs
95 ... AND Stop Logging SanityTestDt
Hardik Windlassa3d04b92020-02-17 15:06:05 +000096 Run Keyword If ${has_dataplane} Clean Up Linux
97 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
98
Hardik Windlass35706ba2020-02-20 08:16:42 +000099Test Subscriber Delete and Add for DT
100 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
Hardik Windlass63d5e002020-03-06 21:07:09 +0530101 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
Hardik Windlass35706ba2020-02-20 08:16:42 +0000102 ... Delete a subscriber and validate that the pings do not succeed and state is purged
103 ... Disable and Enable the ONU (This is to replicate the existing DT behaviour)
104 ... Re-add the subscriber, and validate that the flows are present and pings are successful
Suchitra Vemurif2388ad2020-03-15 21:44:44 -0700105 [Tags] functionalDt SubAddDeleteDt
Andy Baviere187eda2020-04-20 15:00:02 -0700106 [Setup] Start Logging SubAddDeleteDt
Hardik Windlass35706ba2020-02-20 08:16:42 +0000107 [Teardown] Run Keywords Collect Logs
108 ... AND Stop Logging SubAddDeleteDt
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800109 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000110 ${src}= Set Variable ${hosts.src[${I}]}
111 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800112 ${of_id}= Get ofID From OLT List ${src['olt']}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000113 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800114 ${olt_device_id}= Get OLTDeviceID From OLT List ${src['olt']}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000115 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
116 ... ${of_id}
117 # Remove Subscriber Access
ubuntu6b6e7d42020-03-02 12:35:42 -0800118 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000119 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
120 Sleep 10s
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530121 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlass35706ba2020-02-20 08:16:42 +0000122 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
123 ... Wait Until Keyword Succeeds 60s 2s
124 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
125 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800126 # TODO: Enhance the test to validate flows per OLT
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530127 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800128 ${onos_flows_count}= Evaluate 4 * ( ${num_all_onus} - 1 )
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530129 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
130 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlass25e11702020-03-30 20:05:19 +0530131 ... ${of_id} ${onos_flows_count}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000132 # Verify VOLTHA flows for OLT equals twice the number of ONUS (minus ONU under test) + 1 for LLDP
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800133 ${olt_flows}= Evaluate 2 * ( ${num_all_onus} - 1 ) + 1
Hardik Windlass35706ba2020-02-20 08:16:42 +0000134 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800135 ... ${olt_device_id}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000136 # Verify VOLTHA flows for ONU under test is Zero
137 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate Device Flows
138 ... ${onu_device_id} 0
139 # Disable and Re-Enable the ONU (To replicate DT current workflow)
140 # TODO: Delete and Auto-Discovery Add of ONU (not yet supported)
141 Disable Device ${onu_device_id}
142 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
143 ... Validate Device DISABLED UNKNOWN
144 ... REACHABLE ${src['onu']}
145 Enable Device ${onu_device_id}
Suchitra Vemuricdc32d82020-07-17 12:24:46 -0700146 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 360s 5s
Hardik Windlass35706ba2020-02-20 08:16:42 +0000147 ... Validate Device ENABLED ACTIVE
148 ... REACHABLE ${src['onu']}
149 # Add Subscriber Access
ubuntu6b6e7d42020-03-02 12:35:42 -0800150 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000151 ... ${ONOS_SSH_PORT} volt-add-subscriber-access ${of_id} ${onu_port}
152 Sleep 10s
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530153 # Verify subscriber access flows are added for the ONU port
154 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass25e11702020-03-30 20:05:19 +0530155 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
156 ... ${onu_port} ${nni_port} ${src['s_tag']}
Suchitra Vemuricdc32d82020-07-17 12:24:46 -0700157 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 360s 5s
Hardik Windlass35706ba2020-02-20 08:16:42 +0000158 ... Validate Device ENABLED ACTIVE
159 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-flows-pushed
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530160 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlass35706ba2020-02-20 08:16:42 +0000161 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
162 ... Wait Until Keyword Succeeds 60s 2s
163 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
164 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
165 Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
166 Run Keyword and Ignore Error Collect Logs
167 END
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800168 # Verify flows for all OLTs
169 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate All OLT Flows
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530170 # Verify ONOS Flows
171 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800172 #${onos_flows_count}= Evaluate 4 * ${num_all_onus}
173 #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
174 #... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
175 #... ${of_id} ${onos_flows_count}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530176 # Verify VOLTHA Flows
Hardik Windlass35706ba2020-02-20 08:16:42 +0000177 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800178 #${olt_flows}= Evaluate 2 * ${num_all_onus} + 1
Hardik Windlass35706ba2020-02-20 08:16:42 +0000179 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800180 #${onu_flows}= Set Variable 2
181 #Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
182 #${List_ONU_Serial} Create List
183 #Set Suite Variable ${List_ONU_Serial}
184 #Build ONU SN List ${List_ONU_Serial}
185 #Log ${List_ONU_Serial}
186 #Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
187 #... ${List_ONU_Serial} ${onu_flows}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000188
Hardik Windlass63d5e002020-03-06 21:07:09 +0530189Test Disable and Enable ONU for DT
190 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
191 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
192 ... Perform disable on the ONUs and validate that the pings do not succeed
193 ... Perform enable on the ONUs and validate that the pings are successful
Suchitra Vemurif2388ad2020-03-15 21:44:44 -0700194 [Tags] functionalDt DisableEnableONUDt
Andy Baviere187eda2020-04-20 15:00:02 -0700195 [Setup] Start Logging DisableEnableONUDt
Hardik Windlass63d5e002020-03-06 21:07:09 +0530196 [Teardown] Run Keywords Collect Logs
197 ... AND Stop Logging DisableEnableONUDt
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800198 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass63d5e002020-03-06 21:07:09 +0530199 ${src}= Set Variable ${hosts.src[${I}]}
200 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800201 ${of_id}= Get ofID From OLT List ${src['olt']}
Hardik Windlass63d5e002020-03-06 21:07:09 +0530202 ${onu_device_id}= Get Device ID From SN ${src['onu']}
203 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
204 ... ${of_id}
205 Disable Device ${onu_device_id}
206 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
207 ... Validate Device DISABLED UNKNOWN
208 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-admin-lock
209 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700210 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530211 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlass63d5e002020-03-06 21:07:09 +0530212 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
213 ... Wait Until Keyword Succeeds 60s 2s
214 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
215 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
216 Sleep 5s
217 Enable Device ${onu_device_id}
Suchitra Vemuricdc32d82020-07-17 12:24:46 -0700218 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 360s 5s
Hardik Windlass63d5e002020-03-06 21:07:09 +0530219 ... Validate Device ENABLED ACTIVE
220 ... REACHABLE ${src['onu']} onu=True onu_reason=onu-reenabled
221 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700222 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530223 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlass63d5e002020-03-06 21:07:09 +0530224 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
225 ... Wait Until Keyword Succeeds 60s 2s
226 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
227 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
228 Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
229 Run Keyword and Ignore Error Collect Logs
230 END
231
Hardik Windlassaaea3402020-03-10 19:45:45 +0530232Test Disable and Delete OLT for DT
233 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
234 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
235 ... Perform disable on the OLT and validate ONUs state and that the pings do not succeed
236 ... Perform delete on the OLT, Re-do Setup (Recreate the OLT) and Perform Sanity Test DT
Suchitra Vemurif2388ad2020-03-15 21:44:44 -0700237 [Tags] functionalDt DisableDeleteOLTDt
Suchitra Vemuri221398a2020-05-29 22:45:17 -0700238 [Setup] Start Logging DisableDeleteOLTDt
Hardik Windlassaaea3402020-03-10 19:45:45 +0530239 [Teardown] Run Keywords Collect Logs
240 ... AND Stop Logging DisableDeleteOLTDt
Hardik Windlassaaea3402020-03-10 19:45:45 +0530241 # Disable and Validate OLT Device
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800242 FOR ${I} IN RANGE 0 ${olt_count}
243 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
244 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
245 Disable Device ${olt_device_id}
246 ${of_id}= Get ofID From OLT List ${olt_serial_number}
247 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
248 ... Validate OLT Device DISABLED UNKNOWN REACHABLE
249 ... ${olt_serial_number}
250 Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Device DISABLED UNKNOWN REACHABLE
251 ... ${olt_serial_number}
252 ${num_onus}= Set Variable ${list_olts}[${I}][onucount]
253 # Validate ONUs
254 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONUs After OLT Disable
255 ... ${num_onus}
256 # Verify ONOS Flows
257 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
258 ${onos_flows_count}= Evaluate 4 * ${num_onus}
259 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
260 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
261 ... ${of_id} ${onos_flows_count}
262 # Verify VOLTHA Flows
263 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
264 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
265 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
266 ${onu_flows}= Set Variable 2
267 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
268 ... ${olt_device_id}
269 ${List_ONU_Serial} Create List
270 Set Suite Variable ${List_ONU_Serial}
Andrea Campanella99a548b2020-11-18 09:50:32 +0100271 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number} ${num_onus}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800272 Log ${List_ONU_Serial}
273 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
274 ... ${List_ONU_Serial} ${onu_flows}
275 # Delete OLT and Validate Empty Device List
276 Delete Device ${olt_device_id}
277 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Test Empty Device List
278 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
279 ... Verify Device Flows Removed ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
280 Run Keyword and Ignore Error Collect Logs
281 END
282 #Disable Device ${olt_device_id}
283 #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
284 #... Validate OLT Device DISABLED UNKNOWN REACHABLE
285 #... ${olt_serial_number}
286
Hardik Windlassaaea3402020-03-10 19:45:45 +0530287 # Validate ONUs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800288 #Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONUs After OLT Disable
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530289 # Verify ONOS Flows
290 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800291 #${onos_flows_count}= Evaluate 4 * ${num_all_onus}
292 #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
293 #... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
294 #... ${of_id} ${onos_flows_count}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530295 # Verify VOLTHA Flows
Hardik Windlassaaea3402020-03-10 19:45:45 +0530296 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800297 #${olt_flows}= Evaluate 2 * ${num_all_onus} + 1
Hardik Windlassaaea3402020-03-10 19:45:45 +0530298 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800299 #${onu_flows}= Set Variable 2
300 #Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
301 #${List_ONU_Serial} Create List
302 #Set Suite Variable ${List_ONU_Serial}
303 #Build ONU SN List ${List_ONU_Serial}
304 #Log ${List_ONU_Serial}
305 #Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
306 #... ${List_ONU_Serial} ${onu_flows}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530307 # Delete OLT and Validate Empty Device List
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800308 #Delete Device ${olt_device_id}
309 #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Test Empty Device List
310 #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
311 #... Verify Device Flows Removed ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
312 #Run Keyword and Ignore Error Collect Logs
Hardik Windlassaaea3402020-03-10 19:45:45 +0530313 # Re-do Setup (Recreate the OLT) and Perform Sanity Test DT
314 Run Keyword Setup
Suchitra Vemuriae9cecb2020-03-12 12:59:14 -0700315 Run Keyword If ${has_dataplane} Clean Up Linux
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800316 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
317 #Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlassaaea3402020-03-10 19:45:45 +0530318
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530319Test Disable and Enable OLT for DT
320 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
321 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
322 ... Perform disable on the OLT and validate that the pings do not succeed
323 ... Perform enable on the OLT and validate that the pings are successful
Hardik Windlass2b37e712020-06-12 02:13:17 +0530324 [Tags] functionalDt DisableEnableOLTDt
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530325 [Setup] Start Logging DisableEnableOLTDt
326 [Teardown] Run Keywords Collect Logs
327 ... AND Stop Logging DisableEnableOLTDt
328 # Disable and Validate OLT Device
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800329 FOR ${I} IN RANGE 0 ${olt_count}
330 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
331 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
332 ${rc} ${output}= Run and Return Rc and Output
333 ... ${VOLTCTL_CONFIG}; voltctl device disable ${olt_device_id}
334 Should Be Equal As Integers ${rc} 0
335 Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Device DISABLED UNKNOWN REACHABLE
336 ... ${olt_serial_number}
337 END
338 #Disable Device ${olt_device_id}
339 #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
340 #... Validate OLT Device DISABLED UNKNOWN REACHABLE
341 #... ${olt_serial_number}
342 # Validate ONUs
343 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass7c801e62020-05-04 19:33:21 +0530344 ${src}= Set Variable ${hosts.src[${I}]}
345 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800346 ${of_id}= Get ofID From OLT List ${src['olt']}
Hardik Windlass7c801e62020-05-04 19:33:21 +0530347 ${onu_device_id}= Get Device ID From SN ${src['onu']}
348 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
349 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
350 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700351 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlass7c801e62020-05-04 19:33:21 +0530352 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
353 ... Wait Until Keyword Succeeds 60s 2s
354 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
355 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
356 # Remove Subscriber Access (To replicate DT workflow)
357 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
358 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
Hardik Windlass2b37e712020-06-12 02:13:17 +0530359 Sleep 10s
Hardik Windlass7c801e62020-05-04 19:33:21 +0530360 # Delete ONU Device (To replicate DT workflow)
361 Delete Device ${onu_device_id}
Hardik Windlass2b37e712020-06-12 02:13:17 +0530362 Sleep 5s
Hardik Windlass7c801e62020-05-04 19:33:21 +0530363 END
Hardik Windlass2b37e712020-06-12 02:13:17 +0530364 Sleep 5s
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530365 # Enable the OLT back and check ONU, OLT status are back to "ACTIVE"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800366 FOR ${I} IN RANGE 0 ${olt_count}
367 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
368 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
369 Enable Device ${olt_device_id}
370 Sleep 15s
371 Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Device ENABLED ACTIVE REACHABLE
372 ... ${olt_serial_number}
373 #TODO: Update for PON_OLT ETHERNET_NNI
374 #Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Port Types
375 #... PON_OLT ETHERNET_NNI
376 END
Hardik Windlass7c801e62020-05-04 19:33:21 +0530377 # Waiting extra time for the ONUs to come up
378 Sleep 60s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800379 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlass7c801e62020-05-04 19:33:21 +0530380 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530381
382Test Delete and ReAdd OLT for DT
383 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
384 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
385 ... Disable and Delete the OLT
386 ... Create/Enable the same OLT again
387 ... Validate DHCP/E2E pings succeed for all the ONUs connected to the OLT
388 [Tags] functionalDt DeleteReAddOLTDt
389 [Setup] Start Logging DeleteReAddOLTDt
390 [Teardown] Run Keywords Collect Logs
391 ... AND Stop Logging DeleteReAddOLTDt
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800392 FOR ${I} IN RANGE 0 ${olt_count}
393 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
394 ${of_id}= Get ofID From OLT List ${olt_serial_number}
395 Delete Device and Verify ${olt_serial_number}
396 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
397 ... Verify Device Flows Removed ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
398 Run Keyword and Ignore Error Collect Logs
399 END
400 # Recreate the OLTs
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530401 Setup
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800402 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530403 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
404
405Test Disable ONUs and OLT Then Delete ONUs and OLT for DT
406 [Documentation] On deployed POD, disable the ONU, disable the OLT and then delete ONU and OLT.
407 ... This TC is to confirm that ONU removal is not impacting OLT
408 ... Devices will be removed during the execution of this TC
409 ... so calling setup at the end to add the devices back to avoid the confusion.
410 [Tags] functionalDt DisableDeleteONUOLTDt
411 [Setup] Start Logging DisableDeleteONUOLTDt
412 [Teardown] Run Keywords Collect Logs
413 ... AND Stop Logging DisableDeleteONUOLTDt
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800414 #${olt_device_id}= Get Device ID From SN ${olt_serial_number}
415 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530416 ${src}= Set Variable ${hosts.src[${I}]}
417 ${dst}= Set Variable ${hosts.dst[${I}]}
418 ${onu_device_id}= Get Device ID From SN ${src['onu']}
419 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
420 ... Validate Device ENABLED ACTIVE
421 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-flows-pushed
422 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
423 ... Validate OLT Device ENABLED ACTIVE
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800424 ... REACHABLE ${src['olt']}
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530425 Disable Device ${onu_device_id}
426 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
427 ... Validate Device DISABLED UNKNOWN
428 ... REACHABLE ${src['onu']} onu=false
429 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
430 ... Validate OLT Device ENABLED ACTIVE
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800431 ... REACHABLE ${src['olt']}
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530432 END
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800433 #Disable Device ${olt_device_id}
434 # Disable all OLTs
435 FOR ${I} IN RANGE 0 ${olt_count}
436 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
437 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
438 ${rc} ${output}= Run and Return Rc and Output
439 ... ${VOLTCTL_CONFIG}; voltctl device disable ${olt_device_id}
440 Should Be Equal As Integers ${rc} 0
441 Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Device DISABLED UNKNOWN REACHABLE
442 ... ${olt_serial_number}
443 END
444 # Validate ONUs after OLT disable
445 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530446 ${src}= Set Variable ${hosts.src[${I}]}
447 ${dst}= Set Variable ${hosts.dst[${I}]}
448 ${onu_device_id}= Get Device ID From SN ${src['onu']}
449 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
450 ... Validate Device DISABLED DISCOVERED
451 ... UNREACHABLE ${src['onu']} onu=false
452 Delete Device ${onu_device_id}
453 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
454 ... Validate OLT Device DISABLED UNKNOWN
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800455 ... REACHABLE ${src['olt']}
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530456 END
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800457 # Delete all OLTs
458 Delete All Devices and Verify
459
460 #Delete Device ${olt_device_id}
461 #TODO: Fix the following assertion
462 #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Test Empty Device List
463 #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
464 #... Verify Device Flows Removed ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
465
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530466 # Re-do Setup (Recreate the OLT) and Perform Sanity Test DT
467 Run Keyword Setup
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800468 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530469 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
Hardik Windlass3b531fa2020-04-23 18:51:44 +0530470
Andy Baviere19991a2020-05-08 10:42:40 -0700471Data plane verification using TCP for DT
472 [Documentation] Test bandwidth profile is met and not exceeded for each subscriber.
473 ... Assumes iperf3 and jq installed on client and iperf -s running on DHCP server
Andy Bavier7613b9a2020-07-08 07:25:47 -0700474 [Tags] dataplaneDt BandwidthProfileTCPDt VOL-3061
Andy Bavierdfbcaef2020-05-27 15:34:18 -0700475 [Setup] Start Logging BandwidthProfileTCPDt
476 [Teardown] Run Keywords Collect Logs
477 ... AND Stop Logging BandwidthProfileTCPDt
Andy Baviere19991a2020-05-08 10:42:40 -0700478 Pass Execution If '${has_dataplane}'=='False' Bandwidth profile validation can be done only in
479 ... physical pod. Skipping this test in BBSIM.
Suchitra Vemuria4e3e072020-11-06 14:23:47 -0800480 Delete All Devices And Verify
481 Run Keyword If ${has_dataplane} Clean Up Linux
482 setup
483 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
484
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800485 #${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
486 #... ${olt_serial_number}
487 FOR ${I} IN RANGE 0 ${num_all_onus}
Andy Baviere19991a2020-05-08 10:42:40 -0700488 ${src}= Set Variable ${hosts.src[${I}]}
489 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800490 ${of_id}= Get ofID From OLT List ${src['olt']}
Andy Bavierf6ab19c2020-05-14 10:34:47 -0700491 # Check for iperf3 and jq tools
492 ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf3 jq
493 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
494 Pass Execution If ${rc} != 0 Skipping test: iperf3 / jq not found on the RG
495
Andy Baviere19991a2020-05-08 10:42:40 -0700496 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
497 ... ${of_id}
498 ${subscriber_id}= Set Variable ${of_id}/${onu_port}
499 ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id}
500 ... upstreamBandwidthProfile
501 ${limiting_bw_value_upstream} Get Bandwidth Details ${bandwidth_profile_name}
502 ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id}
503 ... downstreamBandwidthProfile
504 ${limiting_bw_value_dnstream} Get Bandwidth Details ${bandwidth_profile_name}
505
506 # Stream TCP packets from RG to server
507 ${updict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']}
508 ... args=-t 30
509 ${actual_upstream_bw_used}= Evaluate ${updict['end']['sum_received']['bits_per_second']}/1000
510
511 # Stream TCP packets from server to RG
512 ${dndict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']}
513 ... args=-R -t 30
514 ${actual_dnstream_bw_used}= Evaluate ${dndict['end']['sum_received']['bits_per_second']}/1000
515
516 ${pct_limit_up}= Evaluate 100*${actual_upstream_bw_used}/${limiting_bw_value_upstream}
517 ${pct_limit_dn}= Evaluate 100*${actual_dnstream_bw_used}/${limiting_bw_value_dnstream}
518 Log Up: bwprof ${limiting_bw_value_upstream}Kbps, got ${actual_upstream_bw_used}Kbps (${pct_limit_up}%)
519 Log Down: bwprof ${limiting_bw_value_dnstream}Kbps, got ${actual_dnstream_bw_used}Kbps (${pct_limit_dn}%)
520
521 Should Be True ${pct_limit_up} <= ${upper_margin_pct}
522 ... The upstream bandwidth exceeded the limit (${pct_limit_up}% of limit)
Andy Bavier7613b9a2020-07-08 07:25:47 -0700523 # VOL-3125: downstream bw limit not enforced. Uncomment when fixed.
524 #Should Be True ${pct_limit_dn} <= ${upper_margin_pct}
525 #... The downstream bandwidth exceeded the limit (${pct_limit_dn}% of limit)
Andy Baviere19991a2020-05-08 10:42:40 -0700526 Should Be True ${pct_limit_up} >= ${lower_margin_pct}
527 ... The upstream bandwidth guarantee was not met (${pct_limit_up}% of resv)
528 Should Be True ${pct_limit_dn} >= ${lower_margin_pct}
529 ... The downstream bandwidth guarantee was not met (${pct_limit_dn}% of resv)
530 END
531
532Data plane verification using UDP for DT
533 [Documentation] Test bandwidth profile is met and not exceeded for each subscriber.
534 ... Assumes iperf3 and jq installed on client and iperf -s running on DHCP server
Andy Bavier7613b9a2020-07-08 07:25:47 -0700535 [Tags] dataplaneDt BandwidthProfileUDPDt VOL-3061
Andy Bavierdfbcaef2020-05-27 15:34:18 -0700536 [Setup] Start Logging BandwidthProfileUDPDt
537 [Teardown] Run Keywords Collect Logs
538 ... AND Stop Logging BandwidthProfileUDPDt
Andy Baviere19991a2020-05-08 10:42:40 -0700539 Pass Execution If '${has_dataplane}'=='False' Bandwidth profile validation can be done only in
540 ... physical pod. Skipping this test in BBSIM.
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800541 #${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
542 #... ${olt_serial_number}
543 FOR ${I} IN RANGE 0 ${num_all_onus}
Andy Baviere19991a2020-05-08 10:42:40 -0700544 ${src}= Set Variable ${hosts.src[${I}]}
545 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800546 ${of_id}= Get ofID From OLT List ${src['olt']}
Andy Bavier7613b9a2020-07-08 07:25:47 -0700547
548 # Check for iperf3 and jq tools
549 ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf3 jq
550 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
551 Pass Execution If ${rc} != 0 Skipping test: iperf3 / jq not found on the RG
552
Andy Baviere19991a2020-05-08 10:42:40 -0700553 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
554 ... ${of_id}
555 ${subscriber_id}= Set Variable ${of_id}/${onu_port}
556 ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id}
557 ... upstreamBandwidthProfile
558 ${limiting_bw_value_upstream} Get Bandwidth Details ${bandwidth_profile_name}
559 ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id}
560 ... downstreamBandwidthProfile
561 ${limiting_bw_value_dnstream} Get Bandwidth Details ${bandwidth_profile_name}
562
563 # Stream UDP packets from RG to server
Andrea Campanella1d34bfc2020-08-06 09:58:49 +0200564 ${uprate}= Run Keyword If ${limiting_bw_value_upstream} != 1000000
565 ... Evaluate ${limiting_bw_value_upstream}*${udp_rate_multiplier}
Andrea Campanella580e0492020-08-05 15:35:48 +0200566 ... ELSE
Andrea Campanella1d34bfc2020-08-06 09:58:49 +0200567 ... Set Variable ${limiting_bw_value_upstream}
Andrea Campanella580e0492020-08-05 15:35:48 +0200568
Andy Baviere19991a2020-05-08 10:42:40 -0700569 ${updict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']}
Andy Bavier7dc50622020-05-28 14:34:12 -0700570 ... args=-u -b ${uprate}K -t 30 -l ${udp_packet_bytes} --pacing-timer 0
Andy Baviere19991a2020-05-08 10:42:40 -0700571 # With UDP test, bits per second is the sending rate. Multiply by the loss rate to get the throughput.
572 ${actual_upstream_bw_used}= Evaluate
573 ... (100 - ${updict['end']['sum']['lost_percent']})*${updict['end']['sum']['bits_per_second']}/100000
574
575 # Stream UDP packets from server to RG
Andrea Campanella1d34bfc2020-08-06 09:58:49 +0200576 ${dnrate}= Run Keyword If ${limiting_bw_value_dnstream} != 1000000
577 ... Evaluate ${limiting_bw_value_dnstream}*${udp_rate_multiplier}
Andrea Campanella580e0492020-08-05 15:35:48 +0200578 ... ELSE
Andrea Campanella1d34bfc2020-08-06 09:58:49 +0200579 ... Set Variable ${limiting_bw_value_dnstream}
Andy Baviere19991a2020-05-08 10:42:40 -0700580 ${dndict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']}
Andy Bavier7dc50622020-05-28 14:34:12 -0700581 ... args=-u -b ${dnrate}K -R -t 30 -l ${udp_packet_bytes} --pacing-timer 0
Andy Baviere19991a2020-05-08 10:42:40 -0700582 # With UDP test, bits per second is the sending rate. Multiply by the loss rate to get the throughput.
583 ${actual_dnstream_bw_used}= Evaluate
584 ... (100 - ${dndict['end']['sum']['lost_percent']})*${dndict['end']['sum']['bits_per_second']}/100000
585
586 ${pct_limit_up}= Evaluate 100*${actual_upstream_bw_used}/${limiting_bw_value_upstream}
587 ${pct_limit_dn}= Evaluate 100*${actual_dnstream_bw_used}/${limiting_bw_value_dnstream}
588 Log Up: bwprof ${limiting_bw_value_upstream}Kbps, got ${actual_upstream_bw_used}Kbps (${pct_limit_up}%)
589 Log Down: bwprof ${limiting_bw_value_dnstream}Kbps, got ${actual_dnstream_bw_used}Kbps (${pct_limit_dn}%)
590
591 Should Be True ${pct_limit_up} <= ${upper_margin_pct}
592 ... The upstream bandwidth exceeded the limit (${pct_limit_up}% of limit)
Andy Bavier7613b9a2020-07-08 07:25:47 -0700593 # VOL-3125: downstream bw limit not enforced. Uncomment when fixed.
594 #Should Be True ${pct_limit_dn} <= ${upper_margin_pct}
595 #... The downstream bandwidth exceeded the limit (${pct_limit_dn}% of limit)
Andy Baviere19991a2020-05-08 10:42:40 -0700596 Should Be True ${pct_limit_up} >= ${lower_margin_pct}
597 ... The upstream bandwidth guarantee was not met (${pct_limit_up}% of resv)
598 Should Be True ${pct_limit_dn} >= ${lower_margin_pct}
599 ... The downstream bandwidth guarantee was not met (${pct_limit_dn}% of resv)
600 END
601
Andy Bavier7613b9a2020-07-08 07:25:47 -0700602Validate parsing of data traffic through voltha using tech profile
603 [Documentation] Assuming that test1 was executed where all the ONUs are authenticated/DHCP/pingable
604 ... Prerequisite tools : Tcpdump and Mausezahn traffic generator on both RG and DHCP/BNG VMs
605 ... Install jq tool to read json file, where test suite is being running
606 ... Make sure 9999 port is enabled or forwarded for both upsteam and downstream direction
607 ... This test sends UDP packets on port 9999 with pbits between 0 and 7 and validates that
608 ... the pbits are preserved by the PON.
609 [Tags] dataplaneDt TechProfileDt VOL-3291
610 [Setup] Start Logging TechProfileDt
611 [Teardown] Run Keywords Collect Logs
612 ... AND Stop Logging TechProfileDt
613 Pass Execution If '${has_dataplane}'=='False'
614 ... Skipping test: Technology profile validation can be done only in physical pod
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800615 FOR ${I} IN RANGE 0 ${num_all_onus}
Andy Bavier7613b9a2020-07-08 07:25:47 -0700616 ${src}= Set Variable ${hosts.src[${I}]}
617 ${dst}= Set Variable ${hosts.dst[${I}]}
618
Andy Bavier275414a2020-07-16 13:07:17 -0700619 ${src_iface_name}= Fetch From Left ${src['dp_iface_name']} .
620
Andy Bavier7613b9a2020-07-08 07:25:47 -0700621 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
622 ${bng_user}= Get Variable Value ${dst['noroot_user']}
623 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
624 Pass Execution If "${bng_ip}" == "${NONE}" or "${bng_user}" == "${NONE}" or "${bng_pass}" == "${NONE}"
625 ... Skipping test: credentials for BNG login required in deployment config
626
627 ${stdout} ${stderr} ${rc}= Execute Remote Command which mausezahn tcpdump
628 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
629 Pass Execution If ${rc} != 0 Skipping test: mausezahn / tcpdump not found on the RG
630 ${stdout} ${stderr} ${rc}= Execute Remote Command which mausezahn tcpdump
631 ... ${bng_ip} ${bng_user} ${bng_pass} ${dst['container_type']} ${dst['container_name']}
632 Pass Execution If ${rc} != 0 Skipping test: mausezahn / tcpdump not found on the BNG
633 Log Upstream test
634 Run Keyword If ${has_dataplane} Create traffic with each pbit and capture at other end
Andy Bavier275414a2020-07-16 13:07:17 -0700635 ... ${dst['dp_iface_ip_qinq']} ${dst['dp_iface_name']} ${src_iface_name}
636 ... 0 udp 9999 ${src['c_tag']} vlan
Andy Bavier7613b9a2020-07-08 07:25:47 -0700637 ... ${bng_ip} ${bng_user} ${bng_pass} ${dst['container_type']} ${dst['container_name']}
638 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
639 Log Downstream test
640 ${rg_ip} ${stderr} ${rc}= Execute Remote Command
641 ... ifconfig ${src['dp_iface_name']} | grep 'inet addr:' | cut -d: -f2 | awk '{ print $1 }'
642 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
643 Should Be Equal As Integers ${rc} 0 Could not get RG's IP address
644 Run Keyword If ${has_dataplane} Create traffic with each pbit and capture at other end
Andy Bavier275414a2020-07-16 13:07:17 -0700645 ... ${rg_ip} ${src_iface_name} ${dst['dp_iface_name']}.${src['s_tag']}
Andy Bavier7613b9a2020-07-08 07:25:47 -0700646 ... 0 udp 9999 ${src['c_tag']} udp
647 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
648 ... ${bng_ip} ${bng_user} ${bng_pass} ${dst['container_type']} ${dst['container_name']}
649 END
650
Hardik Windlass16cdf962020-04-29 15:26:50 +0530651Test Disable and Enable OLT PON Port for DT
652 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
653 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
654 ... Perform disable on the OLT PON Port and validate that the pings do not succeed
655 ... Perform enable on the OLT PON Port and validate that the pings are successful
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800656 [Tags] functionalDt DisableEnableOltPonPortDt VOL-2577 notready
Hardik Windlass16cdf962020-04-29 15:26:50 +0530657 [Setup] Start Logging DisableEnableOltPonPortDt
658 [Teardown] Run Keywords Collect Logs
659 ... AND Stop Logging DisableEnableOltPonPortDt
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800660 TODO: Fix the keywords and test later
Hardik Windlass16cdf962020-04-29 15:26:50 +0530661 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
662 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
663 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
664 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
665 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
666 # Disable the OLT PON Port and Validate OLT Device
667 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
668 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
669 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
670 ... DISABLED DISCOVERED
671 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
672 ... Validate OLT Device ENABLED ACTIVE REACHABLE
673 ... ${olt_serial_number}
674 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
675 ... Validate ONUs for PON OLT Disable DT ${olt_peer_list}
676 Sleep 15s
677 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
678 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
679 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
680 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
681 ... ENABLED ACTIVE
682 # Waiting extra time for the ONUs to come up
683 Sleep 60s
684 ${olt_peer_list_new}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
685 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
686 ... Validate ONUs for PON OLT Enable DT ${olt_peer_list_new}
687 END
688
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000689*** Keywords ***
690Setup Suite
691 [Documentation] Set up the test suite
692 Common Test Suite Setup
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -0700693 #Restore all ONUs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800694 #Run Keyword If ${has_dataplane} RestoreONUs ${num_all_onus}
Suchitra Vemuri1d8e8172020-06-17 17:43:56 -0700695 #power_switch.robot needs it to support different vendor's power switch
696 ${switch_type}= Get Variable Value ${web_power_switch.type}
697 Run Keyword If "${switch_type}"!="" Set Global Variable ${powerswitch_type} ${switch_type}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000698
699Clear All Devices Then Create New Device
700 [Documentation] Remove any devices from VOLTHA and ONOS
701 # Remove all devices from voltha and nos
702 Delete All Devices and Verify
703 # Execute normal test Setup Keyword
704 Setup
705