blob: 8084f95616f27f01da71deecd2e6f5f9c336e539 [file] [log] [blame]
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -07001# Copyright 2017 - present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
14# FIXME Can we use the same test against BBSim and Hardware?
15
16*** Settings ***
17Documentation Test various functional end-to-end scenarios for TT workflow
18Suite Setup Setup Suite
19Test Setup Setup
20Test Teardown Teardown
21Suite Teardown Teardown Suite
22Library Collections
23Library String
24Library OperatingSystem
25Library XML
26Library RequestsLibrary
27Library ../../libraries/DependencyLibrary.py
28Resource ../../libraries/onos.robot
29Resource ../../libraries/voltctl.robot
30Resource ../../libraries/voltha.robot
31Resource ../../libraries/utils.robot
32Resource ../../libraries/k8s.robot
33Resource ../../variables/variables.robot
34Resource ../../libraries/power_switch.robot
35
36*** Variables ***
37${POD_NAME} flex-ocp-cord
38${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
39${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs
40#${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
41${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml
42${HELM_CHARTS_DIR} ~/helm-charts
43${VOLTHA_POD_NUM} 8
44${NAMESPACE} voltha
Hardik Windlass4288c6a2021-09-28 07:22:06 +000045${INFRA_NAMESPACE} default
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070046# For below variable value, using deployment name as using grep for
47# parsing radius pod name, we can also use full radius pod name
48${RESTART_POD_NAME} radius
49${timeout} 60s
50${of_id} 0
51${logical_id} 0
52${has_dataplane} True
Hardik Windlass04896f62021-03-05 16:15:11 +053053${teardown_device} True
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070054${scripts} ../../scripts
55
56# Per-test logging on failure is turned off by default; set this variable to enable
57${container_log_dir} ${None}
58
Matteo Scandoloda1c64b2021-07-20 10:14:49 -070059# logging flag to enable Collect Logs, can be passed via the command line too
60# example: -v logging:False
61${logging} True
62
Emrehan UZUN62748282021-05-21 08:16:52 +000063${suppressaddsubscriber} True
64
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070065*** Test Cases ***
66Reboot TT ONUs Physically - Clean Up
67 [Documentation] This test reboots ONUs physically before execution all the tests
68 ... Test case runs only on the PODs that are configured with PowerSwitch that
69 ... controls the power off/on ONUs/OLT remotely (simulating a physical reboot)
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +000070 [Tags] functionalTT PowerSwitch RebootAllTTONUs
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070071 [Setup] Start Logging RebootAllTTONUs
72 [Teardown] Run Keywords Collect Logs
73 ... AND Stop Logging RebootAllTTONUs
74 Power Switch Connection Suite ${web_power_switch.ip} ${web_power_switch.user} ${web_power_switch.password}
Suchitra Vemuri7255c002020-11-09 11:44:36 -080075 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070076 ${src}= Set Variable ${hosts.src[${I}]}
77 ${dst}= Set Variable ${hosts.dst[${I}]}
78 Disable Switch Outlet ${src['power_switch_port']}
TorstenThieme2ed10502021-03-22 18:01:50 +000079 Sleep 10s
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070080 Enable Switch Outlet ${src['power_switch_port']}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070081 END
82
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -070083Sanity E2E Test for TT (HSIA, VoD, VoIP)
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070084 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
85 ... Validate successful DHCP/E2E ping (no EAPOL and DHCP flows) for the tech profile that is used
86 ... Traffic sent with same vlan from different RGs,
87 ... should reach the NNI port on the OLT with the expected double tagged vlan ids
88 ... Inner vlans from the RG should not change
89 [Tags] sanityTT
90 [Setup] Run Keywords Start Logging SanityTestTT
91 ... AND Setup
92 [Teardown] Run Keywords Collect Logs
93 ... AND Stop Logging SanityTestTT
94 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlass5083b3a2021-11-11 12:16:22 +000095 Perform Sanity Test TT
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -070096
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -070097Sanity E2E Test for TT (MCAST)
98 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
99 ... Validate successful DHCP/E2E ping (no EAPOL and DHCP flows) for the tech profile that is used
100 ... Traffic sent with same vlan from different RGs,
101 ... should reach the NNI port on the OLT with the expected double tagged vlan ids
102 ... Inner vlans from the RG should not change
103 [Tags] sanityTT-MCAST
104 [Setup] Run Keyword Start Logging SanityTestTT-MCAST
105 [Teardown] Run Keywords Collect Logs
106 ... AND Stop Logging SanityTestTT-MCAST
107 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000108 Perform Sanity Test TT MCAST
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700109
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000110Test Disable and Delete OLT for TT
111 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
112 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityTt test was executed)
113 ... Perform disable on the OLT and validate ONUs state and that the pings do not succeed
114 ... Perform delete on the OLT, Re-do Setup (Recreate the OLT) and Perform Sanity Test TT
Huseyin Ahmet AYDIN45922c82021-05-27 12:37:32 +0000115 [Tags] functionalTT DisableDeleteOLTTt
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000116 [Setup] Start Logging DisableDeleteOLTTt
117 [Teardown] Run Keywords Collect Logs
118 ... AND Stop Logging DisableDeleteOLTTt
Huseyin Ahmet AYDIN45922c82021-05-27 12:37:32 +0000119 @{particular_onu_device_port}= Create List
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000120 FOR ${I} IN RANGE 0 ${num_all_onus}
121 ${src}= Set Variable ${hosts.src[${I}]}
122 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
123 ... ${of_id} ${src['uni_id']}
124 Append To List ${particular_onu_device_port} ${onu_port}
125 END
126 ${list_onu_port}= Remove Duplicates ${particular_onu_device_port}
127 ${num_of_provisioned_onus}= Get Length ${list_onu_port}
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000128 # Disable and Validate OLT Device
129 FOR ${I} IN RANGE 0 ${olt_count}
130 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
131 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
132 Disable Device ${olt_device_id}
133 ${of_id}= Get ofID From OLT List ${olt_serial_number}
134 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
135 ... Validate OLT Device DISABLED UNKNOWN REACHABLE
136 ... ${olt_serial_number}
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000137 ${num_onus}= Set Variable ${list_olts}[${I}][onucount]
138 # Validate ONUs
139 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONUs After OLT Disable
140 ... ${num_onus} ${olt_serial_number}
141 # Verify ONOS Flows
Matteo Scandolo8b6dc262021-11-22 12:30:27 -0800142 # When we disable the device we shouldn't have any flows provisioned on it
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000143 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo8b6dc262021-11-22 12:30:27 -0800144 ... Verify Added Flow Count for OLT TT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} 0
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000145 # Verify VOLTHA Flows
Matteo Scandolo8b6dc262021-11-22 12:30:27 -0800146 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows 0
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000147 ... ${olt_device_id}
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000148 # Delete OLT and Validate Empty Device List
149 Delete Device ${olt_device_id}
150 # Check that the OLT and the ONUs are actually removed from the system
151 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device Removed
152 ... ${olt_serial_number}
153 Run Keyword and Continue On Failure Validate all ONUS for OLT Removed ${num_all_onus} ${hosts}
154 ... ${olt_serial_number} ${timeout}
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000155 Wait Until Keyword Succeeds ${timeout} 5s
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000156 ... Verify Device Flows Removed ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
157 END
158 # Re-do Setup (Recreate the OLT) and Perform Sanity Test TT
159 Run Keyword Setup
160 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000161 Perform Sanity Tests TT
Huseyin Ahmet AYDIN9ea27aa2021-05-20 14:32:29 +0000162
Emrehan UZUN62748282021-05-21 08:16:52 +0000163Verify re-provisioning subscriber after removing provisoned subscriber for TT
164 [Documentation] Removing/Readding a particular subscriber should have no effect on any other subscriber.
165 [Tags] functionalTT Readd-subscriber-TT
166 [Setup] Start Logging Readd-subscriber-TT
167 [Teardown] Run Keywords Collect Logs
168 ... AND Stop Logging Readd-subscriber-TT
169 Run Keyword If ${has_dataplane} Clean Up Linux
170 FOR ${I} IN RANGE 0 ${num_all_onus}
171 ${src}= Set Variable ${hosts.src[${I}]}
172 ${dst}= Set Variable ${hosts.dst[${I}]}
173 ${service_type}= Get Variable Value ${src['service_type']} "null"
174 ${of_id}= Get ofID From OLT List ${src['olt']}
175 ${onu_device_id}= Get Device ID From SN ${src['onu']}
176 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000177 ... ${of_id} ${src['uni_id']}
Emrehan UZUN62748282021-05-21 08:16:52 +0000178 # Remove Subscriber Access
TorstenThieme4e2168e2021-06-22 14:01:47 +0000179 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP}
Emrehan UZUN62748282021-05-21 08:16:52 +0000180 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
181 Run Keyword If ${has_dataplane} and '${service_type}' != 'mcast'
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000182 ... Wait Until Keyword Succeeds ${timeout} 5s
Emrehan UZUN62748282021-05-21 08:16:52 +0000183 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
184 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Girish Gowdrab1ef7932021-10-29 10:57:47 -0700185 ... ELSE Sleep 10s Wait for flows to be deleted
Emrehan UZUN62748282021-05-21 08:16:52 +0000186 # Verify VOLTHA flows for ONU under test is Zero
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000187 # TODO: Fix ${onu_flows} calculations based on UNIs provisioned
188 # Wait Until Keyword Succeeds ${timeout} 5s Validate Device Flows
189 # ... ${onu_device_id} 0
Emrehan UZUN62748282021-05-21 08:16:52 +0000190 # Add Subscriber Access
TorstenThieme4e2168e2021-06-22 14:01:47 +0000191 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP}
Emrehan UZUN62748282021-05-21 08:16:52 +0000192 ... ${ONOS_SSH_PORT} volt-add-subscriber-access ${of_id} ${onu_port}
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000193 Wait Until Keyword Succeeds ${timeout} 5s
Emrehan UZUN62748282021-05-21 08:16:52 +0000194 ... Validate Device ENABLED ACTIVE
195 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-flows-pushed
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000196 Run Keyword If ${has_dataplane} and '${service_type}' != 'mcast'
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000197 ... Sanity Test TT one ONU ${src} ${dst} ${suppressaddsubscriber}
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000198 ... ELSE IF ${has_dataplane} and '${service_type}' == 'mcast'
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000199 ... Sanity Test TT MCAST one ONU ${src} ${dst} ${suppressaddsubscriber}
Emrehan UZUN62748282021-05-21 08:16:52 +0000200 END
201
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000202Test Disable and Enable ONU for TT
203 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
204 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanitytt test was executed)
205 ... Perform disable on the ONUs and validate that the pings do not succeed
206 ... Perform enable on the ONUs and validate that the pings are successful
207 [Tags] functionalTT DisableEnableONUTT
208 [Setup] Start Logging DisableEnableONUTT
209 [Teardown] Run Keywords Collect Logs
210 ... AND Stop Logging DisableEnableONUTT
211 FOR ${I} IN RANGE 0 ${num_all_onus}
212 ${src}= Set Variable ${hosts.src[${I}]}
213 ${dst}= Set Variable ${hosts.dst[${I}]}
214 ${service_type}= Get Variable Value ${src['service_type']} "null"
215 ${of_id}= Get ofID From OLT List ${src['olt']}
216 ${onu_device_id}= Get Device ID From SN ${src['onu']}
217 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000218 ... ${of_id} ${src['uni_id']}
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000219 Disable Device ${onu_device_id}
220 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
221 ... Validate Device DISABLED UNKNOWN
222 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-admin-lock
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000223 Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000224 ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000225 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000226 ... Wait Until Keyword Succeeds ${timeout} 2s
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000227 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
228 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
229 Sleep 5s
230 Enable Device ${onu_device_id}
231 Run Keyword If ${has_dataplane} and '${service_type}' == 'mcast' Clean Up Linux
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000232 Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000233 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000234 Run Keyword If ${has_dataplane} and '${service_type}' != 'mcast'
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000235 ... Sanity Test TT one ONU ${src} ${dst} ${suppressaddsubscriber}
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000236 ... ELSE IF ${has_dataplane} and '${service_type}' == 'mcast'
Hardik Windlass5083b3a2021-11-11 12:16:22 +0000237 ... Sanity Test TT MCAST one ONU ${src} ${dst} ${suppressaddsubscriber}
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000238 END
239
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700240*** Keywords ***
241Setup Suite
242 [Documentation] Set up the test suite
243 Common Test Suite Setup
244 ${switch_type}= Get Variable Value ${web_power_switch.type}
245 Run Keyword If "${switch_type}"!="" Set Global Variable ${powerswitch_type} ${switch_type}
246
247
248Clear All Devices Then Create New Device
249 [Documentation] Remove any devices from VOLTHA and ONOS
250 # Remove all devices from voltha and nos
251 Delete All Devices and Verify
252 # Execute normal test Setup Keyword
253 Setup
254
Suchitra Vemuri32dea012020-07-08 16:40:06 -0700255
256Teardown Suite
257 [Documentation] Tear down steps for the suite
258 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlass04896f62021-03-05 16:15:11 +0530259 Run Keyword If ${teardown_device} Delete All Devices And Verify
TorstenThieme4e2168e2021-06-22 14:01:47 +0000260 Close All ONOS SSH Connections