blob: 54d46319f1c48348b4ef2f6b897fcaad1ef5be21 [file] [log] [blame]
Hardik Windlassa3d04b92020-02-17 15:06:05 +00001# Copyright 2017 - present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
14# FIXME Can we use the same test against BBSim and Hardware?
15
16*** Settings ***
17Documentation Test various end-to-end scenarios
18Suite Setup Setup Suite
19Test Setup Setup
20Test Teardown Teardown
21Suite Teardown Teardown Suite
22Library Collections
23Library String
24Library OperatingSystem
25Library XML
26Library RequestsLibrary
27Library ../../libraries/DependencyLibrary.py
28Resource ../../libraries/onos.robot
29Resource ../../libraries/voltctl.robot
30Resource ../../libraries/voltha.robot
31Resource ../../libraries/utils.robot
32Resource ../../libraries/k8s.robot
33Resource ../../variables/variables.robot
34
35*** Variables ***
36${POD_NAME} flex-ocp-cord
37${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
38${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs
39#${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
40${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml
41${HELM_CHARTS_DIR} ~/helm-charts
42${VOLTHA_POD_NUM} 8
43${NAMESPACE} voltha
44# For below variable value, using deployment name as using grep for
45# parsing radius pod name, we can also use full radius pod name
46${RESTART_POD_NAME} radius
47${timeout} 60s
48${of_id} 0
49${logical_id} 0
50${has_dataplane} True
Hardik Windlassa3d04b92020-02-17 15:06:05 +000051${teardown_device} False
52${scripts} ../../scripts
53
54# Per-test logging on failure is turned off by default; set this variable to enable
55${container_log_dir} ${None}
56
57*** Test Cases ***
58Sanity E2E Test for OLT/ONU on POD for DT
59 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
60 ... Validate successful DHCP/E2E ping (no EAPOL and DHCP flows) for the tech profile that is used
61 ... Traffic sent with same vlan from different RGs,
62 ... should reach the NNI port on the OLT with the expected double tagged vlan ids
63 ... Inner vlans from the RG should not change
Suchitra Vemurif2388ad2020-03-15 21:44:44 -070064 [Tags] sanityDt
Hardik Windlassa3d04b92020-02-17 15:06:05 +000065 [Setup] Run Keywords Announce Message START TEST SanityTestDt
66 ... AND Start Logging SanityTestDt
67 ... AND Setup
68 [Teardown] Run Keywords Collect Logs
69 ... AND Stop Logging SanityTestDt
70 ... AND Announce Message END TEST SanityTestDt
71 Run Keyword If ${has_dataplane} Clean Up Linux
72 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
73
Hardik Windlass35706ba2020-02-20 08:16:42 +000074Test Subscriber Delete and Add for DT
75 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
Hardik Windlass63d5e002020-03-06 21:07:09 +053076 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
Hardik Windlass35706ba2020-02-20 08:16:42 +000077 ... Delete a subscriber and validate that the pings do not succeed and state is purged
78 ... Disable and Enable the ONU (This is to replicate the existing DT behaviour)
79 ... Re-add the subscriber, and validate that the flows are present and pings are successful
Suchitra Vemurif2388ad2020-03-15 21:44:44 -070080 [Tags] functionalDt SubAddDeleteDt
Hardik Windlass35706ba2020-02-20 08:16:42 +000081 [Setup] Run Keywords Announce Message START TEST SubAddDeleteDt
82 ... AND Start Logging SubAddDeleteDt
83 [Teardown] Run Keywords Collect Logs
84 ... AND Stop Logging SubAddDeleteDt
85 ... AND Announce Message END TEST SubAddDeleteDt
86 FOR ${I} IN RANGE 0 ${num_onus}
87 ${src}= Set Variable ${hosts.src[${I}]}
88 ${dst}= Set Variable ${hosts.dst[${I}]}
89 ${onu_device_id}= Get Device ID From SN ${src['onu']}
90 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
91 ... ${of_id}
92 # Remove Subscriber Access
ubuntu6b6e7d42020-03-02 12:35:42 -080093 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
Hardik Windlass35706ba2020-02-20 08:16:42 +000094 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
95 Sleep 10s
Hardik Windlass59a759f2020-03-26 14:49:01 +053096 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlass35706ba2020-02-20 08:16:42 +000097 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
98 ... Wait Until Keyword Succeeds 60s 2s
99 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
100 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Hardik Windlass59a759f2020-03-26 14:49:01 +0530101 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
102 ${onos_flows_count}= Evaluate 4 * ( ${num_onus} - 1 )
103 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
104 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
105 ... ${onos_flows_count}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000106 # Verify VOLTHA flows for OLT equals twice the number of ONUS (minus ONU under test) + 1 for LLDP
107 ${olt_flows}= Evaluate 2 * ( ${num_onus} - 1 ) + 1
108 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
109 # Verify VOLTHA flows for ONU under test is Zero
110 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate Device Flows
111 ... ${onu_device_id} 0
112 # Disable and Re-Enable the ONU (To replicate DT current workflow)
113 # TODO: Delete and Auto-Discovery Add of ONU (not yet supported)
114 Disable Device ${onu_device_id}
115 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
116 ... Validate Device DISABLED UNKNOWN
117 ... REACHABLE ${src['onu']}
118 Enable Device ${onu_device_id}
119 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
120 ... Validate Device ENABLED ACTIVE
121 ... REACHABLE ${src['onu']}
122 # Add Subscriber Access
ubuntu6b6e7d42020-03-02 12:35:42 -0800123 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000124 ... ${ONOS_SSH_PORT} volt-add-subscriber-access ${of_id} ${onu_port}
125 Sleep 10s
Hardik Windlass59a759f2020-03-26 14:49:01 +0530126 # Verify subscriber access flows are added for the ONU port
127 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
128 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
129 ... ${nni_port} ${src['s_tag']}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000130 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
131 ... Validate Device ENABLED ACTIVE
132 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-flows-pushed
Hardik Windlass59a759f2020-03-26 14:49:01 +0530133 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlass35706ba2020-02-20 08:16:42 +0000134 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
135 ... Wait Until Keyword Succeeds 60s 2s
136 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
137 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
138 Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
139 Run Keyword and Ignore Error Collect Logs
140 END
Hardik Windlass59a759f2020-03-26 14:49:01 +0530141 # Verify ONOS Flows
142 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
143 ${onos_flows_count}= Evaluate 4 * ${num_onus}
144 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
145 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onos_flows_count}
146 # Verify VOLTHA Flows
Hardik Windlass35706ba2020-02-20 08:16:42 +0000147 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
148 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
149 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
150 ${onu_flows}= Set Variable 2
151 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
152 ${List_ONU_Serial} Create List
153 Set Suite Variable ${List_ONU_Serial}
154 Build ONU SN List ${List_ONU_Serial}
155 Log ${List_ONU_Serial}
156 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
157 ... ${List_ONU_Serial} ${onu_flows}
158
Hardik Windlass63d5e002020-03-06 21:07:09 +0530159Test Disable and Enable ONU for DT
160 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
161 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
162 ... Perform disable on the ONUs and validate that the pings do not succeed
163 ... Perform enable on the ONUs and validate that the pings are successful
Suchitra Vemurif2388ad2020-03-15 21:44:44 -0700164 [Tags] functionalDt DisableEnableONUDt
Hardik Windlass63d5e002020-03-06 21:07:09 +0530165 [Setup] Run Keywords Announce Message START TEST DisableEnableONUDt
166 ... AND Start Logging DisableEnableONUDt
167 [Teardown] Run Keywords Collect Logs
168 ... AND Stop Logging DisableEnableONUDt
169 ... AND Announce Message END TEST DisableEnableONUDt
170 FOR ${I} IN RANGE 0 ${num_onus}
171 ${src}= Set Variable ${hosts.src[${I}]}
172 ${dst}= Set Variable ${hosts.dst[${I}]}
173 ${onu_device_id}= Get Device ID From SN ${src['onu']}
174 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
175 ... ${of_id}
176 Disable Device ${onu_device_id}
177 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
178 ... Validate Device DISABLED UNKNOWN
179 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-admin-lock
180 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
181 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Hardik Windlass59a759f2020-03-26 14:49:01 +0530182 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlass63d5e002020-03-06 21:07:09 +0530183 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
184 ... Wait Until Keyword Succeeds 60s 2s
185 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
186 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
187 Sleep 5s
188 Enable Device ${onu_device_id}
189 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
190 ... Validate Device ENABLED ACTIVE
191 ... REACHABLE ${src['onu']} onu=True onu_reason=onu-reenabled
192 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
193 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Hardik Windlass59a759f2020-03-26 14:49:01 +0530194 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlass63d5e002020-03-06 21:07:09 +0530195 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
196 ... Wait Until Keyword Succeeds 60s 2s
197 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
198 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
199 Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
200 Run Keyword and Ignore Error Collect Logs
201 END
202
Hardik Windlassaaea3402020-03-10 19:45:45 +0530203Test Disable and Delete OLT for DT
204 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
205 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
206 ... Perform disable on the OLT and validate ONUs state and that the pings do not succeed
207 ... Perform delete on the OLT, Re-do Setup (Recreate the OLT) and Perform Sanity Test DT
Suchitra Vemurif2388ad2020-03-15 21:44:44 -0700208 [Tags] functionalDt DisableDeleteOLTDt
Hardik Windlassaaea3402020-03-10 19:45:45 +0530209 [Setup] Run Keywords Announce Message START TEST DisableDeleteOLTDt
210 ... AND Start Logging DisableDeleteOLTDt
211 [Teardown] Run Keywords Collect Logs
212 ... AND Stop Logging DisableDeleteOLTDt
213 ... AND Announce Message END TEST DisableDeleteOLTDt
214 # Disable and Validate OLT Device
215 Disable Device ${olt_device_id}
216 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
217 ... Validate OLT Device DISABLED UNKNOWN REACHABLE
218 ... ${olt_serial_number}
219 # Validate ONUs
220 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONUs After OLT Disable
Hardik Windlass59a759f2020-03-26 14:49:01 +0530221 # Verify ONOS Flows
222 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
223 ${onos_flows_count}= Evaluate 4 * ${num_onus}
224 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
225 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onos_flows_count}
226 # Verify VOLTHA Flows
Hardik Windlassaaea3402020-03-10 19:45:45 +0530227 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
228 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
229 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
230 ${onu_flows}= Set Variable 2
231 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
232 ${List_ONU_Serial} Create List
233 Set Suite Variable ${List_ONU_Serial}
234 Build ONU SN List ${List_ONU_Serial}
235 Log ${List_ONU_Serial}
236 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
237 ... ${List_ONU_Serial} ${onu_flows}
238 # Delete OLT and Validate Empty Device List
239 Delete Device ${olt_device_id}
240 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Test Empty Device List
241 Run Keyword and Ignore Error Collect Logs
242 # Re-do Setup (Recreate the OLT) and Perform Sanity Test DT
243 Run Keyword Setup
244 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
Suchitra Vemuriae9cecb2020-03-12 12:59:14 -0700245 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlassaaea3402020-03-10 19:45:45 +0530246
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000247*** Keywords ***
248Setup Suite
249 [Documentation] Set up the test suite
250 Common Test Suite Setup
251
252Clear All Devices Then Create New Device
253 [Documentation] Remove any devices from VOLTHA and ONOS
254 # Remove all devices from voltha and nos
255 Delete All Devices and Verify
256 # Execute normal test Setup Keyword
257 Setup
258