blob: 2fd1549d5f0515d6b9be7cc37c3db823b3eb9e24 [file] [log] [blame]
Hardik Windlassa3d04b92020-02-17 15:06:05 +00001# Copyright 2017 - present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
14# FIXME Can we use the same test against BBSim and Hardware?
15
16*** Settings ***
17Documentation Test various end-to-end scenarios
18Suite Setup Setup Suite
19Test Setup Setup
20Test Teardown Teardown
21Suite Teardown Teardown Suite
22Library Collections
23Library String
24Library OperatingSystem
25Library XML
26Library RequestsLibrary
27Library ../../libraries/DependencyLibrary.py
28Resource ../../libraries/onos.robot
29Resource ../../libraries/voltctl.robot
30Resource ../../libraries/voltha.robot
31Resource ../../libraries/utils.robot
32Resource ../../libraries/k8s.robot
33Resource ../../variables/variables.robot
34
35*** Variables ***
36${POD_NAME} flex-ocp-cord
37${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
38${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs
39#${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
40${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml
41${HELM_CHARTS_DIR} ~/helm-charts
42${VOLTHA_POD_NUM} 8
43${NAMESPACE} voltha
44# For below variable value, using deployment name as using grep for
45# parsing radius pod name, we can also use full radius pod name
46${RESTART_POD_NAME} radius
47${timeout} 60s
48${of_id} 0
49${logical_id} 0
50${has_dataplane} True
Hardik Windlassa3d04b92020-02-17 15:06:05 +000051${teardown_device} False
52${scripts} ../../scripts
53
54# Per-test logging on failure is turned off by default; set this variable to enable
55${container_log_dir} ${None}
56
57*** Test Cases ***
58Sanity E2E Test for OLT/ONU on POD for DT
59 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
60 ... Validate successful DHCP/E2E ping (no EAPOL and DHCP flows) for the tech profile that is used
61 ... Traffic sent with same vlan from different RGs,
62 ... should reach the NNI port on the OLT with the expected double tagged vlan ids
63 ... Inner vlans from the RG should not change
Suchitra Vemurif2388ad2020-03-15 21:44:44 -070064 [Tags] sanityDt
Hardik Windlassa3d04b92020-02-17 15:06:05 +000065 [Setup] Run Keywords Announce Message START TEST SanityTestDt
66 ... AND Start Logging SanityTestDt
67 ... AND Setup
68 [Teardown] Run Keywords Collect Logs
69 ... AND Stop Logging SanityTestDt
70 ... AND Announce Message END TEST SanityTestDt
71 Run Keyword If ${has_dataplane} Clean Up Linux
72 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
73
Hardik Windlass35706ba2020-02-20 08:16:42 +000074Test Subscriber Delete and Add for DT
75 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
Hardik Windlass63d5e002020-03-06 21:07:09 +053076 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
Hardik Windlass35706ba2020-02-20 08:16:42 +000077 ... Delete a subscriber and validate that the pings do not succeed and state is purged
78 ... Disable and Enable the ONU (This is to replicate the existing DT behaviour)
79 ... Re-add the subscriber, and validate that the flows are present and pings are successful
Suchitra Vemurif2388ad2020-03-15 21:44:44 -070080 [Tags] functionalDt SubAddDeleteDt
Hardik Windlass35706ba2020-02-20 08:16:42 +000081 [Setup] Run Keywords Announce Message START TEST SubAddDeleteDt
82 ... AND Start Logging SubAddDeleteDt
83 [Teardown] Run Keywords Collect Logs
84 ... AND Stop Logging SubAddDeleteDt
85 ... AND Announce Message END TEST SubAddDeleteDt
86 FOR ${I} IN RANGE 0 ${num_onus}
87 ${src}= Set Variable ${hosts.src[${I}]}
88 ${dst}= Set Variable ${hosts.dst[${I}]}
89 ${onu_device_id}= Get Device ID From SN ${src['onu']}
90 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
91 ... ${of_id}
92 # Remove Subscriber Access
ubuntu6b6e7d42020-03-02 12:35:42 -080093 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
Hardik Windlass35706ba2020-02-20 08:16:42 +000094 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
95 Sleep 10s
96 # TODO: Yet to Verify on the Physical POD
97 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
98 ... Wait Until Keyword Succeeds 60s 2s
99 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
100 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
101 # Verify VOLTHA flows for OLT equals twice the number of ONUS (minus ONU under test) + 1 for LLDP
102 ${olt_flows}= Evaluate 2 * ( ${num_onus} - 1 ) + 1
103 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
104 # Verify VOLTHA flows for ONU under test is Zero
105 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate Device Flows
106 ... ${onu_device_id} 0
107 # Disable and Re-Enable the ONU (To replicate DT current workflow)
108 # TODO: Delete and Auto-Discovery Add of ONU (not yet supported)
109 Disable Device ${onu_device_id}
110 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
111 ... Validate Device DISABLED UNKNOWN
112 ... REACHABLE ${src['onu']}
113 Enable Device ${onu_device_id}
114 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
115 ... Validate Device ENABLED ACTIVE
116 ... REACHABLE ${src['onu']}
117 # Add Subscriber Access
ubuntu6b6e7d42020-03-02 12:35:42 -0800118 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
Hardik Windlass35706ba2020-02-20 08:16:42 +0000119 ... ${ONOS_SSH_PORT} volt-add-subscriber-access ${of_id} ${onu_port}
120 Sleep 10s
121 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
122 ... Validate Device ENABLED ACTIVE
123 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-flows-pushed
124 # TODO: Yet to Verify on the Physical POD
125 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
126 ... Wait Until Keyword Succeeds 60s 2s
127 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
128 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
129 Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
130 Run Keyword and Ignore Error Collect Logs
131 END
132 # Verify VOLTHA Flows (TODO: Add verification for ONOS Flows)
133 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
134 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
135 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
136 ${onu_flows}= Set Variable 2
137 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
138 ${List_ONU_Serial} Create List
139 Set Suite Variable ${List_ONU_Serial}
140 Build ONU SN List ${List_ONU_Serial}
141 Log ${List_ONU_Serial}
142 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
143 ... ${List_ONU_Serial} ${onu_flows}
144
Hardik Windlass63d5e002020-03-06 21:07:09 +0530145Test Disable and Enable ONU for DT
146 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
147 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
148 ... Perform disable on the ONUs and validate that the pings do not succeed
149 ... Perform enable on the ONUs and validate that the pings are successful
Suchitra Vemurif2388ad2020-03-15 21:44:44 -0700150 [Tags] functionalDt DisableEnableONUDt
Hardik Windlass63d5e002020-03-06 21:07:09 +0530151 [Setup] Run Keywords Announce Message START TEST DisableEnableONUDt
152 ... AND Start Logging DisableEnableONUDt
153 [Teardown] Run Keywords Collect Logs
154 ... AND Stop Logging DisableEnableONUDt
155 ... AND Announce Message END TEST DisableEnableONUDt
156 FOR ${I} IN RANGE 0 ${num_onus}
157 ${src}= Set Variable ${hosts.src[${I}]}
158 ${dst}= Set Variable ${hosts.dst[${I}]}
159 ${onu_device_id}= Get Device ID From SN ${src['onu']}
160 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
161 ... ${of_id}
162 Disable Device ${onu_device_id}
163 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
164 ... Validate Device DISABLED UNKNOWN
165 ... REACHABLE ${src['onu']} onu=True onu_reason=omci-admin-lock
166 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
167 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
168 # TODO: Yet to Verify on the Physical POD
169 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
170 ... Wait Until Keyword Succeeds 60s 2s
171 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
172 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
173 Sleep 5s
174 Enable Device ${onu_device_id}
175 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
176 ... Validate Device ENABLED ACTIVE
177 ... REACHABLE ${src['onu']} onu=True onu_reason=onu-reenabled
178 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
179 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
180 # TODO: Yet to Verify on the Physical POD
181 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
182 ... Wait Until Keyword Succeeds 60s 2s
183 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
184 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
185 Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
186 Run Keyword and Ignore Error Collect Logs
187 END
188
Hardik Windlassaaea3402020-03-10 19:45:45 +0530189Test Disable and Delete OLT for DT
190 [Documentation] Validates E2E Ping Connectivity and object states for the given scenario:
191 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
192 ... Perform disable on the OLT and validate ONUs state and that the pings do not succeed
193 ... Perform delete on the OLT, Re-do Setup (Recreate the OLT) and Perform Sanity Test DT
Suchitra Vemurif2388ad2020-03-15 21:44:44 -0700194 [Tags] functionalDt DisableDeleteOLTDt
Hardik Windlassaaea3402020-03-10 19:45:45 +0530195 [Setup] Run Keywords Announce Message START TEST DisableDeleteOLTDt
196 ... AND Start Logging DisableDeleteOLTDt
197 [Teardown] Run Keywords Collect Logs
198 ... AND Stop Logging DisableDeleteOLTDt
199 ... AND Announce Message END TEST DisableDeleteOLTDt
200 # Disable and Validate OLT Device
201 Disable Device ${olt_device_id}
202 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
203 ... Validate OLT Device DISABLED UNKNOWN REACHABLE
204 ... ${olt_serial_number}
205 # Validate ONUs
206 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONUs After OLT Disable
207 # Verify VOLTHA Flows (TODO: Add verification for ONOS Flows)
208 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
209 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
210 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
211 ${onu_flows}= Set Variable 2
212 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
213 ${List_ONU_Serial} Create List
214 Set Suite Variable ${List_ONU_Serial}
215 Build ONU SN List ${List_ONU_Serial}
216 Log ${List_ONU_Serial}
217 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
218 ... ${List_ONU_Serial} ${onu_flows}
219 # Delete OLT and Validate Empty Device List
220 Delete Device ${olt_device_id}
221 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Test Empty Device List
222 Run Keyword and Ignore Error Collect Logs
223 # Re-do Setup (Recreate the OLT) and Perform Sanity Test DT
224 Run Keyword Setup
225 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
Suchitra Vemuriae9cecb2020-03-12 12:59:14 -0700226 Run Keyword If ${has_dataplane} Clean Up Linux
Hardik Windlassaaea3402020-03-10 19:45:45 +0530227
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000228*** Keywords ***
229Setup Suite
230 [Documentation] Set up the test suite
231 Common Test Suite Setup
232
233Clear All Devices Then Create New Device
234 [Documentation] Remove any devices from VOLTHA and ONOS
235 # Remove all devices from voltha and nos
236 Delete All Devices and Verify
237 # Execute normal test Setup Keyword
238 Setup
239