blob: d1c1593f4e3618727b3eefed1e9d89d8b7e54988 [file] [log] [blame]
Suchitra Vemurife309412020-12-01 19:19:52 -08001# Copyright 2020 - present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
14
15*** Settings ***
16Documentation Test various end-to-end scenarios involing Multiple OLTs
17Suite Setup Setup Suite
18Test Setup Setup
19Test Teardown Teardown
20Suite Teardown Teardown Suite
21Library Collections
22Library String
23Library OperatingSystem
24Library XML
25Library RequestsLibrary
26Library ../../libraries/DependencyLibrary.py
27Resource ../../libraries/onos.robot
28Resource ../../libraries/voltctl.robot
29Resource ../../libraries/voltha.robot
30Resource ../../libraries/utils.robot
31Resource ../../libraries/k8s.robot
32Resource ../../variables/variables.robot
33Resource ../../libraries/power_switch.robot
34
35*** Variables ***
36${POD_NAME} flex-ocp-cord
37${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
38${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs
39#${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
40${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml
41${HELM_CHARTS_DIR} ~/helm-charts
42${VOLTHA_POD_NUM} 8
43${NAMESPACE} voltha
44# For below variable value, using deployment name as using grep for
45# parsing radius pod name, we can also use full radius pod name
46${RESTART_POD_NAME} radius
47${timeout} 60s
48${of_id} 0
49${logical_id} 0
50${has_dataplane} True
51${teardown_device} False
52${scripts} ../../scripts
53
54# Per-test logging on failure is turned off by default; set this variable to enable
55${container_log_dir} ${None}
56
57*** Test Cases ***
58Verify OLT after Rebooting Physically for DT - Multiple OLT
59 [Documentation] Test the physical reboot of the OLT
60 ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed)
61 ... Test performs a physical reboot, performs "reboot" from the OLT CLI
62 ... Test runs when more than one OLT exists
63 ... Only one OLT is rebooted in the test, while verifying if the ONUs on the
Hardik Windlassa119a102021-02-15 14:52:07 +053064 ... other OLT are still functional
Hardik Windlass5ceb84e2021-02-11 11:17:08 +000065 [Tags] functionalDt MultiOLTPhysicalRebootDt
Suchitra Vemurife309412020-12-01 19:19:52 -080066 [Setup] Start Logging MultiOlt_Physical_Dt
67 [Teardown] Run Keywords Collect Logs
68 ... AND Stop Logging MultiOlt_Physical_Dt
Suchitra Vemurife309412020-12-01 19:19:52 -080069 # Execute the test when the number of OLTs are greater than one
70 Pass Execution If ${olt_count} == 1 Skipping test: just one OLT
Hardik Windlassa119a102021-02-15 14:52:07 +053071 Clear All Devices Then Perform Setup And Sanity
Suchitra Vemurife309412020-12-01 19:19:52 -080072 # Reboot the first OLT from the list of olts - rebooting from the OLT CLI
73 ${olt_user}= Get From Dictionary ${list_olts}[0] user
74 ${olt_pass}= Get From Dictionary ${list_olts}[0] pass
75 ${olt_ssh_ip}= Get From Dictionary ${list_olts}[0] sship
76 ${olt_serial_number}= Get From Dictionary ${list_olts}[0] sn
77 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
78 Run Keyword If ${has_dataplane} Login And Run Command On Remote System
Andrea Campanella5ef88142021-02-02 14:34:50 +010079 ... reboot ${olt_ssh_ip} ${olt_user} ${olt_pass} prompt=#
Suchitra Vemurife309412020-12-01 19:19:52 -080080 # validate that the ONUs on the other OLTs are still functional
81 Verify ping is successful for ONUs not on this OLT ${num_all_onus} ${olt_device_id}
Suchitra Vemurife309412020-12-01 19:19:52 -080082
83 # validate that the ONUs on the rebooted OLT are not pingable
84 FOR ${I} IN RANGE 0 ${num_all_onus}
85 ${src}= Set Variable ${hosts.src[${I}]}
86 ${dst}= Set Variable ${hosts.dst[${I}]}
87 ${olt_serial_number}= Get From Dictionary ${list_olts}[0] sn
88 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
89 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
90 ... Wait Until Keyword Succeeds 60s 2s
91 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
92 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
93 END
94 # Wait for the rebooted OLT to come back up
95 ${olt_user}= Get From Dictionary ${list_olts}[0] user
96 ${olt_pass}= Get From Dictionary ${list_olts}[0] pass
97 ${olt_ssh_ip}= Get From Dictionary ${list_olts}[0] sship
98 ${olt_serial_number}= Get From Dictionary ${list_olts}[0] sn
99 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
100 Run Keyword If ${has_dataplane} Wait Until Keyword Succeeds 120s 10s
101 ... Check Remote System Reachability True ${olt_ssh_ip}
102 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 360s 5s
103 ... Validate OLT Device ENABLED ACTIVE
104 ... REACHABLE ${olt_serial_number}
105 # Waiting extra time for the ONUs to come up
106 Sleep 60s
Suchitra Vemurife309412020-12-01 19:19:52 -0800107 Run Keyword If ${has_dataplane} Clean Up Linux
108 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
109
110Verify OLT Soft Reboot for DT - Multiple OLT
111 [Documentation] Test soft reboot of the OLT using voltctl command
112 ... Test runs when more than one OLT exists
113 ... Only one OLT is rebooted in the test, while verifying if the ONUs on the
Hardik Windlassa119a102021-02-15 14:52:07 +0530114 ... other OLT are still functional
Suchitra Vemurife309412020-12-01 19:19:52 -0800115 [Tags] MultiOLTSoftRebootDt functionalDt
116 [Setup] Start Logging MultiOLTSoftRebootDt
Suchitra Vemurife309412020-12-01 19:19:52 -0800117 [Teardown] Run Keywords Collect Logs
118 ... AND Stop Logging MultiOLTSoftRebootDt
Suchitra Vemuri6971c392020-12-08 10:41:33 -0800119 ... AND Delete All Devices and Verify
Suchitra Vemurife309412020-12-01 19:19:52 -0800120 Pass Execution If ${olt_count} == 1 Skipping test: just one OLT
Hardik Windlassa119a102021-02-15 14:52:07 +0530121 Clear All Devices Then Perform Setup And Sanity
Suchitra Vemurife309412020-12-01 19:19:52 -0800122 # Reboot the first OLT
123 ${olt_user}= Get From Dictionary ${list_olts}[0] user
124 ${olt_pass}= Get From Dictionary ${list_olts}[0] pass
125 ${olt_ssh_ip}= Get From Dictionary ${list_olts}[0] sship
126 ${olt_serial_number}= Get From Dictionary ${list_olts}[0] sn
127 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
128 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 360s 5s
129 ... Validate OLT Device ENABLED ACTIVE
130 ... REACHABLE ${olt_serial_number}
131 # Reboot the OLT using "voltctl device reboot" command
132 Reboot Device ${olt_device_id}
Andrea Campanella9d8d3a52021-06-17 12:18:23 +0200133 # Wait for the OLT to actually go down
134 Wait Until Keyword Succeeds 360s 5s Validate OLT Device ENABLED UNKNOWN UNREACHABLE
135 ... ${olt_serial_number}
Suchitra Vemurife309412020-12-01 19:19:52 -0800136 # validate that the ONUs on the other OLTs are still functional
137 Verify ping is successful for ONUs not on this OLT ${num_all_onus} ${olt_device_id}
138 #Verify that ping fails for the ONUs where the OLT has been rebooted
139 FOR ${I} IN RANGE 0 ${num_all_onus}
140 ${src}= Set Variable ${hosts.src[${I}]}
141 ${dst}= Set Variable ${hosts.dst[${I}]}
142 ${olt_serial_number}= Get From Dictionary ${list_olts}[0] sn
143 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
144 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
145 ... Wait Until Keyword Succeeds 60s 2s
146 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
147 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
148 END
149 # Check OLT state
150 ${olt_serial_number}= Get From Dictionary ${list_olts}[0] sn
151 ${olt_ssh_ip}= Get From Dictionary ${list_olts}[0] sship
152 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
153 # Wait for the OLT to come back up
154 Run Keyword If ${has_dataplane} Wait Until Keyword Succeeds 120s 10s
155 ... Check Remote System Reachability True ${olt_ssh_ip}
156 # Check OLT states
157 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 360s 5s
158 ... Validate OLT Device ENABLED ACTIVE
159 ... REACHABLE ${olt_serial_number}
160 # Waiting extra time for the ONUs to come up
161 Sleep 60s
Suchitra Vemurife309412020-12-01 19:19:52 -0800162 #Check after reboot that ONUs are active, DHCP and pingable
163 Run Keyword If ${has_dataplane} Clean Up Linux
164 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT
165
166*** Keywords ***
167Setup Suite
168 [Documentation] Set up the test suite
169 Common Test Suite Setup
170 #power_switch.robot needs it to support different vendor's power switch
171 ${switch_type}= Get Variable Value ${web_power_switch.type}
172 Run Keyword If "${switch_type}"!="" Set Global Variable ${powerswitch_type} ${switch_type}
173
Hardik Windlassa119a102021-02-15 14:52:07 +0530174Clear All Devices Then Perform Setup And Sanity
175 [Documentation] Remove any devices from VOLTHA and Verify in ONOS
176 ... Create New Device through Setup and Perform Sanity
Suchitra Vemurife309412020-12-01 19:19:52 -0800177 # Remove all devices from voltha and nos
Hardik Windlassa119a102021-02-15 14:52:07 +0530178 Run Keyword and Ignore Error Delete All Devices and Verify
Suchitra Vemurife309412020-12-01 19:19:52 -0800179 # Execute normal test Setup Keyword
180 Setup
Hardik Windlassa119a102021-02-15 14:52:07 +0530181 # Performing Sanity Test to make sure subscribers are all DHCP and pingable
182 Run Keyword If ${has_dataplane} Clean Up Linux
183 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test DT