blob: 137fc9ba2a9a9a71f9120f6defc99dcbc726be6d [file] [log] [blame]
Hemadf003682020-04-28 21:22:22 +05301# Copyright 2017 - present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
14
15*** Settings ***
16Documentation Test various failure scenarios
17Suite Setup Setup Suite
18Test Setup Setup
19Test Teardown Teardown
TorstenThieme4e2168e2021-06-22 14:01:47 +000020Suite Teardown Teardown Suite
Hemadf003682020-04-28 21:22:22 +053021Library Collections
22Library String
23Library OperatingSystem
24Library XML
25Library RequestsLibrary
26Library ../../libraries/DependencyLibrary.py
27Resource ../../libraries/onos.robot
28Resource ../../libraries/voltctl.robot
29Resource ../../libraries/voltha.robot
30Resource ../../libraries/utils.robot
31Resource ../../libraries/k8s.robot
32Resource ../../variables/variables.robot
33Resource ../../libraries/power_switch.robot
34
35*** Variables ***
36${POD_NAME} flex-ocp-cord
37${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
38${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs
39#${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
40${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml
41${HELM_CHARTS_DIR} ~/helm-charts
42${VOLTHA_POD_NUM} 8
43${NAMESPACE} voltha
44${DEFAULTSPACE} default
45# For below variable value, using deployment name as using grep for
46# parsing radius pod name, we can also use full radius pod name
47${RESTART_POD_NAME} radius
48${timeout} 60s
49${of_id} 0
50${logical_id} 0
51${has_dataplane} True
52${teardown_device} False
53${scripts} ../../scripts
54
55# Per-test logging on failure is turned off by default; set this variable to enable
56${container_log_dir} ${None}
57
58*** Test Cases ***
59Verify OLT Soft Reboot
60 [Documentation] Test soft reboot of the OLT using voltctl command
Suchitra Vemuri4e6ff3c2020-08-04 21:52:17 -070061 [Tags] VOL-2745 OLTSoftReboot functional
Hemadf003682020-04-28 21:22:22 +053062 [Setup] Start Logging OLTSoftReboot
Hemadf003682020-04-28 21:22:22 +053063 [Teardown] Run Keywords Collect Logs
64 ... AND Stop Logging OLTSoftReboot
Suchitra Vemuridee90b12020-08-11 16:11:41 -070065 Delete All Devices and Verify
Suchitra Vemuri4e6ff3c2020-08-04 21:52:17 -070066 Setup
Hemadf003682020-04-28 21:22:22 +053067 ## Performing Sanity Test to make sure subscribers are all AUTH+DHCP and pingable
Suchitra Vemuri4e6ff3c2020-08-04 21:52:17 -070068 Run Keyword If ${has_dataplane} Clean Up Linux
69 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test
Hemadf003682020-04-28 21:22:22 +053070 # Reboot the OLT using "voltctl device reboot" command
71 Reboot Device ${olt_device_id}
Andrea Campanella9d8d3a52021-06-17 12:18:23 +020072 # Wait for the OLT to actually go down
73 Wait Until Keyword Succeeds 360s 5s Validate OLT Device ENABLED UNKNOWN UNREACHABLE
74 ... ${olt_serial_number}
Hemadf003682020-04-28 21:22:22 +053075 #Verify that ping fails
76 FOR ${I} IN RANGE 0 ${num_onus}
77 ${src}= Set Variable ${hosts.src[${I}]}
78 ${dst}= Set Variable ${hosts.dst[${I}]}
79 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
80 ... Wait Until Keyword Succeeds 60s 2s
81 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
82 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
83 END
Hemadf003682020-04-28 21:22:22 +053084 Run Keyword If ${has_dataplane} Wait Until Keyword Succeeds 120s 10s
Suchitra Vemurib7253a52020-07-14 22:35:17 -070085 ... Check Remote System Reachability True ${olt_ssh_ip}
Hemadf003682020-04-28 21:22:22 +053086 # Waiting extra time for the ONUs to come up
Hemadf003682020-04-28 21:22:22 +053087 # Check OLT states
Suchitra Vemuri4e6ff3c2020-08-04 21:52:17 -070088 Wait Until Keyword Succeeds 360s 5s Validate OLT Device ENABLED ACTIVE REACHABLE
Hemadf003682020-04-28 21:22:22 +053089 ... ${olt_serial_number}
Hemadf003682020-04-28 21:22:22 +053090 #Check after reboot that ONUs are active, authenticated/DHCP/pingable
91 Run Keyword If ${has_dataplane} Clean Up Linux
92 Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test
93
dmohapatro2166a442020-06-05 15:11:40 +000094Verify restart ofagent container before subscriber is provisioned
95 [Documentation] Restart ofagent container before subscriber is provisioned.
96 [Tags] functional VOL-2962 ofagentRestart
97 [Setup] Start Logging ofagentRestart
98 [Teardown] Run Keywords Collect Logs
99 ... AND Stop Logging ofagentRestart
100 ... AND Scale K8s Deployment ${NAMESPACE} voltha-ofagent 1
101 setup
102 Run Keyword If ${has_dataplane} Clean Up Linux
103 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
104 Set Global Variable ${of_id}
105 FOR ${I} IN RANGE 0 ${num_onus}
106 ${src}= Set Variable ${hosts.src[${I}]}
107 ${dst}= Set Variable ${hosts.dst[${I}]}
108 ${onu_device_id}= Get Device ID From SN ${src['onu']}
109 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
110 ... ${of_id}
111 # Bring up the device and verify it authenticates
112 Wait Until Keyword Succeeds ${timeout} 5s Validate Device ENABLED ACTIVE REACHABLE
Hardik Windlass8b446492021-06-10 06:25:23 +0000113 ... ${onu_device_id} onu=True onu_reason=omci-flows-pushed by_dev_id=True
dmohapatro2166a442020-06-05 15:11:40 +0000114 Wait Until Keyword Succeeds ${timeout} 2s Verify Eapol Flows Added For ONU ${ONOS_SSH_IP}
115 ... ${ONOS_SSH_PORT} ${onu_port}
116 ${wpa_log}= Run Keyword If ${has_dataplane} Catenate SEPARATOR=.
117 ... /tmp/wpa ${src['dp_iface_name']} log
118 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate Authentication True
119 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
120 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
121 Wait Until Keyword Succeeds ${timeout} 2s Verify ONU in AAA-Users ${ONOS_SSH_IP}
122 ... ${ONOS_SSH_PORT} ${onu_port}
123 END
124 # Restart POD ofagent
125 ${waitforRestart} Set Variable 120s
126 ${podStatusOutput}= Run kubectl get pods -n ${NAMESPACE}
127 Log ${podStatusOutput}
128 ${countBforRestart}= Run kubectl get pods -n ${NAMESPACE} | grep Running | wc -l
129 ${podName} Set Variable ofagent
130 Restart Pod ${NAMESPACE} ${podName}
131 Sleep 60s
132 Wait Until Keyword Succeeds ${waitforRestart} 2s Validate Pod Status ofagent ${NAMESPACE}
133 ... Running
134 FOR ${I} IN RANGE 0 ${num_onus}
135 # Add subscriber access and verify that DHCP completes to ensure system is still functioning properly
TorstenThieme4e2168e2021-06-22 14:01:47 +0000136 #Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP}
Suchitra Vemuri4e6ff3c2020-08-04 21:52:17 -0700137 #... ${ONOS_SSH_PORT} volt-add-subscriber-access ${of_id} ${onu_port}
dmohapatro2166a442020-06-05 15:11:40 +0000138 ${src}= Set Variable ${hosts.src[${I}]}
139 ${dst}= Set Variable ${hosts.dst[${I}]}
dmohapatro2166a442020-06-05 15:11:40 +0000140 ${onu_device_id}= Get Device ID From SN ${src['onu']}
141 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
142 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
Suchitra Vemuri4e6ff3c2020-08-04 21:52:17 -0700143 # Add subscriber access and verify that DHCP completes to ensure system is still functioning properly
TorstenThieme4e2168e2021-06-22 14:01:47 +0000144 Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP}
Suchitra Vemuri4e6ff3c2020-08-04 21:52:17 -0700145 ... ${ONOS_SSH_PORT} volt-add-subscriber-access ${of_id} ${onu_port}
dmohapatro2166a442020-06-05 15:11:40 +0000146 # Verify DHCP-Allocations
147 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
148 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
149 # Verify Ping
150 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Check Ping True
151 ... ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']} ${src['ip']}
152 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
dmohapatro2166a442020-06-05 15:11:40 +0000153 END
Hemadf003682020-04-28 21:22:22 +0530154
155*** Keywords ***
156Setup Suite
157 [Documentation] Set up the test suite
158 Common Test Suite Setup
TorstenThieme4e2168e2021-06-22 14:01:47 +0000159
160Teardown Suite
161 [Documentation] Clean up ONOS SSH connections
162 Close All ONOS SSH Connections