blob: 6680a34a6a93d49c68b9a3e0e894564ef3f23cd1 [file] [log] [blame]
Kailash92764922019-07-25 08:21:39 -07001# Copyright 2017-present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
Kailash92764922019-07-25 08:21:39 -070014# robot test functions
15
16*** Settings ***
17Documentation Library for various utilities
18Library SSHLibrary
Kailash92764922019-07-25 08:21:39 -070019Library String
20Library DateTime
21Library Process
22Library Collections
23Library RequestsLibrary
24Library OperatingSystem
Andy Bavier63460da2020-02-20 14:35:12 -070025Library CORDRobot
26Library ImportResource resources=CORDRobot
TorstenThiemed4f48962020-12-08 12:17:19 +000027Resource ./voltctl.robot
Kailash92764922019-07-25 08:21:39 -070028
29*** Keywords ***
Kailash528f7c02019-07-31 10:55:49 -070030Check CLI Tools Configured
31 [Documentation] Tests that use 'voltctl' and 'kubectl' should execute this keyword in suite setup
32 # check voltctl and kubectl configured
Hardik Windlass13803172021-04-26 08:17:07 +000033 ${voltctl_rc} ${voltctl_output}= Run And Return Rc And Output voltctl device list
34 Log ${voltctl_output}
35 ${kubectl_rc} ${kubectl_output}= Run And Return Rc And Output kubectl get pods
36 Log ${kubectl_output}
Gilles Depatie675a2062019-10-22 12:44:42 -040037 Run Keyword If ${voltctl_rc} != 0 or ${kubectl_rc} != 0 FATAL ERROR
38 ... VOLTCTL and KUBECTL not configured. Please configure before executing tests.
Gilles Depatieb5682f82019-10-31 10:39:45 -040039
40Send File To Onos
Zack Williamsa8fe75a2020-01-10 14:25:27 -070041 [Documentation] Send the content of the file to Onos to selected section of configuration
42 ... using Post Request
43 [Arguments] ${CONFIG_FILE} ${section}
44 ${Headers}= Create Dictionary Content-Type application/json
45 ${File_Data}= OperatingSystem.Get File ${CONFIG_FILE}
46 Log ${Headers}
47 Log ${File_Data}
48 ${resp}= Post Request ONOS
49 ... /onos/v1/network/configuration/${section} headers=${Headers} data=${File_Data}
50 Should Be Equal As Strings ${resp.status_code} 200
Andy Bavier88cd9f62019-11-26 16:22:33 -070051
52Common Test Suite Setup
53 [Documentation] Setup the test suite
Andy Bavier88cd9f62019-11-26 16:22:33 -070054 Set Global Variable ${KUBECTL_CONFIG} export KUBECONFIG=%{KUBECONFIG}
Matteo Scandolo5899be12020-11-11 15:38:07 -080055 Set Global Variable ${VOLTCTL_CONFIG} %{VOLTCONFIG}
Andy Bavier88cd9f62019-11-26 16:22:33 -070056 ${k8s_node_ip}= Evaluate ${nodes}[0].get("ip")
ubuntu6b6e7d42020-03-02 12:35:42 -080057 ${ONOS_REST_IP}= Get Environment Variable ONOS_REST_IP ${k8s_node_ip}
58 ${ONOS_SSH_IP}= Get Environment Variable ONOS_SSH_IP ${k8s_node_ip}
59 Set Global Variable ${ONOS_REST_IP}
60 Set Global Variable ${ONOS_SSH_IP}
Andy Bavier88cd9f62019-11-26 16:22:33 -070061 ${k8s_node_user}= Evaluate ${nodes}[0].get("user")
62 ${k8s_node_pass}= Evaluate ${nodes}[0].get("pass")
63 Check CLI Tools Configured
64 ${onos_auth}= Create List karaf karaf
65 ${HEADERS} Create Dictionary Content-Type=application/json
ubuntu6b6e7d42020-03-02 12:35:42 -080066 Create Session ONOS http://${ONOS_REST_IP}:${ONOS_REST_PORT} auth=${ONOS_AUTH}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080067 ${num_olts} Get Length ${olts}
68 ${list_olts} Create List
Suchitra Vemuriac9785e2021-01-07 16:50:18 -080069 # Create olt list from the configuration file
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080070 FOR ${I} IN RANGE 0 ${num_olts}
71 ${ip} Evaluate ${olts}[${I}].get("ip")
72 ${user} Evaluate ${olts}[${I}].get("user")
73 ${pass} Evaluate ${olts}[${I}].get("pass")
74 ${serial_number} Evaluate ${olts}[${I}].get("serial")
75 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanella3dcce272021-01-15 16:04:47 +010076 ${type} Evaluate ${olts}[${I}].get("type")
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080077 ${orig_olt_port} Evaluate ${olts}[${I}].get("oltPort")
78 ${port}= Set Variable If "${orig_olt_port}" == "None" ${OLT_PORT} ${orig_olt_port}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080079 ${onu_count}= Get ONU Count For OLT ${hosts.src} ${serial_number}
Suchitra Vemurife309412020-12-01 19:19:52 -080080 ${onu_list}= Get ONU List For OLT ${hosts.src} ${serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080081 ${olt} Create Dictionary ip ${ip} user ${user} pass
Andrea Campanella3dcce272021-01-15 16:04:47 +010082 ... ${pass} sn ${serial_number} onucount ${onu_count} type ${type}
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080083 ... sship ${olt_ssh_ip} oltport ${port} onus ${onu_list}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080084 Append To List ${list_olts} ${olt}
85 END
86 ${num_all_onus}= Get Length ${hosts.src}
87 ${num_all_onus}= Convert to String ${num_all_onus}
Andy Bavier88cd9f62019-11-26 16:22:33 -070088 #send sadis file to onos
Andy Baviera2691752019-11-27 12:18:38 -070089 ${sadis_file}= Get Variable Value ${sadis.file}
Zack Williamsa8fe75a2020-01-10 14:25:27 -070090 Log To Console \nSadis File:${sadis_file}
Andy Bavier88cd9f62019-11-26 16:22:33 -070091 Run Keyword Unless '${sadis_file}' is '${None}' Send File To Onos ${sadis_file} apps/
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080092 Set Suite Variable ${num_all_onus}
93 Set Suite Variable ${num_olts}
94 Set Suite Variable ${list_olts}
95 ${olt_count}= Get Length ${list_olts}
96 Set Suite Variable ${olt_count}
Andrea Campanella3dcce272021-01-15 16:04:47 +010097 @{container_list}= Create List ${OLT_ADAPTER_APP_LABEL} adapter-open-onu voltha-api-server
Andy Bavier88cd9f62019-11-26 16:22:33 -070098 ... voltha-ro-core voltha-rw-core-11 voltha-rw-core-12 voltha-ofagent
99 Set Suite Variable ${container_list}
100 ${datetime}= Get Current Date
suraj gour7f6d5fe2019-11-29 10:56:35 +0000101 Set Suite Variable ${datetime}
102
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800103Get ONU Count For OLT
104 [Arguments] ${src} ${serial_number}
105 [Documentation] Gets ONU Count for the specified OLT
106 ${src_length}= Get Length ${src}
107 ${count}= Set Variable 0
108 FOR ${I} IN RANGE 0 ${src_length}
109 ${sn} Evaluate ${src}[${I}].get("olt")
TorstenThiemed4f48962020-12-08 12:17:19 +0000110 ${count}= Run Keyword If '${serial_number}' == '${sn}' Evaluate ${count} + 1
111 ... ELSE Set Variable ${count}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800112 END
113 [Return] ${count}
114
Suchitra Vemurife309412020-12-01 19:19:52 -0800115Get ONU List For OLT
116 [Arguments] ${src} ${serial_number}
117 [Documentation] Gets ONU List for the specified OLT
118 ${src_length}= Get Length ${src}
119 ${onu_list}= Create List
120 FOR ${I} IN RANGE 0 ${src_length}
121 ${sn} Evaluate ${src}[${I}].get("olt")
122 Run Keyword If '${serial_number}' == '${sn}' Append To List ${onu_list} ${src}[${I}].get("onu")
123 ... ELSE Set Variable ${onu_list}
124 END
125 [Return] ${onu_list}
126
suraj gour7f6d5fe2019-11-29 10:56:35 +0000127WPA Reassociate
suraj gour7f6d5fe2019-11-29 10:56:35 +0000128 [Documentation] Executes a particular wpa_cli reassociate, which performs force reassociation
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700129 [Arguments] ${iface} ${ip} ${user} ${pass}=${None}
130 ... ${container_type}=${None} ${container_name}=${None}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000131 #Below for loops are used instead of sleep time, to execute reassociate command and check status
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700132 FOR ${i} IN RANGE 70
133 ${output}= Login And Run Command On Remote System
134 ... wpa_cli -i ${iface} reassociate ${ip} ${user}
135 ... ${pass} ${container_type} ${container_name}
136 ${passed}= Run Keyword And Return Status Should Contain ${output} OK
Andy Bavierb63f6d22020-03-12 15:34:37 -0700137 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700138 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700139 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700140 FOR ${i} IN RANGE 70
141 ${output}= Login And Run Command On Remote System
Andy Bavierae4a17e2020-02-25 14:54:36 -0700142 ... wpa_cli -i ${iface} status | grep SUCCESS ${ip} ${user}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700143 ... ${pass} ${container_type} ${container_name}
144 ${passed}= Run Keyword And Return Status Should Contain ${output} SUCCESS
Andy Bavierb63f6d22020-03-12 15:34:37 -0700145 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700146 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700147 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700148
suraj gour7f6d5fe2019-11-29 10:56:35 +0000149Validate Authentication After Reassociate
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700150 [Arguments] ${auth_pass} ${iface} ${ip} ${user} ${pass}=${None}
151 ... ${container_type}=${None} ${container_name}=${None}
152 [Documentation]
153 ... Executes a particular reassociate request on the RG using wpa_cli.
154 ... auth_pass determines if authentication should pass
Andy Bavier84834d42020-02-25 13:49:50 -0700155 ${wpa_log}= Catenate SEPARATOR=. /tmp/wpa ${iface} log
156 ${output}= Login And Run Command On Remote System truncate -s 0 ${wpa_log}; cat ${wpa_log}
157 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
158 Log ${output}
159 Should Not Contain ${output} authentication completed successfully
suraj gour7f6d5fe2019-11-29 10:56:35 +0000160 WPA Reassociate ${iface} ${ip} ${user} ${pass} ${container_type} ${container_name}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700161 Run Keyword If '${auth_pass}' == 'True' Wait Until Keyword Succeeds ${timeout} 2s
Andy Bavier84834d42020-02-25 13:49:50 -0700162 ... Check Remote File Contents True ${wpa_log} ${iface}.*authentication completed successfully
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700163 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000164 Run Keyword If '${auth_pass}' == 'False' Sleep 20s
Suchitra Vemuri3cb29f82020-02-25 13:59:58 -0800165 Run Keyword If '${auth_pass}' == 'False' Check Remote File Contents False /tmp/wpa.log
Andy Bavier84834d42020-02-25 13:49:50 -0700166 ... ${iface}.*authentication completed successfully ${ip} ${user} ${pass}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700167 ... ${container_type} ${container_name}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000168
169Send Dhclient Request To Release Assigned IP
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700170 [Arguments] ${iface} ${ip} ${user} ${path_dhcpleasefile} ${pass}=${None}
171 ... ${container_type}=${None} ${container_name}=${None}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000172 [Documentation] Executes a dhclient with option to release ip against a particular interface on the RG (src)
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700173 ${result}= Login And Run Command On Remote System
174 ... dhclient -nw -r ${iface} && rm ${path_dhcpleasefile}/dhclient.* ${ip} ${user}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000175 ... ${pass} ${container_type} ${container_name}
176 Log ${result}
177 #Should Contain ${result} DHCPRELEASE
178 [Return] ${result}
suraj gour1ecfae92019-12-20 15:11:40 +0000179
180Check Remote File Contents For WPA Logs
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700181 [Arguments] ${file_should_exist} ${file} ${pattern} ${ip} ${user} ${pass}=${None}
182 ... ${container_type}=${None} ${container_name}=${None} ${prompt}=~$
suraj gour1ecfae92019-12-20 15:11:40 +0000183 [Documentation] Checks for particular pattern count in a file
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700184 ${result}= Login And Run Command On Remote System
185 ... cat ${file} | grep '${pattern}' | wc -l ${ip} ${user} ${pass}
suraj gour1ecfae92019-12-20 15:11:40 +0000186 ... ${container_type} ${container_name} ${prompt}
187 [Return] ${result}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000188
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800189
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000190Perform Sanity Test
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800191 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure
192 ... for all the ONUs connected to each OLT - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000193 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
194 ... In all other (common) cases flag has to be set False (default).
195 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800196 FOR ${J} IN RANGE 0 ${num_olts}
197 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
198 ${onu_count}= Set Variable ${list_olts}[${J}][onucount]
199 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
200 ... ${olt_serial_number}
201 Set Global Variable ${of_id}
202 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
203 ... Get NNI Port in ONOS ${of_id}
204 Set Global Variable ${nni_port}
205 # Verify Default Meter in ONOS (valid only for ATT)
206 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
207 ... Verify Default Meter Present in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
208 Perform Sanity Test Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${onu_count}
TorstenThiemec3c23232021-01-13 13:06:31 +0000209 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800210 END
211
212Perform Sanity Test Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000213 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000214 [Documentation] This keyword performs Sanity Test Procedure
215 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
216 ... This keyword can be used to call in any other tests where sanity check is required
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800217 ... and avoids duplication of code. - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000218 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
219 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800220 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000221 ${src}= Set Variable ${hosts.src[${I}]}
222 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800223 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000224 ${onu_device_id}= Get Device ID From SN ${src['onu']}
225 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
226 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800227 # Check ONU port is Enabled in ONOS
228 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700229 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800230 # Verify EAPOL flows are added for the ONU port
TorstenThiemec3c23232021-01-13 13:06:31 +0000231 Run Keyword Unless ${supress_add_subscriber}
232 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
ubuntu6b6e7d42020-03-02 12:35:42 -0800233 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800234 # Verify ONU state in voltha
235 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
236 ... ENABLED ACTIVE REACHABLE
237 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
238 # Perform Authentication
Andy Bavier84834d42020-02-25 13:49:50 -0700239 ${wpa_log}= Run Keyword If ${has_dataplane} Catenate SEPARATOR=.
240 ... /tmp/wpa ${src['dp_iface_name']} log
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000241 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate Authentication True
242 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
Andy Bavier84834d42020-02-25 13:49:50 -0700243 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000244 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800245 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
TorstenThiemec3c23232021-01-13 13:06:31 +0000246 Run Keyword Unless ${supress_add_subscriber}
247 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800248 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000249 ... volt-add-subscriber-access ${of_id} ${onu_port}
Suchitra Vemuri9da44302020-03-04 14:24:49 -0800250 # Verify that no pending flows exist for the ONU port
251 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
252 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Hardik Windlass21807632020-04-14 16:24:55 +0530253 # Verify subscriber access flows are added for the ONU port
254 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
255 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
256 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530257 # Verify Meters in ONOS
258 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
259 ... Verify Meters in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000260 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
261 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
262 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
263 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
264 ... ${dst['container_name']}
265 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
ubuntu6b6e7d42020-03-02 12:35:42 -0800266 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000267 END
268
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000269Perform Sanity Test DT
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800270 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000271 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
272 ... In all other (common) cases flag has to be set False (default).
273 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800274 FOR ${J} IN RANGE 0 ${num_olts}
275 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
276 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
277 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
278 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
279 ... ${olt_serial_number}
280 Set Global Variable ${of_id}
281 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
282 ... Get NNI Port in ONOS ${of_id}
283 Set Global Variable ${nni_port}
284 Perform Sanity Test DT Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${num_onus}
TorstenThiemec3c23232021-01-13 13:06:31 +0000285 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800286 # Verify ONOS Flows
287 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
288 ${onos_flows_count}= Evaluate 4 * ${num_onus}
289 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
290 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
291 ... ${onos_flows_count}
292 # Verify VOLTHA Flows
293 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
294 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
295 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
296 ${onu_flows}= Set Variable 2
297 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
298 ... ${olt_device_id}
299 ${List_ONU_Serial} Create List
300 Set Suite Variable ${List_ONU_Serial}
Suchitra Vemuri21a47fd2020-11-16 18:39:09 -0800301 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800302 Log ${List_ONU_Serial}
303 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
304 ... ${List_ONU_Serial} ${onu_flows}
305 END
306
307
308Perform Sanity Test DT Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000309 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000310 [Documentation] This keyword performs Sanity Test Procedure for DT Workflow
311 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
312 ... This keyword can be used to call in any other tests where sanity check is required
313 ... and avoids duplication of code.
TorstenThiemec3c23232021-01-13 13:06:31 +0000314 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
315 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800316 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000317 ${src}= Set Variable ${hosts.src[${I}]}
318 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800319 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000320 ${onu_device_id}= Get Device ID From SN ${src['onu']}
321 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
322 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
323 # Check ONU port is Enabled in ONOS
324 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700325 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemec3c23232021-01-13 13:06:31 +0000326 Run Keyword Unless ${supress_add_subscriber}
327 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800328 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000329 ... volt-add-subscriber-access ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530330 # Verify subscriber access flows are added for the ONU port
331 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass25e11702020-03-30 20:05:19 +0530332 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
333 ... ${onu_port} ${nni_port} ${src['s_tag']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000334 # Verify ONU state in voltha
335 ${onu_reasons}= Create List omci-flows-pushed
336 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
337 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000338 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
339 ... ENABLED ACTIVE REACHABLE
TorstenThiemec3c23232021-01-13 13:06:31 +0000340 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530341 # Verify Meters in ONOS
342 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
343 ... Verify Meters in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530344 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000345 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
346 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
347 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
348 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
349 ... ${dst['container_name']}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000350 END
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800351
352Validate All OLT Flows
353 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
354 FOR ${J} IN RANGE 0 ${num_olts}
355 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
356 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
357 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
358 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
359 ... ${olt_serial_number}
360 Set Global Variable ${of_id}
361 # Verify ONOS Flows
362 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
363 ${onos_flows_count}= Evaluate 4 * ${num_onus}
364 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
365 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
366 ... ${onos_flows_count}
367 # Verify VOLTHA Flows
368 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
369 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
370 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
371 ${onu_flows}= Set Variable 2
372 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
373 ... ${olt_device_id}
374 ${List_ONU_Serial} Create List
375 Set Suite Variable ${List_ONU_Serial}
Andrea Campanella6391f842020-11-16 10:01:18 +0100376 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800377 Log ${List_ONU_Serial}
378 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
379 ... ${List_ONU_Serial} ${onu_flows}
380 END
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000381
TorstenThieme70bc5262021-01-19 12:12:55 +0000382Perform Sanity Tests TT
383 [Documentation] This keyword performs both Sanity Test Procedure for TT Workflow
384 ... Sanity Test TT for HSIA, VoD, VoIP services and Sanity Test TT for MCAST
385 ... For repeating sanity tests without subscriber changes set flag supress_add_subscriber=True.
386 ... In all other (common) cases flag has to be set False (default).
387 [Arguments] ${supress_add_subscriber}=False
388 Perform Sanity Test TT ${supress_add_subscriber}
TorstenThieme136ebf72021-02-26 14:27:07 +0000389 # run of mcast sanity test is currently limited for real HW
390 Run Keyword If ${has_dataplane} Perform Sanity Test TT MCAST ${supress_add_subscriber}
TorstenThieme70bc5262021-01-19 12:12:55 +0000391
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700392Perform Sanity Test TT
393 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
394 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
395 ... This keyword can be used to call in any other tests where sanity check is required
396 ... and avoids duplication of code.
TorstenThieme70bc5262021-01-19 12:12:55 +0000397 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
398 ... In all other (common) cases flag has to be set False (default).
399 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800400 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700401 ${src}= Set Variable ${hosts.src[${I}]}
402 ${dst}= Set Variable ${hosts.dst[${I}]}
403 ${service_type}= Get Variable Value ${src['service_type']} "null"
TorstenThiemea36068c2021-02-19 09:57:32 +0000404 Run Keyword IF '${service_type}' != 'mcast' Sanity Test TT one ONU ${src} ${dst} ${supress_add_subscriber}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700405 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700406
407Sanity Test TT one ONU
408 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
409 ... Tests for one ONU
410 ... Assertions apply to HSIA, VoD, VoIP services
TorstenThieme70bc5262021-01-19 12:12:55 +0000411 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
412 ... In all other (common) cases flag has to be set False (default).
413 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800414 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700415 Set Global Variable ${of_id}
416 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
417 ... Get NNI Port in ONOS ${of_id}
418 Set Global Variable ${nni_port}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700419 ${onu_device_id}= Get Device ID From SN ${src['onu']}
420 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
421 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
422 # Check ONU port is Enabled in ONOS
423 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
424 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000425 Run Keyword Unless ${supress_add_subscriber}
426 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700427 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
428 ... volt-add-subscriber-access ${of_id} ${onu_port}
TorstenThiemea36068c2021-02-19 09:57:32 +0000429 # Verify ONU state in voltha
430 ${onu_reasons}= Create List omci-flows-pushed
431 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
432 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700433 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
434 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800435 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700436 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
437 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
438 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
439 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
440 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
441 ... ${dst['container_name']}
Matteo Scandolo37a6cb72021-01-08 13:55:59 -0800442 Run Keyword IF '${src['service_type']}'!='hsia'
Suchitra Vemuri42819412020-10-01 17:45:43 -0700443 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -0700444 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri42819412020-10-01 17:45:43 -0700445 ... ${src['c_tag']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700446
447Perform Sanity Test TT MCAST
448 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
449 ... Adds subscribers
450 ... Validates for MCAST
TorstenThieme70bc5262021-01-19 12:12:55 +0000451 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
452 ... In all other (common) cases flag has to be set False (default).
453 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800454 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700455 ${src}= Set Variable ${hosts.src[${I}]}
456 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700457 ${service_type}= Get Variable Value ${src['service_type']} "null"
458 Run Keyword IF '${service_type}' == 'mcast' Sanity Test TT MCAST one ONU ${src}
TorstenThiemea36068c2021-02-19 09:57:32 +0000459 ... ${dst} ${supress_add_subscriber}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700460 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700461
462Sanity Test TT MCAST one ONU
463 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
464 ... Tests for one ONU
465 ... Assertions apply to MCAST services
TorstenThieme70bc5262021-01-19 12:12:55 +0000466 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
467 ... In all other (common) cases flag has to be set False (default).
468 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700469 # Check for iperf and jq tools
470 ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf jq
471 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
472 ... ${src['container_name']}
473 Pass Execution If ${rc} != 0 Skipping test: iperf / jq not found on the RG
474
475 #Reset the IP on the interface
476 ${output}= Login And Run Command On Remote System sudo ifconfig ${src['dp_iface_name']} 0
477 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
478 # Kill iperf on BNG
479 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
480 ... sudo kill -9 `pidof iperf`
481 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
482 ... ${dst['container_name']}
483
484 # Setup RG for Multi-cast test
485 ${output}= Login And Run Command On Remote System
486 ... sudo ifconfig ${src['dp_iface_name']} ${src['mcast_rg']} up ; sudo kill -9 `pidof iperf`
487 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
488 ${output}= Login And Run Command On Remote System
489 ... sudo ip route add ${src['mcast_grp_subnet_mask']} dev ${src['dp_iface_name']} scope link
490 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
491
492 # Perform operations for adding subscriber
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800493 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700494 Set Global Variable ${of_id}
495 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
496 ... Get NNI Port in ONOS ${of_id}
497 Set Global Variable ${nni_port}
498 ${onu_device_id}= Get Device ID From SN ${src['onu']}
499 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
500 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
501 # Check ONU port is Enabled in ONOS
502 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
503 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000504 Run Keyword Unless ${supress_add_subscriber}
505 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700506 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
507 ... volt-add-subscriber-access ${of_id} ${onu_port}
TorstenThiemea36068c2021-02-19 09:57:32 +0000508 # Verify ONU state in voltha
509 ${onu_reasons}= Create List omci-flows-pushed
510 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
511 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700512 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
513 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800514 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700515
516 # Setup iperf on the BNG
517 ${server_output}= Login And Run Command On Remote System
518 ... sudo iperf -c ${dst['dp_iface_ip_qinq']} -u -T 32 -t 60 -i 1 &
519 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
520 ... ${dst['container_name']}
521
522 # Setup iperf on the RG
523 ${rg_output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
524 ... Login And Run Command On Remote System
525 ... rm -rf /tmp/rg_output ; sudo iperf -s -u -B ${dst['dp_iface_ip_qinq']} -i 1 -D >> /tmp/rg_output
526 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
527 Log ${rg_output}
528 Sleep 60s
529 ${output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
530 ... Login And Run Command On Remote System
531 ... cat /tmp/rg_output | grep KBytes
532 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
533 Log ${output}
534 Should Contain ${output} KBytes
535
536 # Kill iperf on BNG
537 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
538 ... sudo kill -9 `pidof iperf`
539 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
540 ... ${dst['container_name']}
541
542 # Kill iperf on the RG
543 ${output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
544 ... sudo kill -9 `pidof iperf`
545 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
546
Hardik Windlass62db9d92021-05-17 09:32:40 +0000547Setup Soak
548 [Documentation] Pre-test Setup for Soak Job
549 ${olt_ids} Create List
550 FOR ${I} IN RANGE 0 ${num_olts}
551 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
552 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
553 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
554 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
555 ... ${olt_serial_number}
556 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
557 ... Get NNI Port in ONOS ${of_id}
558 Set Global Variable ${nni_port}
559 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
560 ... of_id ${of_id} sn ${olt_serial_number}
561 Append To List ${olt_ids} ${olt}
562 END
563 Set Global Variable ${olt_ids}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700564
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000565Setup
566 [Documentation] Pre-test Setup
Hardik Windlass4ed54502021-05-14 07:34:15 +0000567 [Arguments] ${skip_empty_device_list_test}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000568 #test for empty device list
Hardik Windlass4ed54502021-05-14 07:34:15 +0000569 Run Keyword If '${skip_empty_device_list_test}'=='False' Test Empty Device List
Hardik Windlass5e214b22021-02-26 10:37:14 +0000570 # TBD: Need for this Sleep
571 Run Keyword If ${has_dataplane} Sleep 180s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800572 # Create a list of olt ids (logical and device_id)
573 ${olt_ids} Create List
574 FOR ${I} IN RANGE 0 ${num_olts}
575 #create/preprovision device
Andrea Campanella3dcce272021-01-15 16:04:47 +0100576 ${olt_device_id}= Run Keyword If "${list_olts}[${I}][type]" == "${None}"
Suchitra Vemuri09f878d2021-02-10 18:19:04 -0800577 ... Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport]
578 ... ELSE Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport] ${list_olts}[${I}][type]
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800579 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
580 #Set Suite Variable ${olt_device_id}
581 #validate olt states
582 Wait Until Keyword Succeeds ${timeout} 5s
583 ... Validate OLT Device PREPROVISIONED UNKNOWN UNKNOWN ${olt_device_id}
584 Sleep 5s
585 Enable Device ${olt_device_id}
Suchitra Vemuricf6e89c2021-03-24 19:14:15 -0700586 # Increasing the timer to incorporate wait time for in-band
587 Wait Until Keyword Succeeds 540s 5s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800588 ... Validate OLT Device ENABLED ACTIVE REACHABLE ${olt_serial_number}
589 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
590 # Set Suite Variable ${logical_id}
591 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
592 ... ${olt_serial_number}
593 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
594 ... of_id ${of_id} sn ${olt_serial_number}
595 Append To List ${olt_ids} ${olt}
596 END
597 Set Global Variable ${olt_ids}
598
599Get ofID From OLT List
600 [Documentation] Retrieves the corresponding of_id for the OLT serial number specified
601 [Arguments] ${serial_number}
602 FOR ${I} IN RANGE 0 ${olt_count}
603 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100604 ${of_id}= Run Keyword IF "${serial_number}"=="${sn}"
605 ... Get From Dictionary ${olt_ids}[${I}] of_id ELSE Set Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800606 END
607 [Return] ${of_id}
608
609Get OLTDeviceID From OLT List
610 [Documentation] Retrieves the corresponding olt_device_id for the OLT serial number specified
611 [Arguments] ${serial_number}
Suchitra Vemuri4b8f4f52020-11-17 19:12:50 -0800612 ${olt_device_id}= Set Variable 0
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800613 FOR ${I} IN RANGE 0 ${olt_count}
614 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100615 ${olt_device_id}= Run Keyword IF "${serial_number}"=="${sn}"
616 ... Get From Dictionary ${olt_ids}[${I}] device_id ELSE Set Variable ${olt_device_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800617 END
618 [Return] ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000619
Andrea Campanellad848de02020-11-24 10:23:41 +0100620Get Num of Onus From OLT SN
621 [Documentation] Retrieves the corresponding number of ONUs for a given OLT based on serial number specified
622 [Arguments] ${serial_number}
623 ${num_of_olt_onus}= Set Variable 0
624 FOR ${I} IN RANGE 0 ${olt_count}
625 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
626 ${num_of_olt_onus}= Run Keyword IF "${serial_number}"=="${sn}"
627 ... Get From Dictionary ${list_olts}[${I}] onucount ELSE Set Variable ${num_of_olt_onus}
628 END
629 [Return] ${num_of_olt_onus}
630
Hardik Windlassaaea3402020-03-10 19:45:45 +0530631Validate ONUs After OLT Disable
632 [Documentation] Validates the ONUs state in Voltha, ONUs port state in ONOS
633 ... and that pings do not succeed After corresponding OLT is Disabled
Andrea Campanella4e507882020-11-26 11:33:11 +0100634 [Arguments] ${num_onus} ${olt_serial_number}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530635 FOR ${I} IN RANGE 0 ${num_onus}
636 ${src}= Set Variable ${hosts.src[${I}]}
637 ${dst}= Set Variable ${hosts.dst[${I}]}
Andrea Campanella4e507882020-11-26 11:33:11 +0100638 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800639 ${of_id}= Get ofID From OLT List ${src['olt']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530640 ${onu_device_id}= Get Device ID From SN ${src['onu']}
641 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
642 ... ${of_id}
643 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
644 ... Validate Device ENABLED DISCOVERED
645 ... UNREACHABLE ${src['onu']} onu=True onu_reason=stopping-openomci
646 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700647 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530648 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
649 ... Wait Until Keyword Succeeds 60s 2s
650 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
651 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530652 END
653
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000654Delete All Devices and Verify
655 [Documentation] Remove any devices from VOLTHA and ONOS
656 # Clear devices from VOLTHA
657 Disable Devices In Voltha Root=true
658 Wait Until Keyword Succeeds ${timeout} 2s Test Devices Disabled In Voltha Root=true
659 Delete Devices In Voltha Root=true
660 Wait Until Keyword Succeeds ${timeout} 2s Test Empty Device List
Hardik Windlasse8b99222021-01-25 10:03:14 +0000661 FOR ${I} IN RANGE 0 ${num_olts}
662 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
TorstenThieme9bd8b9a2021-03-11 15:00:43 +0000663 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlasse8b99222021-01-25 10:03:14 +0000664 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
665 END
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000666 # Clear devices from ONOS
Suchitra Vemurif7a033c2020-02-26 17:22:41 -0800667 #Remove All Devices From ONOS
ubuntu6b6e7d42020-03-02 12:35:42 -0800668 #... http://karaf:karaf@${ONOS_REST_IP}:${ONOS_REST_PORT}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000669
670Teardown
671 [Documentation] kills processes and cleans up interfaces on src+dst servers
672 Run Keyword If ${has_dataplane} Clean Up Linux
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000673
674Teardown Suite
675 [Documentation] Clean up device if desired
676 Run Keyword If ${teardown_device} Delete All Devices and Verify
677
678Delete Device and Verify
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800679 [Arguments] ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000680 [Documentation] Disable -> Delete devices via voltctl and verify its removed
Suchitra Vemuri2fa9bba2020-01-22 17:38:48 -0800681 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000682 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800683 ... voltctl -c ${VOLTCTL_CONFIG} device disable ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000684 Should Be Equal As Integers ${rc} 0
685 Sleep 5s
686 Wait Until Keyword Succeeds ${timeout} 5s
687 ... Validate OLT Device DISABLED UNKNOWN REACHABLE ${olt_serial_number}
688 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800689 ... voltctl -c ${VOLTCTL_CONFIG} device delete ${olt_device_id}
Hardik Windlassdf5035e2021-01-27 08:34:59 +0000690 Sleep 50s
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000691 Should Be Equal As Integers ${rc} 0
692 Wait Until Keyword Succeeds ${timeout} 5s Validate Device Removed ${olt_device_id}
Hardik Windlasse8b99222021-01-25 10:03:14 +0000693 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 15s
694 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000695
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000696Repeat Sanity Test
697 [Documentation] This keyword performs Sanity Test Procedure
698 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
699 ... This keyword can be used to call in any other tests where sanity check is required
700 ... with wpa reassociation
701 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
702 Set Global Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800703 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000704 ${src}= Set Variable ${hosts.src[${I}]}
705 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800706 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
707 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
708 # Check ONU port is Enabled in ONOD
709 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700710 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800711 # Verify EAPOL flows are added for the ONU port
712 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800713 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800714 # Verify ONU state in voltha
Suchitra Vemurid1e27fb2020-02-01 16:34:37 -0800715 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri81e4f022020-02-01 13:16:02 -0800716 ... ENABLED ACTIVE REACHABLE
717 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800718 # Perform Authentication
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000719 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
720 ... Validate Authentication After Reassociate
721 ... True ${src['dp_iface_name']} ${src['ip']} ${src['user']} ${src['pass']}
722 ... ${src['container_type']} ${src['container_name']}
723 Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800724 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000725 Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800726 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000727 ... volt-add-subscriber-access ${of_id} ${onu_port}
728 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
729 ... Validate DHCP and Ping True True
730 ... ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
731 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
732 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
733 ... ${dst['container_name']}
734 Wait Until Keyword Succeeds ${timeout} 2s Run Keyword And Continue On Failure
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800735 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000736 END
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +0000737
Hardik Windlass41701e82021-01-12 17:44:44 +0000738Disable Enable PON Port Per OLT
739 [Arguments] ${olt_serial_number}
740 [Documentation] This keyword disables and then enables OLT PON port and
741 ... also validate ONUs for each corresponding case
742 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
743 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
744 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
745 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
746 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
747 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
748 # Disable the OLT PON Port and Validate OLT Device
749 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
750 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
751 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
752 ... DISABLED DISCOVERED
753 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
754 ... Validate OLT Device ENABLED ACTIVE REACHABLE
755 ... ${olt_serial_number}
756 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
757 ... Validate ONUs for PON OLT Disable ${olt_serial_number} ${olt_peer_list}
758 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
759 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
760 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
761 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
762 ... ENABLED ACTIVE
763 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
764 ... Validate ONUs for PON OLT Enable ${olt_serial_number} ${olt_peer_list}
765 END
766
Hardik Windlass16cdf962020-04-29 15:26:50 +0530767Validate ONUs for PON OLT Disable
Hardik Windlass41701e82021-01-12 17:44:44 +0000768 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530769 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
770 ... And Pings succeed for other Active OLT PON port ONUs
771 ... Also it removes subscriber for Disabled OLT PON port ONUs to replicate ATT workflow
Hardik Windlass41701e82021-01-12 17:44:44 +0000772 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530773 ${src}= Set Variable ${hosts.src[${I}]}
774 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000775 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530776 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000777 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530778 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
779 ... ${of_id}
780 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
781 Run Keyword If ${matched}
782 ... Run Keywords
783 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
784 ... Validate Device ENABLED DISCOVERED
Hardik Windlass41701e82021-01-12 17:44:44 +0000785 ... UNREACHABLE ${src['onu']} onu=True onu_reason=omci-flows-deleted
Hardik Windlass16cdf962020-04-29 15:26:50 +0530786 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
787 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
788 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
789 ... Wait Until Keyword Succeeds 60s 2s
790 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
791 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
792 ... ${src['container_name']}
793 # Remove Subscriber Access (To replicate ATT workflow)
794 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
795 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
796 ... ELSE
797 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
798 ... Wait Until Keyword Succeeds 60s 2s
799 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
800 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
801 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530802 END
803
804Validate ONUs for PON OLT Enable
Hardik Windlass41701e82021-01-12 17:44:44 +0000805 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530806 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
807 ... Also performs Auth/subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800808 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530809 ${src}= Set Variable ${hosts.src[${I}]}
810 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000811 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530812 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000813 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530814 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
815 ... ${of_id}
816 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
817 ${wpa_log}= Run Keyword If ${has_dataplane} and ${matched} Catenate SEPARATOR=.
818 ... /tmp/wpa ${src['dp_iface_name']} log
819 Run Keyword If ${matched}
820 ... Run Keywords
821 # Perform Cleanup
822 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
823 # Verify ONU port status
824 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
825 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
826 # Verify EAPOL flows are added for the ONU port
827 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
828 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
829 # Verify ONU state in voltha
830 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
831 ... Validate Device ENABLED ACTIVE REACHABLE
832 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
833 # Perform Authentication
834 ... AND Run Keyword If ${has_dataplane}
835 ... Run Keyword And Continue On Failure Validate Authentication True
836 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
837 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
838 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
839 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
840 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
841 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
842 ... volt-add-subscriber-access ${of_id} ${onu_port}
843 # Verify that no pending flows exist for the ONU port
844 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
845 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
846 # Verify subscriber access flows are added for the ONU port
847 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
848 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
849 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
850 ... AND Run Keyword If ${has_dataplane}
851 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
852 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
853 ... ${src['ip']} ${src['user']} ${src['pass']}
854 ... ${src['container_type']} ${src['container_name']}
855 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
856 ... ${dst['container_type']} ${dst['container_name']}
857 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
858 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
859 ... AND Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
860 ... ELSE
861 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
862 ... Wait Until Keyword Succeeds 60s 2s
863 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
864 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
865 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530866 END
867
Hardik Windlass41701e82021-01-12 17:44:44 +0000868Disable Enable PON Port Per OLT DT
869 [Arguments] ${olt_serial_number}
870 [Documentation] This keyword disables and then enables OLT PON port and
871 ... also validate ONUs for each corresponding case
872 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
873 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
874 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
875 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
876 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
877 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
878 # Disable the OLT PON Port and Validate OLT Device
879 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
880 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
881 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
882 ... DISABLED DISCOVERED
883 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
884 ... Validate OLT Device ENABLED ACTIVE REACHABLE
885 ... ${olt_serial_number}
886 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
887 ... Validate ONUs for PON OLT Disable DT ${olt_serial_number} ${olt_peer_list}
Hardik Windlass41701e82021-01-12 17:44:44 +0000888 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
889 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
890 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
891 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
892 ... ENABLED ACTIVE
893 # Waiting extra time for the ONUs to come up
Hardik Windlass5e214b22021-02-26 10:37:14 +0000894 Sleep 30s
Hardik Windlass41701e82021-01-12 17:44:44 +0000895 ${olt_peer_list_new}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
896 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
897 ... Validate ONUs for PON OLT Enable DT ${olt_serial_number} ${olt_peer_list_new}
898 END
899
Hardik Windlass16cdf962020-04-29 15:26:50 +0530900Validate ONUs for PON OLT Disable DT
Hardik Windlass41701e82021-01-12 17:44:44 +0000901 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530902 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
903 ... And Pings succeed for other Active OLT PON port ONUs
904 ... Also it removes subscriber and deletes ONUs for Disabled OLT PON port to replicate DT workflow
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800905 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530906 ${src}= Set Variable ${hosts.src[${I}]}
907 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000908 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530909 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000910 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530911 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
912 ... ${of_id}
913 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
914 Run Keyword If ${matched}
915 ... Run Keywords
916 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
917 ... Validate Device ENABLED DISCOVERED
918 ... UNREACHABLE ${src['onu']} onu=True onu_reason=stopping-openomci
919 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
920 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
921 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
922 ... Wait Until Keyword Succeeds 60s 2s
923 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
924 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
925 ... ${src['container_name']}
926 # Remove Subscriber Access (To replicate DT workflow)
927 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
928 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530929 # Delete ONU Device (To replicate DT workflow)
930 ... AND Delete Device ${onu_device_id}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530931 ... ELSE
932 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
933 ... Wait Until Keyword Succeeds 60s 2s
934 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
935 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
936 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530937 END
938
939Validate ONUs for PON OLT Enable DT
Hardik Windlass41701e82021-01-12 17:44:44 +0000940 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530941 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
942 ... Also performs subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800943 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530944 ${src}= Set Variable ${hosts.src[${I}]}
945 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000946 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530947 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000948 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530949 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
950 ... ${of_id}
951 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
952 Run Keyword If ${matched}
953 ... Run Keywords
954 # Perform Cleanup
955 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
956 # Verify ONU port status
957 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
958 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
959 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
960 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
961 ... volt-add-subscriber-access ${of_id} ${onu_port}
962 # Verify ONU state in voltha
963 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
964 ... Validate Device ENABLED ACTIVE REACHABLE
965 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
966 # Verify subscriber access flows are added for the ONU port
967 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
968 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
969 ... ${onu_port} ${nni_port} ${src['s_tag']}
970 ... AND Run Keyword If ${has_dataplane}
971 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
972 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
973 ... ${src['ip']} ${src['user']} ${src['pass']}
974 ... ${src['container_type']} ${src['container_name']}
975 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
976 ... ${dst['container_type']} ${dst['container_name']}
977 ... ELSE
978 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
979 ... Wait Until Keyword Succeeds 60s 2s
980 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
981 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
982 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530983 END
984
985Match ONU in PON OLT Peer List
986 [Arguments] ${olt_peer_list} ${onu_device_id}
987 [Documentation] This keyword matches if ONU device is present in OLT PON port peer list
988 ${matched}= Set Variable False
989 FOR ${olt_peer} IN @{olt_peer_list}
990 ${matched}= Set Variable If '${onu_device_id}' == '${olt_peer}' True False
991 Exit For Loop If ${matched}
992 END
993 [Return] ${matched}
994
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +0000995Collect Logs
996 [Documentation] Collect Logs from voltha and onos cli for various commands
997 Run Keyword and Ignore Error Get Device List from Voltha
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800998 FOR ${I} IN RANGE 0 ${num_olts}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800999 Run Keyword and Ignore Error Get Device Output from Voltha ${olt_ids}[${I}][device_id]
1000 Run Keyword and Ignore Error Get Logical Device Output from Voltha ${olt_ids}[${I}][logical_id]
1001 END
1002 #Run Keyword and Ignore Error Get Device Output from Voltha ${olt_device_id}
1003 #Run Keyword and Ignore Error Get Logical Device Output from Voltha ${logical_id}
ubuntu6b6e7d42020-03-02 12:35:42 -08001004 Get ONOS Status ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001005
1006Verify ping is succesful except for given device
1007 [Arguments] ${num_onus} ${exceptional_onu_id}
1008 [Documentation] Checks that ping for all the devices are successful except the given ONU.
1009 ${pingStatus} Set Variable True
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001010 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001011 ${src}= Set Variable ${hosts.src[${I}]}
1012 ${dst}= Set Variable ${hosts.dst[${I}]}
1013 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1014 ${pingStatus} Run Keyword If '${onu_device_id}' == '${exceptional_onu_id}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001015 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1016 ... Wait Until Keyword Succeeds 60s 2s
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001017 ... Check Ping ${pingStatus} ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1018 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1019 END
Andy Bavier4a8450e2020-02-04 08:58:37 -07001020
Suchitra Vemurife309412020-12-01 19:19:52 -08001021Verify ping is successful for ONUs not on this OLT
1022 [Arguments] ${num_all_onus} ${exceptional_olt_id}
1023 [Documentation] Checks that pings work for all the ONUs except for the ONUs on the given OLT.
1024 #${pingStatus} Set Variable True
1025 FOR ${I} IN RANGE 0 ${num_all_onus}
1026 ${src}= Set Variable ${hosts.src[${I}]}
1027 ${dst}= Set Variable ${hosts.dst[${I}]}
1028 ${olt_device_id}= Get Device ID From SN ${src['olt']}
1029 Continue For Loop If "${olt_device_id}"=="${exceptional_olt_id}"
1030 #${pingStatus} Run Keyword If '${olt_device_id}' == '${exceptional_olt_id}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001031 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1032 ... Wait Until Keyword Succeeds 60s 2s
Suchitra Vemurife309412020-12-01 19:19:52 -08001033 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1034 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1035 END
1036
Andy Bavier1923ecc2020-06-18 14:06:40 -07001037Echo Message to OLT Logs
1038 [Arguments] ${message}
1039 [Documentation] Echoes ${message} into the OLT logs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001040 FOR ${I} IN RANGE 0 ${num_olts}
1041 ${olt_user} Evaluate ${olts}[${I}].get("user")
1042 ${olt_pass} Evaluate ${olts}[${I}].get("pass")
1043 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanellaebf6f0d2021-01-12 13:10:29 +01001044 Continue For Loop If "${olt_user}" == "${None}"
1045 Continue For Loop If "${olt_pass}" == "${None}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001046 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1047 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt.log
1048 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1049 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1050 ... printf '%s\n' '' '' '${message}' '' >> /var/log/dev_mgmt_daemon.log
1051 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1052 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1053 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt_process_watchdog.log
1054 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1055 END
Andy Bavier1923ecc2020-06-18 14:06:40 -07001056
Andy Bavierabeba262020-02-07 16:22:16 -07001057Start Logging
1058 [Arguments] ${label}
1059 [Documentation] Start logging for test ${label}
1060 ${kail_process}= Run Keyword If "${container_log_dir}" != "${None}" Start Process kail -n default
1061 ... -n voltha cwd=${container_log_dir} stdout=${label}-combined.log
1062 Set Test Variable ${kail_process}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001063 Run Keyword If ${has_dataplane} Echo Message to OLT Logs START ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001064
1065Stop Logging
1066 [Arguments] ${label}
1067 [Documentation] End logging for test; remove logfile if test passed
1068 Run sync
1069 Run Keyword If ${kail_process} Terminate Process ${kail_process}
1070 ${test_logfile}= Run Keyword If "${container_log_dir}" != "${None}"
1071 ... Join Path ${container_log_dir} ${label}-combined.log
1072 Run Keyword If Test Passed Run Keyword If "${test_logfile}" != "${None}" Remove File ${test_logfile}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001073 Run Keyword If ${has_dataplane} Echo Message to OLT Logs END ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001074
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001075Clean Up Linux
1076 [Documentation] Kill processes and clean up interfaces on src+dst servers
Hardik Windlass16cdf962020-04-29 15:26:50 +05301077 [Arguments] ${onu_id}=${EMPTY}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001078 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001079 ${src}= Set Variable ${hosts.src[${I}]}
1080 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301081 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1082 Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
Andy Bavier84b83282020-06-30 05:47:49 -07001083 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001084 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001085 Execute Remote Command sudo pkill dhclient ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001086 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Baviereff938d2020-06-29 18:27:49 -07001087 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1088 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1089 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1090 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001091 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1092 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1093 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1094 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1095 ... ${dst['container_type']} ${dst['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001096 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1097 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1098 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
Andy Bavierf4b7d1d2020-06-30 11:14:04 -07001099 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1100 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
Andy Baviereff938d2020-06-29 18:27:49 -07001101 ... ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001102 END
Scott Baker60e570d2020-02-02 22:10:13 -08001103
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001104Clean Up Linux Per OLT
1105 [Documentation] Kill processes and clean up interfaces on src+dst servers
1106 [Arguments] ${olt_serial_number}
1107 FOR ${I} IN RANGE 0 ${num_all_onus}
1108 ${src}= Set Variable ${hosts.src[${I}]}
1109 ${dst}= Set Variable ${hosts.dst[${I}]}
1110 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1111 ${sn}= Get Device ID From SN ${src['olt']}
1112 #Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
1113 Continue For Loop If '${olt_serial_number}' == '${sn}'
1114 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
1115 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1116 Execute Remote Command sudo pkill dhclient ${src['ip']}
1117 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1118 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1119 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1120 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1121 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
1122 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1123 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1124 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1125 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1126 ... ${dst['container_type']} ${dst['container_name']}
1127 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1128 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1129 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
1130 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1131 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
1132 ... ${dst['container_type']} ${dst['container_name']}
1133 END
1134
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001135Clean dhclient
1136 [Documentation] Kills dhclient processes only for all RGs
Hardik Windlass41701e82021-01-12 17:44:44 +00001137 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001138 ${src}= Set Variable ${hosts.src[${I}]}
1139 ${dst}= Set Variable ${hosts.dst[${I}]}
1140 Execute Remote Command sudo pkill dhclient ${src['ip']}
1141 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1142 END
1143
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001144Clean WPA Process
1145 [Documentation] Kills wpa_supplicant processes only for all RGs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001146 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001147 ${src}= Set Variable ${hosts.src[${I}]}
1148 ${dst}= Set Variable ${hosts.dst[${I}]}
1149 Run Keyword And Ignore Error Kill Linux Process [w]pa_supplicant ${src['ip']}
1150 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1151 END
1152
Scott Baker60e570d2020-02-02 22:10:13 -08001153Should Be Larger Than
1154 [Documentation] Verify that value_1 is > value_2
1155 [Arguments] ${value_1} ${value_2}
1156 Run Keyword If ${value_1} <= ${value_2}
1157 ... Fail The value ${value_1} is not larger than ${value_2}
1158
Scott Bakeree675552020-02-11 10:43:34 -08001159Should Be Larger Than Or Equal To
1160 [Documentation] Verify that value_1 is >= value_2
1161 [Arguments] ${value_1} ${value_2}
1162 Run Keyword If ${value_1} < ${value_2}
1163 ... Fail The value ${value_1} is not larger than or equal to ${value_2}
1164
Scott Baker60e570d2020-02-02 22:10:13 -08001165Should Be Float
1166 [Documentation] Verify that value is a floating point number type
1167 [Arguments] ${value}
1168 ${type} Evaluate type(${value}).__name__
1169 Should Be Equal ${type} float
1170
Scott Bakeree675552020-02-11 10:43:34 -08001171Should Be Newer Than Or Equal To
1172 [Documentation] Compare two RFC3339 dates
1173 [Arguments] ${value_1} ${value_2}
1174 ${unix_v1} Parse RFC3339 ${value_1}
1175 ${unix_v2} Parse RFC3339 ${value_2}
1176 Run Keyword If ${unix_v1} < ${unix_v2}
1177 ... Fail The value ${value_1} is not newer than or equal to ${value_2}
1178
Scott Baker60e570d2020-02-02 22:10:13 -08001179Get Current Time
1180 [Documentation] Return the current time in RFC3339 format
1181 ${output}= Run date -u +"%FT%T%:z"
1182 [return] ${output}
Scott Bakeree675552020-02-11 10:43:34 -08001183
1184Parse RFC3339
1185 [Documentation] Parse an RFC3339 timestamp
1186 [Arguments] ${dateStr}
1187 ${rc} ${output}= Run and Return Rc and Output date --date="${dateStr}" "+%s"
1188 Should Be Equal As Numbers ${rc} 0
1189 [return] ${output}
Matteo Scandolo142e6272020-04-29 17:36:59 -07001190
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001191Get Bandwidth Profile Name For Given Subscriber
1192 [Arguments] ${subscriber_id} ${stream_type}=upstreamBandwidthProfile
1193 [Documentation] Keyword to get the bandwidth details of the given subscriber
1194 ${bandwidth_profile_output}= Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
1195 ... volt-programmed-subscribers | grep ${subscriber_id}
1196 @{bandwidth_profile_array}= Split String ${bandwidth_profile_output} ,
1197 Log ${bandwidth_profile_array}
1198 FOR ${value} IN @{bandwidth_profile_array}
1199 @{row_value}= Split String ${value} =
1200 ${bandwidth_profile_name}= Set Variable If '${row_value[0]}' == ' ${stream_type}'
1201 ... ${row_value[1]}
1202 ${bandwidth_profile_name}= Convert To String ${bandwidth_profile_name}
1203 Run Keyword If "${bandwidth_profile_name}" != "None" Exit For Loop
1204 END
1205 Log ${bandwidth_profile_name}
1206 [Return] ${bandwidth_profile_name}
1207
1208Execute Remote Command
1209 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1210 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1211 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
Andy Baviereff938d2020-06-29 18:27:49 -07001212 ... ${container_type}=${None} ${container_name}=${None} ${timeout}=${None}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001213 ${conn_id}= SSHLibrary.Open Connection ${ip}
1214 Run Keyword If '${pass}' != '${None}'
1215 ... SSHLibrary.Login ${user} ${pass}
1216 ... ELSE
1217 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1218 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1219 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001220 ${stdout} ${stderr} ${rc}= Run Keyword If '${container_type}' == 'LXC'
1221 ... SSHLibrary.Execute Command lxc exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001222 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001223 ... ELSE IF '${container_type}' == 'K8S'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001224 ... SSHLibrary.Execute Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001225 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001226 ... ELSE
Andy Baviereff938d2020-06-29 18:27:49 -07001227 ... SSHLibrary.Execute Command ${cmd} return_stderr=True return_rc=True timeout=${timeout}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001228
1229 Log ${stdout}
1230 Log ${stderr}
1231 Log ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001232 SSHLibrary.Close Connection
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001233 [Return] ${stdout} ${stderr} ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001234
Suraj Gour33651272020-05-04 10:10:16 +05301235Start Remote Command
1236 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1237 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1238 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
1239 ... ${container_type}=${None} ${container_name}=${None}
1240 ${conn_id}= SSHLibrary.Open Connection ${ip}
1241 Run Keyword If '${pass}' != '${None}'
1242 ... SSHLibrary.Login ${user} ${pass}
1243 ... ELSE
1244 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1245 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1246 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
1247 Run Keyword If '${container_type}' == 'LXC'
1248 ... SSHLibrary.Start Command lxc exec ${container_name} -- ${cmd}
1249 ... ELSE IF '${container_type}' == 'K8S'
1250 ... SSHLibrary.Start Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
1251 ... ELSE
1252 ... SSHLibrary.Start Command ${cmd}
Andy Bavier9fb23232020-06-30 15:12:20 -07001253 # It seems that closing the connection immediately will sometimes kill the command
1254 Sleep 1s
Suraj Gour33651272020-05-04 10:10:16 +05301255 SSHLibrary.Close Connection
1256
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001257Run Iperf3 Test Client
1258 [Arguments] ${src} ${server} ${args}
1259 [Documentation] Login to ${src} and run the iperf3 client against ${server} using ${args}.
1260 ... Return a Dictionary containing the results of the test.
Girish Gowdrad769b412021-05-16 11:09:46 -07001261 ${output} ${stderr} ${rc}= Execute Remote Command iperf3 -J -c ${server} ${args} -l 1024 -M 1350 | jq -M -c '.'
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001262 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001263 Should Be Equal As Integers ${rc} 0
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001264 ${object}= Evaluate json.loads(r'''${output}''') json
1265 [Return] ${object}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001266
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -07001267Run Iperf Test Client for MCAST
1268 [Arguments] ${src} ${server} ${args}
1269 [Documentation] Login to ${src} and run the iperf client against ${server} using ${args}.
1270 ... Return a Dictionary containing the results of the test.
1271 ${output} ${stderr} ${rc}= Execute Remote Command sudo iperf -c ${server} ${args} | jq -M -c '.'
1272 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1273 Should Be Equal As Integers ${rc} 0
1274 ${object}= Evaluate json.loads(r'''${output}''') json
1275 [Return] ${object}
1276
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001277RestoreONUs
1278 [Documentation] Restore all connected ONUs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001279 [Arguments] ${num_all_onus}
1280 FOR ${I} IN RANGE 0 ${num_all_onus}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001281 ${src}= Set Variable ${hosts.src[${I}]}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001282 ${container_type}= Get Variable Value ${src['container_type']} "null"
1283 ${container_name}= Get Variable Value ${src['container_name']} "null"
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001284 ${onu_type}= Get Variable Value ${src['onu_type']} "null"
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001285 #Get ens6f0 from ens6f0.22
1286 ${if_name}= Replace String Using Regexp ${src['dp_iface_name']} \\..* \
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001287 Run Keyword IF '${onu_type}' == 'alpha' AlphaONURestoreDefault ${src['ip']} ${src['user']}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001288 ... ${src['pass']} ${if_name} admin admin ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001289 END
1290
1291AlphaONURestoreDefault
1292 [Documentation] Restore the Alpha ONU to factory setting
1293 [Arguments] ${rg_ip} ${rg_user} ${rg_pass} ${onu_ifname}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001294 ... ${onu_user} ${onu_pass} ${container_type}=${None} ${container_name}=${None}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001295 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 192.168.1.3/24
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001296 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
TorstenThieme70bc5262021-01-19 12:12:55 +00001297 ${cmd} Catenate
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001298 ... (echo open "192.168.1.1"; sleep 1;
1299 ... echo "${onu_user}"; sleep 1;
1300 ... echo "${onu_pass}"; sleep 1;
1301 ... echo "restoredefault"; sleep 1) | telnet
1302 ${output}= Login And Run Command On Remote System ${cmd}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001303 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001304 Log To Console ${output}
1305 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 0
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001306 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Suraj Gour33651272020-05-04 10:10:16 +05301307
1308Create traffic with each pbit and capture at other end
1309 [Documentation] Generates upstream traffic using Mausezahn tool
1310 ... with each pbit and validates reception at other end using tcpdump
1311 [Arguments] ${target_ip} ${target_iface} ${src_iface}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001312 ... ${packet_count} ${packet_type} ${vlan} ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301313 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
1314 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
1315 FOR ${pbit} IN RANGE 8
Andy Baviereff938d2020-06-29 18:27:49 -07001316 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301317 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001318 ${var1}= Set Variable sudo mausezahn ${src_iface} -B ${target_ip} -c ${packet_count}
1319 ${var2}= Set Variable -t ${packet_type} "dp=80, flags=rst, p=aa:aa:aa" -Q ${pbit}:${vlan}
Suraj Gour33651272020-05-04 10:10:16 +05301320 ${cmd}= Set Variable ${var1} ${var2}
1321 Start Remote Command ${cmd} ${src_ip} ${src_user} ${src_pass}
1322 ... ${src_container_type} ${src_container_name}
1323 ${output} ${stderr} ${rc}= Execute Remote Command
Andy Baviereff938d2020-06-29 18:27:49 -07001324 ... sudo tcpdump -l -U -c 30 -i ${target_iface} -e ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301325 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
Andy Baviereff938d2020-06-29 18:27:49 -07001326 ... timeout=30 seconds
1327 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301328 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001329 Run Keyword If "${tcpdump_filter}"=="tcp"
Girish Gowdraebeca682021-05-18 14:44:41 -07001330 ... Should Match Regexp ${output} , p ${pbit},
Suraj Gour33651272020-05-04 10:10:16 +05301331 END
TorstenThieme70bc5262021-01-19 12:12:55 +00001332
1333Determine Number Of ONU
1334 [Arguments] ${olt_serial_number}=${EMPTY} ${num_onus}=${num_all_onus}
1335 [Documentation] Determine the number of different ONUs for the given OLT taken from host.src
1336 ${onu_list} Create List
1337 FOR ${INDEX} IN RANGE 0 ${num_onus}
1338 Continue For Loop If "${olt_serial_number}"!="${hosts.src[${INDEX}].olt}" and "${olt_serial_number}"!="${EMPTY}"
1339 ${onu_id}= Get Index From List ${onu_list} ${hosts.src[${INDEX}].onu}
1340 Run Keyword If -1 == ${onu_id} Append To List ${onu_list} ${hosts.src[${INDEX}].onu}
1341 END
1342 ${real_num_onus}= Get Length ${onu_list}
1343 [Return] ${real_num_onus}