blob: 19e9c2d4bafd3fc25a8379f793890f8cdf1ba9fb [file] [log] [blame]
Kailash92764922019-07-25 08:21:39 -07001# Copyright 2017-present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
Kailash92764922019-07-25 08:21:39 -070014# robot test functions
15
16*** Settings ***
17Documentation Library for various utilities
18Library SSHLibrary
Kailash92764922019-07-25 08:21:39 -070019Library String
20Library DateTime
21Library Process
22Library Collections
23Library RequestsLibrary
24Library OperatingSystem
Andy Bavier63460da2020-02-20 14:35:12 -070025Library CORDRobot
26Library ImportResource resources=CORDRobot
TorstenThiemed4f48962020-12-08 12:17:19 +000027Resource ./voltctl.robot
Kailash92764922019-07-25 08:21:39 -070028
29*** Keywords ***
Kailash528f7c02019-07-31 10:55:49 -070030Check CLI Tools Configured
31 [Documentation] Tests that use 'voltctl' and 'kubectl' should execute this keyword in suite setup
32 # check voltctl and kubectl configured
Hardik Windlass13803172021-04-26 08:17:07 +000033 ${voltctl_rc} ${voltctl_output}= Run And Return Rc And Output voltctl device list
34 Log ${voltctl_output}
35 ${kubectl_rc} ${kubectl_output}= Run And Return Rc And Output kubectl get pods
36 Log ${kubectl_output}
Gilles Depatie675a2062019-10-22 12:44:42 -040037 Run Keyword If ${voltctl_rc} != 0 or ${kubectl_rc} != 0 FATAL ERROR
38 ... VOLTCTL and KUBECTL not configured. Please configure before executing tests.
Gilles Depatieb5682f82019-10-31 10:39:45 -040039
40Send File To Onos
Zack Williamsa8fe75a2020-01-10 14:25:27 -070041 [Documentation] Send the content of the file to Onos to selected section of configuration
42 ... using Post Request
43 [Arguments] ${CONFIG_FILE} ${section}
44 ${Headers}= Create Dictionary Content-Type application/json
45 ${File_Data}= OperatingSystem.Get File ${CONFIG_FILE}
46 Log ${Headers}
47 Log ${File_Data}
48 ${resp}= Post Request ONOS
49 ... /onos/v1/network/configuration/${section} headers=${Headers} data=${File_Data}
50 Should Be Equal As Strings ${resp.status_code} 200
Andy Bavier88cd9f62019-11-26 16:22:33 -070051
52Common Test Suite Setup
53 [Documentation] Setup the test suite
Andy Bavier88cd9f62019-11-26 16:22:33 -070054 Set Global Variable ${KUBECTL_CONFIG} export KUBECONFIG=%{KUBECONFIG}
Matteo Scandolo5899be12020-11-11 15:38:07 -080055 Set Global Variable ${VOLTCTL_CONFIG} %{VOLTCONFIG}
Andy Bavier88cd9f62019-11-26 16:22:33 -070056 ${k8s_node_ip}= Evaluate ${nodes}[0].get("ip")
ubuntu6b6e7d42020-03-02 12:35:42 -080057 ${ONOS_REST_IP}= Get Environment Variable ONOS_REST_IP ${k8s_node_ip}
58 ${ONOS_SSH_IP}= Get Environment Variable ONOS_SSH_IP ${k8s_node_ip}
59 Set Global Variable ${ONOS_REST_IP}
60 Set Global Variable ${ONOS_SSH_IP}
Andy Bavier88cd9f62019-11-26 16:22:33 -070061 ${k8s_node_user}= Evaluate ${nodes}[0].get("user")
62 ${k8s_node_pass}= Evaluate ${nodes}[0].get("pass")
63 Check CLI Tools Configured
64 ${onos_auth}= Create List karaf karaf
65 ${HEADERS} Create Dictionary Content-Type=application/json
ubuntu6b6e7d42020-03-02 12:35:42 -080066 Create Session ONOS http://${ONOS_REST_IP}:${ONOS_REST_PORT} auth=${ONOS_AUTH}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080067 ${num_olts} Get Length ${olts}
68 ${list_olts} Create List
Suchitra Vemuriac9785e2021-01-07 16:50:18 -080069 # Create olt list from the configuration file
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080070 FOR ${I} IN RANGE 0 ${num_olts}
71 ${ip} Evaluate ${olts}[${I}].get("ip")
72 ${user} Evaluate ${olts}[${I}].get("user")
73 ${pass} Evaluate ${olts}[${I}].get("pass")
74 ${serial_number} Evaluate ${olts}[${I}].get("serial")
75 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanella3dcce272021-01-15 16:04:47 +010076 ${type} Evaluate ${olts}[${I}].get("type")
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080077 ${orig_olt_port} Evaluate ${olts}[${I}].get("oltPort")
78 ${port}= Set Variable If "${orig_olt_port}" == "None" ${OLT_PORT} ${orig_olt_port}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080079 ${onu_count}= Get ONU Count For OLT ${hosts.src} ${serial_number}
Suchitra Vemurife309412020-12-01 19:19:52 -080080 ${onu_list}= Get ONU List For OLT ${hosts.src} ${serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080081 ${olt} Create Dictionary ip ${ip} user ${user} pass
Andrea Campanella3dcce272021-01-15 16:04:47 +010082 ... ${pass} sn ${serial_number} onucount ${onu_count} type ${type}
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080083 ... sship ${olt_ssh_ip} oltport ${port} onus ${onu_list}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080084 Append To List ${list_olts} ${olt}
85 END
86 ${num_all_onus}= Get Length ${hosts.src}
87 ${num_all_onus}= Convert to String ${num_all_onus}
Andy Bavier88cd9f62019-11-26 16:22:33 -070088 #send sadis file to onos
Andy Baviera2691752019-11-27 12:18:38 -070089 ${sadis_file}= Get Variable Value ${sadis.file}
Zack Williamsa8fe75a2020-01-10 14:25:27 -070090 Log To Console \nSadis File:${sadis_file}
Andy Bavier88cd9f62019-11-26 16:22:33 -070091 Run Keyword Unless '${sadis_file}' is '${None}' Send File To Onos ${sadis_file} apps/
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080092 Set Suite Variable ${num_all_onus}
93 Set Suite Variable ${num_olts}
94 Set Suite Variable ${list_olts}
95 ${olt_count}= Get Length ${list_olts}
96 Set Suite Variable ${olt_count}
Andrea Campanella3dcce272021-01-15 16:04:47 +010097 @{container_list}= Create List ${OLT_ADAPTER_APP_LABEL} adapter-open-onu voltha-api-server
Andy Bavier88cd9f62019-11-26 16:22:33 -070098 ... voltha-ro-core voltha-rw-core-11 voltha-rw-core-12 voltha-ofagent
99 Set Suite Variable ${container_list}
100 ${datetime}= Get Current Date
suraj gour7f6d5fe2019-11-29 10:56:35 +0000101 Set Suite Variable ${datetime}
102
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800103Get ONU Count For OLT
104 [Arguments] ${src} ${serial_number}
105 [Documentation] Gets ONU Count for the specified OLT
106 ${src_length}= Get Length ${src}
107 ${count}= Set Variable 0
108 FOR ${I} IN RANGE 0 ${src_length}
109 ${sn} Evaluate ${src}[${I}].get("olt")
TorstenThiemed4f48962020-12-08 12:17:19 +0000110 ${count}= Run Keyword If '${serial_number}' == '${sn}' Evaluate ${count} + 1
111 ... ELSE Set Variable ${count}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800112 END
113 [Return] ${count}
114
Suchitra Vemurife309412020-12-01 19:19:52 -0800115Get ONU List For OLT
116 [Arguments] ${src} ${serial_number}
117 [Documentation] Gets ONU List for the specified OLT
118 ${src_length}= Get Length ${src}
119 ${onu_list}= Create List
120 FOR ${I} IN RANGE 0 ${src_length}
121 ${sn} Evaluate ${src}[${I}].get("olt")
122 Run Keyword If '${serial_number}' == '${sn}' Append To List ${onu_list} ${src}[${I}].get("onu")
123 ... ELSE Set Variable ${onu_list}
124 END
125 [Return] ${onu_list}
126
suraj gour7f6d5fe2019-11-29 10:56:35 +0000127WPA Reassociate
suraj gour7f6d5fe2019-11-29 10:56:35 +0000128 [Documentation] Executes a particular wpa_cli reassociate, which performs force reassociation
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700129 [Arguments] ${iface} ${ip} ${user} ${pass}=${None}
130 ... ${container_type}=${None} ${container_name}=${None}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000131 #Below for loops are used instead of sleep time, to execute reassociate command and check status
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700132 FOR ${i} IN RANGE 70
133 ${output}= Login And Run Command On Remote System
134 ... wpa_cli -i ${iface} reassociate ${ip} ${user}
135 ... ${pass} ${container_type} ${container_name}
136 ${passed}= Run Keyword And Return Status Should Contain ${output} OK
Andy Bavierb63f6d22020-03-12 15:34:37 -0700137 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700138 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700139 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700140 FOR ${i} IN RANGE 70
141 ${output}= Login And Run Command On Remote System
Andy Bavierae4a17e2020-02-25 14:54:36 -0700142 ... wpa_cli -i ${iface} status | grep SUCCESS ${ip} ${user}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700143 ... ${pass} ${container_type} ${container_name}
144 ${passed}= Run Keyword And Return Status Should Contain ${output} SUCCESS
Andy Bavierb63f6d22020-03-12 15:34:37 -0700145 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700146 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700147 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700148
suraj gour7f6d5fe2019-11-29 10:56:35 +0000149Validate Authentication After Reassociate
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700150 [Arguments] ${auth_pass} ${iface} ${ip} ${user} ${pass}=${None}
151 ... ${container_type}=${None} ${container_name}=${None}
152 [Documentation]
153 ... Executes a particular reassociate request on the RG using wpa_cli.
154 ... auth_pass determines if authentication should pass
Andy Bavier84834d42020-02-25 13:49:50 -0700155 ${wpa_log}= Catenate SEPARATOR=. /tmp/wpa ${iface} log
156 ${output}= Login And Run Command On Remote System truncate -s 0 ${wpa_log}; cat ${wpa_log}
157 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
158 Log ${output}
159 Should Not Contain ${output} authentication completed successfully
suraj gour7f6d5fe2019-11-29 10:56:35 +0000160 WPA Reassociate ${iface} ${ip} ${user} ${pass} ${container_type} ${container_name}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700161 Run Keyword If '${auth_pass}' == 'True' Wait Until Keyword Succeeds ${timeout} 2s
Andy Bavier84834d42020-02-25 13:49:50 -0700162 ... Check Remote File Contents True ${wpa_log} ${iface}.*authentication completed successfully
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700163 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000164 Run Keyword If '${auth_pass}' == 'False' Sleep 20s
Suchitra Vemuri3cb29f82020-02-25 13:59:58 -0800165 Run Keyword If '${auth_pass}' == 'False' Check Remote File Contents False /tmp/wpa.log
Andy Bavier84834d42020-02-25 13:49:50 -0700166 ... ${iface}.*authentication completed successfully ${ip} ${user} ${pass}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700167 ... ${container_type} ${container_name}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000168
169Send Dhclient Request To Release Assigned IP
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700170 [Arguments] ${iface} ${ip} ${user} ${path_dhcpleasefile} ${pass}=${None}
171 ... ${container_type}=${None} ${container_name}=${None}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000172 [Documentation] Executes a dhclient with option to release ip against a particular interface on the RG (src)
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700173 ${result}= Login And Run Command On Remote System
174 ... dhclient -nw -r ${iface} && rm ${path_dhcpleasefile}/dhclient.* ${ip} ${user}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000175 ... ${pass} ${container_type} ${container_name}
176 Log ${result}
177 #Should Contain ${result} DHCPRELEASE
178 [Return] ${result}
suraj gour1ecfae92019-12-20 15:11:40 +0000179
180Check Remote File Contents For WPA Logs
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700181 [Arguments] ${file_should_exist} ${file} ${pattern} ${ip} ${user} ${pass}=${None}
182 ... ${container_type}=${None} ${container_name}=${None} ${prompt}=~$
suraj gour1ecfae92019-12-20 15:11:40 +0000183 [Documentation] Checks for particular pattern count in a file
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700184 ${result}= Login And Run Command On Remote System
185 ... cat ${file} | grep '${pattern}' | wc -l ${ip} ${user} ${pass}
suraj gour1ecfae92019-12-20 15:11:40 +0000186 ... ${container_type} ${container_name} ${prompt}
187 [Return] ${result}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000188
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800189
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000190Perform Sanity Test
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800191 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure
192 ... for all the ONUs connected to each OLT - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000193 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
194 ... In all other (common) cases flag has to be set False (default).
195 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800196 FOR ${J} IN RANGE 0 ${num_olts}
197 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
198 ${onu_count}= Set Variable ${list_olts}[${J}][onucount]
199 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
200 ... ${olt_serial_number}
201 Set Global Variable ${of_id}
202 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
203 ... Get NNI Port in ONOS ${of_id}
204 Set Global Variable ${nni_port}
205 # Verify Default Meter in ONOS (valid only for ATT)
206 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
207 ... Verify Default Meter Present in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
208 Perform Sanity Test Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${onu_count}
TorstenThiemec3c23232021-01-13 13:06:31 +0000209 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800210 END
211
212Perform Sanity Test Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000213 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000214 [Documentation] This keyword performs Sanity Test Procedure
215 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
216 ... This keyword can be used to call in any other tests where sanity check is required
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800217 ... and avoids duplication of code. - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000218 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
219 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800220 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000221 ${src}= Set Variable ${hosts.src[${I}]}
222 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800223 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000224 ${onu_device_id}= Get Device ID From SN ${src['onu']}
225 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
226 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800227 # Check ONU port is Enabled in ONOS
228 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700229 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800230 # Verify EAPOL flows are added for the ONU port
TorstenThiemec3c23232021-01-13 13:06:31 +0000231 Run Keyword Unless ${supress_add_subscriber}
232 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
ubuntu6b6e7d42020-03-02 12:35:42 -0800233 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800234 # Verify ONU state in voltha
235 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
236 ... ENABLED ACTIVE REACHABLE
237 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
238 # Perform Authentication
Andy Bavier84834d42020-02-25 13:49:50 -0700239 ${wpa_log}= Run Keyword If ${has_dataplane} Catenate SEPARATOR=.
240 ... /tmp/wpa ${src['dp_iface_name']} log
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000241 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate Authentication True
242 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
Andy Bavier84834d42020-02-25 13:49:50 -0700243 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000244 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800245 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
TorstenThiemec3c23232021-01-13 13:06:31 +0000246 Run Keyword Unless ${supress_add_subscriber}
247 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800248 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000249 ... volt-add-subscriber-access ${of_id} ${onu_port}
Suchitra Vemuri9da44302020-03-04 14:24:49 -0800250 # Verify that no pending flows exist for the ONU port
251 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
252 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Hardik Windlass21807632020-04-14 16:24:55 +0530253 # Verify subscriber access flows are added for the ONU port
254 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
255 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
256 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530257 # Verify Meters in ONOS
258 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
259 ... Verify Meters in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000260 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
261 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
262 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
263 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
264 ... ${dst['container_name']}
265 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
ubuntu6b6e7d42020-03-02 12:35:42 -0800266 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000267 END
268
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000269Perform Sanity Test DT
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800270 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000271 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
272 ... In all other (common) cases flag has to be set False (default).
273 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800274 FOR ${J} IN RANGE 0 ${num_olts}
275 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
276 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
277 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
278 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
279 ... ${olt_serial_number}
280 Set Global Variable ${of_id}
281 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
282 ... Get NNI Port in ONOS ${of_id}
283 Set Global Variable ${nni_port}
284 Perform Sanity Test DT Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${num_onus}
TorstenThiemec3c23232021-01-13 13:06:31 +0000285 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800286 # Verify ONOS Flows
287 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
288 ${onos_flows_count}= Evaluate 4 * ${num_onus}
289 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
290 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
291 ... ${onos_flows_count}
292 # Verify VOLTHA Flows
293 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
294 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
295 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
296 ${onu_flows}= Set Variable 2
297 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
298 ... ${olt_device_id}
299 ${List_ONU_Serial} Create List
300 Set Suite Variable ${List_ONU_Serial}
Suchitra Vemuri21a47fd2020-11-16 18:39:09 -0800301 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800302 Log ${List_ONU_Serial}
303 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
304 ... ${List_ONU_Serial} ${onu_flows}
305 END
306
307
308Perform Sanity Test DT Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000309 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000310 [Documentation] This keyword performs Sanity Test Procedure for DT Workflow
311 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
312 ... This keyword can be used to call in any other tests where sanity check is required
313 ... and avoids duplication of code.
TorstenThiemec3c23232021-01-13 13:06:31 +0000314 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
315 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800316 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000317 ${src}= Set Variable ${hosts.src[${I}]}
318 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800319 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000320 ${onu_device_id}= Get Device ID From SN ${src['onu']}
321 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
322 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
323 # Check ONU port is Enabled in ONOS
324 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700325 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemec3c23232021-01-13 13:06:31 +0000326 Run Keyword Unless ${supress_add_subscriber}
327 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800328 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000329 ... volt-add-subscriber-access ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530330 # Verify subscriber access flows are added for the ONU port
331 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass25e11702020-03-30 20:05:19 +0530332 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
333 ... ${onu_port} ${nni_port} ${src['s_tag']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000334 # Verify ONU state in voltha
335 ${onu_reasons}= Create List omci-flows-pushed
336 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
337 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000338 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
339 ... ENABLED ACTIVE REACHABLE
TorstenThiemec3c23232021-01-13 13:06:31 +0000340 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530341 # Verify Meters in ONOS
342 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Girish Gowdra21ec25d2021-05-24 10:07:01 -0700343 ... Verify Meters in ONOS Ietf ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530344 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000345 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
346 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
347 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
348 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
349 ... ${dst['container_name']}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000350 END
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800351
352Validate All OLT Flows
353 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
354 FOR ${J} IN RANGE 0 ${num_olts}
355 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
356 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
357 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
358 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
359 ... ${olt_serial_number}
360 Set Global Variable ${of_id}
361 # Verify ONOS Flows
362 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
363 ${onos_flows_count}= Evaluate 4 * ${num_onus}
364 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
365 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
366 ... ${onos_flows_count}
367 # Verify VOLTHA Flows
368 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
369 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
370 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
371 ${onu_flows}= Set Variable 2
372 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
373 ... ${olt_device_id}
374 ${List_ONU_Serial} Create List
375 Set Suite Variable ${List_ONU_Serial}
Andrea Campanella6391f842020-11-16 10:01:18 +0100376 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800377 Log ${List_ONU_Serial}
378 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
379 ... ${List_ONU_Serial} ${onu_flows}
380 END
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000381
TorstenThieme70bc5262021-01-19 12:12:55 +0000382Perform Sanity Tests TT
383 [Documentation] This keyword performs both Sanity Test Procedure for TT Workflow
384 ... Sanity Test TT for HSIA, VoD, VoIP services and Sanity Test TT for MCAST
385 ... For repeating sanity tests without subscriber changes set flag supress_add_subscriber=True.
386 ... In all other (common) cases flag has to be set False (default).
387 [Arguments] ${supress_add_subscriber}=False
388 Perform Sanity Test TT ${supress_add_subscriber}
TorstenThieme136ebf72021-02-26 14:27:07 +0000389 # run of mcast sanity test is currently limited for real HW
390 Run Keyword If ${has_dataplane} Perform Sanity Test TT MCAST ${supress_add_subscriber}
TorstenThieme70bc5262021-01-19 12:12:55 +0000391
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700392Perform Sanity Test TT
393 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
394 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
395 ... This keyword can be used to call in any other tests where sanity check is required
396 ... and avoids duplication of code.
TorstenThieme70bc5262021-01-19 12:12:55 +0000397 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
398 ... In all other (common) cases flag has to be set False (default).
399 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800400 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700401 ${src}= Set Variable ${hosts.src[${I}]}
402 ${dst}= Set Variable ${hosts.dst[${I}]}
403 ${service_type}= Get Variable Value ${src['service_type']} "null"
TorstenThiemea36068c2021-02-19 09:57:32 +0000404 Run Keyword IF '${service_type}' != 'mcast' Sanity Test TT one ONU ${src} ${dst} ${supress_add_subscriber}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700405 END
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000406 # Verify Subscriber Access Flow Count
407 @{particular_onu_device_port}= Create List
408 FOR ${I} IN RANGE 0 ${num_all_onus}
409 ${src}= Set Variable ${hosts.src[${I}]}
410 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
411 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} ${of_id}
412 Append To List ${particular_onu_device_port} ${onu_port}
413 END
414 ${list_onu_port}= Remove Duplicates ${particular_onu_device_port}
415 ${num_of_provisioned_onus}= Get Length ${list_onu_port}
416 FOR ${I} IN RANGE 0 ${olt_count}
417 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
418 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
Hardik Windlass315d6152021-06-09 08:22:44 +0000419 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000420 ${num_onus}= Set Variable ${list_olts}[${I}][onucount]
421 # Verify ONOS Flows
422 # Number of Access Flows on ONOS equals 16 * the Number of Active ONUs + 3 for default LLDP, IGMP and DHCP
423 ${onos_flows_count}= Run Keyword If ${has_dataplane} Evaluate 16 * ${num_of_provisioned_onus} + 3
424 ... ELSE Evaluate 15 * ${num_of_provisioned_onus} + 3
425 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
426 ... Verify Added Flow Count for OLT TT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
427 ... ${onos_flows_count}
428 # Verify VOLTHA Flows
429 # Number of per OLT Flows equals 10 * Number of Active ONUs + 3 for default LLDP, IGMP and DHCP
430 ${olt_flows}= Run Keyword If ${has_dataplane} Evaluate 10 * ${num_of_provisioned_onus} + 3
431 ... ELSE Evaluate 9 * ${num_of_provisioned_onus} + 3
432 # Number of per ONU Flows equals 6 for 3play service data plane + 4 for Trap to Host Flows
433 ${onu_flows}= Run Keyword If ${has_dataplane} Set Variable 10
434 ... ELSE Set Variable 9
435 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
436 ... ${olt_device_id}
437 ${List_ONU_Serial} Create List
438 Set Suite Variable ${List_ONU_Serial}
439 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number} ${num_onus}
440 Log ${List_ONU_Serial}
441 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
442 ... ${List_ONU_Serial} ${onu_flows}
443 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700444
445Sanity Test TT one ONU
446 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
447 ... Tests for one ONU
448 ... Assertions apply to HSIA, VoD, VoIP services
TorstenThieme70bc5262021-01-19 12:12:55 +0000449 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
450 ... In all other (common) cases flag has to be set False (default).
451 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800452 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700453 Set Global Variable ${of_id}
454 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
455 ... Get NNI Port in ONOS ${of_id}
456 Set Global Variable ${nni_port}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700457 ${onu_device_id}= Get Device ID From SN ${src['onu']}
458 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
459 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
460 # Check ONU port is Enabled in ONOS
461 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
462 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000463 Run Keyword Unless ${supress_add_subscriber}
464 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700465 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
466 ... volt-add-subscriber-access ${of_id} ${onu_port}
TorstenThiemea36068c2021-02-19 09:57:32 +0000467 # Verify ONU state in voltha
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000468 ${onu_reasons}= Create List omci-flows-pushed onu-reenabled
TorstenThiemea36068c2021-02-19 09:57:32 +0000469 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
470 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700471 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
472 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800473 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700474 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
475 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
476 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
477 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
478 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
479 ... ${dst['container_name']}
Matteo Scandolo37a6cb72021-01-08 13:55:59 -0800480 Run Keyword IF '${src['service_type']}'!='hsia'
Suchitra Vemuri42819412020-10-01 17:45:43 -0700481 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -0700482 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri42819412020-10-01 17:45:43 -0700483 ... ${src['c_tag']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700484
485Perform Sanity Test TT MCAST
486 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
487 ... Adds subscribers
488 ... Validates for MCAST
TorstenThieme70bc5262021-01-19 12:12:55 +0000489 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
490 ... In all other (common) cases flag has to be set False (default).
491 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800492 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700493 ${src}= Set Variable ${hosts.src[${I}]}
494 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700495 ${service_type}= Get Variable Value ${src['service_type']} "null"
496 Run Keyword IF '${service_type}' == 'mcast' Sanity Test TT MCAST one ONU ${src}
TorstenThiemea36068c2021-02-19 09:57:32 +0000497 ... ${dst} ${supress_add_subscriber}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700498 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700499
500Sanity Test TT MCAST one ONU
501 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
502 ... Tests for one ONU
503 ... Assertions apply to MCAST services
TorstenThieme70bc5262021-01-19 12:12:55 +0000504 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
505 ... In all other (common) cases flag has to be set False (default).
506 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700507 # Check for iperf and jq tools
508 ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf jq
509 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
510 ... ${src['container_name']}
511 Pass Execution If ${rc} != 0 Skipping test: iperf / jq not found on the RG
512
513 #Reset the IP on the interface
514 ${output}= Login And Run Command On Remote System sudo ifconfig ${src['dp_iface_name']} 0
515 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
516 # Kill iperf on BNG
517 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
518 ... sudo kill -9 `pidof iperf`
519 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
520 ... ${dst['container_name']}
521
522 # Setup RG for Multi-cast test
523 ${output}= Login And Run Command On Remote System
524 ... sudo ifconfig ${src['dp_iface_name']} ${src['mcast_rg']} up ; sudo kill -9 `pidof iperf`
525 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
526 ${output}= Login And Run Command On Remote System
527 ... sudo ip route add ${src['mcast_grp_subnet_mask']} dev ${src['dp_iface_name']} scope link
528 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
529
530 # Perform operations for adding subscriber
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800531 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700532 Set Global Variable ${of_id}
533 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
534 ... Get NNI Port in ONOS ${of_id}
535 Set Global Variable ${nni_port}
536 ${onu_device_id}= Get Device ID From SN ${src['onu']}
537 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
538 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
539 # Check ONU port is Enabled in ONOS
540 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
541 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000542 Run Keyword Unless ${supress_add_subscriber}
543 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700544 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
545 ... volt-add-subscriber-access ${of_id} ${onu_port}
TorstenThiemea36068c2021-02-19 09:57:32 +0000546 # Verify ONU state in voltha
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000547 ${onu_reasons}= Create List omci-flows-pushed onu-reenabled
TorstenThiemea36068c2021-02-19 09:57:32 +0000548 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
549 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700550 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
551 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800552 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700553
554 # Setup iperf on the BNG
555 ${server_output}= Login And Run Command On Remote System
556 ... sudo iperf -c ${dst['dp_iface_ip_qinq']} -u -T 32 -t 60 -i 1 &
557 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
558 ... ${dst['container_name']}
559
560 # Setup iperf on the RG
561 ${rg_output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
562 ... Login And Run Command On Remote System
563 ... rm -rf /tmp/rg_output ; sudo iperf -s -u -B ${dst['dp_iface_ip_qinq']} -i 1 -D >> /tmp/rg_output
564 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
565 Log ${rg_output}
566 Sleep 60s
567 ${output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
568 ... Login And Run Command On Remote System
569 ... cat /tmp/rg_output | grep KBytes
570 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
571 Log ${output}
572 Should Contain ${output} KBytes
573
574 # Kill iperf on BNG
575 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
576 ... sudo kill -9 `pidof iperf`
577 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
578 ... ${dst['container_name']}
579
580 # Kill iperf on the RG
581 ${output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
582 ... sudo kill -9 `pidof iperf`
583 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
584
Hardik Windlass62db9d92021-05-17 09:32:40 +0000585Setup Soak
586 [Documentation] Pre-test Setup for Soak Job
587 ${olt_ids} Create List
588 FOR ${I} IN RANGE 0 ${num_olts}
589 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
590 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
591 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
592 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
593 ... ${olt_serial_number}
594 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
595 ... Get NNI Port in ONOS ${of_id}
596 Set Global Variable ${nni_port}
597 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
598 ... of_id ${of_id} sn ${olt_serial_number}
599 Append To List ${olt_ids} ${olt}
600 END
601 Set Global Variable ${olt_ids}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700602
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000603Setup
604 [Documentation] Pre-test Setup
Hardik Windlass4ed54502021-05-14 07:34:15 +0000605 [Arguments] ${skip_empty_device_list_test}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000606 #test for empty device list
Hardik Windlass4ed54502021-05-14 07:34:15 +0000607 Run Keyword If '${skip_empty_device_list_test}'=='False' Test Empty Device List
Hardik Windlass5e214b22021-02-26 10:37:14 +0000608 # TBD: Need for this Sleep
609 Run Keyword If ${has_dataplane} Sleep 180s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800610 # Create a list of olt ids (logical and device_id)
611 ${olt_ids} Create List
612 FOR ${I} IN RANGE 0 ${num_olts}
613 #create/preprovision device
Andrea Campanella3dcce272021-01-15 16:04:47 +0100614 ${olt_device_id}= Run Keyword If "${list_olts}[${I}][type]" == "${None}"
Suchitra Vemuri09f878d2021-02-10 18:19:04 -0800615 ... Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport]
616 ... ELSE Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport] ${list_olts}[${I}][type]
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800617 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
618 #Set Suite Variable ${olt_device_id}
619 #validate olt states
620 Wait Until Keyword Succeeds ${timeout} 5s
621 ... Validate OLT Device PREPROVISIONED UNKNOWN UNKNOWN ${olt_device_id}
622 Sleep 5s
623 Enable Device ${olt_device_id}
Suchitra Vemuricf6e89c2021-03-24 19:14:15 -0700624 # Increasing the timer to incorporate wait time for in-band
625 Wait Until Keyword Succeeds 540s 5s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800626 ... Validate OLT Device ENABLED ACTIVE REACHABLE ${olt_serial_number}
627 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
628 # Set Suite Variable ${logical_id}
629 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
630 ... ${olt_serial_number}
631 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
632 ... of_id ${of_id} sn ${olt_serial_number}
633 Append To List ${olt_ids} ${olt}
634 END
635 Set Global Variable ${olt_ids}
636
637Get ofID From OLT List
638 [Documentation] Retrieves the corresponding of_id for the OLT serial number specified
639 [Arguments] ${serial_number}
640 FOR ${I} IN RANGE 0 ${olt_count}
641 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100642 ${of_id}= Run Keyword IF "${serial_number}"=="${sn}"
643 ... Get From Dictionary ${olt_ids}[${I}] of_id ELSE Set Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800644 END
645 [Return] ${of_id}
646
647Get OLTDeviceID From OLT List
648 [Documentation] Retrieves the corresponding olt_device_id for the OLT serial number specified
649 [Arguments] ${serial_number}
Suchitra Vemuri4b8f4f52020-11-17 19:12:50 -0800650 ${olt_device_id}= Set Variable 0
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800651 FOR ${I} IN RANGE 0 ${olt_count}
652 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100653 ${olt_device_id}= Run Keyword IF "${serial_number}"=="${sn}"
654 ... Get From Dictionary ${olt_ids}[${I}] device_id ELSE Set Variable ${olt_device_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800655 END
656 [Return] ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000657
Andrea Campanellad848de02020-11-24 10:23:41 +0100658Get Num of Onus From OLT SN
659 [Documentation] Retrieves the corresponding number of ONUs for a given OLT based on serial number specified
660 [Arguments] ${serial_number}
661 ${num_of_olt_onus}= Set Variable 0
662 FOR ${I} IN RANGE 0 ${olt_count}
663 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
664 ${num_of_olt_onus}= Run Keyword IF "${serial_number}"=="${sn}"
665 ... Get From Dictionary ${list_olts}[${I}] onucount ELSE Set Variable ${num_of_olt_onus}
666 END
667 [Return] ${num_of_olt_onus}
668
Hardik Windlassaaea3402020-03-10 19:45:45 +0530669Validate ONUs After OLT Disable
670 [Documentation] Validates the ONUs state in Voltha, ONUs port state in ONOS
671 ... and that pings do not succeed After corresponding OLT is Disabled
Andrea Campanella4e507882020-11-26 11:33:11 +0100672 [Arguments] ${num_onus} ${olt_serial_number}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530673 FOR ${I} IN RANGE 0 ${num_onus}
674 ${src}= Set Variable ${hosts.src[${I}]}
675 ${dst}= Set Variable ${hosts.dst[${I}]}
Andrea Campanella4e507882020-11-26 11:33:11 +0100676 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800677 ${of_id}= Get ofID From OLT List ${src['olt']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530678 ${onu_device_id}= Get Device ID From SN ${src['onu']}
679 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
680 ... ${of_id}
681 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
682 ... Validate Device ENABLED DISCOVERED
683 ... UNREACHABLE ${src['onu']} onu=True onu_reason=stopping-openomci
684 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700685 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530686 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
687 ... Wait Until Keyword Succeeds 60s 2s
688 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
689 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530690 END
691
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000692Delete All Devices and Verify
693 [Documentation] Remove any devices from VOLTHA and ONOS
694 # Clear devices from VOLTHA
695 Disable Devices In Voltha Root=true
696 Wait Until Keyword Succeeds ${timeout} 2s Test Devices Disabled In Voltha Root=true
697 Delete Devices In Voltha Root=true
698 Wait Until Keyword Succeeds ${timeout} 2s Test Empty Device List
Hardik Windlasse8b99222021-01-25 10:03:14 +0000699 FOR ${I} IN RANGE 0 ${num_olts}
700 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
TorstenThieme9bd8b9a2021-03-11 15:00:43 +0000701 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlasse8b99222021-01-25 10:03:14 +0000702 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
703 END
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000704 # Clear devices from ONOS
Suchitra Vemurif7a033c2020-02-26 17:22:41 -0800705 #Remove All Devices From ONOS
ubuntu6b6e7d42020-03-02 12:35:42 -0800706 #... http://karaf:karaf@${ONOS_REST_IP}:${ONOS_REST_PORT}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000707
708Teardown
709 [Documentation] kills processes and cleans up interfaces on src+dst servers
710 Run Keyword If ${has_dataplane} Clean Up Linux
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000711
712Teardown Suite
713 [Documentation] Clean up device if desired
714 Run Keyword If ${teardown_device} Delete All Devices and Verify
715
716Delete Device and Verify
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800717 [Arguments] ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000718 [Documentation] Disable -> Delete devices via voltctl and verify its removed
Suchitra Vemuri2fa9bba2020-01-22 17:38:48 -0800719 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000720 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800721 ... voltctl -c ${VOLTCTL_CONFIG} device disable ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000722 Should Be Equal As Integers ${rc} 0
723 Sleep 5s
724 Wait Until Keyword Succeeds ${timeout} 5s
725 ... Validate OLT Device DISABLED UNKNOWN REACHABLE ${olt_serial_number}
726 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800727 ... voltctl -c ${VOLTCTL_CONFIG} device delete ${olt_device_id}
Hardik Windlassdf5035e2021-01-27 08:34:59 +0000728 Sleep 50s
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000729 Should Be Equal As Integers ${rc} 0
730 Wait Until Keyword Succeeds ${timeout} 5s Validate Device Removed ${olt_device_id}
Hardik Windlasse8b99222021-01-25 10:03:14 +0000731 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 15s
732 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000733
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000734Repeat Sanity Test
735 [Documentation] This keyword performs Sanity Test Procedure
736 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
737 ... This keyword can be used to call in any other tests where sanity check is required
738 ... with wpa reassociation
739 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
740 Set Global Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800741 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000742 ${src}= Set Variable ${hosts.src[${I}]}
743 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800744 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
745 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
746 # Check ONU port is Enabled in ONOD
747 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700748 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800749 # Verify EAPOL flows are added for the ONU port
750 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800751 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800752 # Verify ONU state in voltha
Suchitra Vemurid1e27fb2020-02-01 16:34:37 -0800753 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri81e4f022020-02-01 13:16:02 -0800754 ... ENABLED ACTIVE REACHABLE
755 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800756 # Perform Authentication
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000757 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
758 ... Validate Authentication After Reassociate
759 ... True ${src['dp_iface_name']} ${src['ip']} ${src['user']} ${src['pass']}
760 ... ${src['container_type']} ${src['container_name']}
761 Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800762 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000763 Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800764 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000765 ... volt-add-subscriber-access ${of_id} ${onu_port}
766 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
767 ... Validate DHCP and Ping True True
768 ... ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
769 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
770 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
771 ... ${dst['container_name']}
772 Wait Until Keyword Succeeds ${timeout} 2s Run Keyword And Continue On Failure
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800773 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000774 END
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +0000775
Hardik Windlass41701e82021-01-12 17:44:44 +0000776Disable Enable PON Port Per OLT
777 [Arguments] ${olt_serial_number}
778 [Documentation] This keyword disables and then enables OLT PON port and
779 ... also validate ONUs for each corresponding case
780 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
781 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
782 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
783 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
784 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
785 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
786 # Disable the OLT PON Port and Validate OLT Device
787 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
788 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
789 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
790 ... DISABLED DISCOVERED
791 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
792 ... Validate OLT Device ENABLED ACTIVE REACHABLE
793 ... ${olt_serial_number}
794 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
795 ... Validate ONUs for PON OLT Disable ${olt_serial_number} ${olt_peer_list}
796 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
797 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
798 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
799 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
800 ... ENABLED ACTIVE
801 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
802 ... Validate ONUs for PON OLT Enable ${olt_serial_number} ${olt_peer_list}
803 END
804
Hardik Windlass16cdf962020-04-29 15:26:50 +0530805Validate ONUs for PON OLT Disable
Hardik Windlass41701e82021-01-12 17:44:44 +0000806 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530807 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
808 ... And Pings succeed for other Active OLT PON port ONUs
809 ... Also it removes subscriber for Disabled OLT PON port ONUs to replicate ATT workflow
Hardik Windlass41701e82021-01-12 17:44:44 +0000810 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530811 ${src}= Set Variable ${hosts.src[${I}]}
812 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000813 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530814 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000815 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530816 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
817 ... ${of_id}
818 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
819 Run Keyword If ${matched}
820 ... Run Keywords
821 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
822 ... Validate Device ENABLED DISCOVERED
Hardik Windlass41701e82021-01-12 17:44:44 +0000823 ... UNREACHABLE ${src['onu']} onu=True onu_reason=omci-flows-deleted
Hardik Windlass16cdf962020-04-29 15:26:50 +0530824 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
825 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
826 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
827 ... Wait Until Keyword Succeeds 60s 2s
828 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
829 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
830 ... ${src['container_name']}
831 # Remove Subscriber Access (To replicate ATT workflow)
832 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
833 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
834 ... ELSE
835 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
836 ... Wait Until Keyword Succeeds 60s 2s
837 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
838 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
839 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530840 END
841
842Validate ONUs for PON OLT Enable
Hardik Windlass41701e82021-01-12 17:44:44 +0000843 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530844 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
845 ... Also performs Auth/subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800846 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530847 ${src}= Set Variable ${hosts.src[${I}]}
848 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000849 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530850 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000851 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530852 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
853 ... ${of_id}
854 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
855 ${wpa_log}= Run Keyword If ${has_dataplane} and ${matched} Catenate SEPARATOR=.
856 ... /tmp/wpa ${src['dp_iface_name']} log
857 Run Keyword If ${matched}
858 ... Run Keywords
859 # Perform Cleanup
860 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
861 # Verify ONU port status
862 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
863 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
864 # Verify EAPOL flows are added for the ONU port
865 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
866 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
867 # Verify ONU state in voltha
868 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
869 ... Validate Device ENABLED ACTIVE REACHABLE
870 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
871 # Perform Authentication
872 ... AND Run Keyword If ${has_dataplane}
873 ... Run Keyword And Continue On Failure Validate Authentication True
874 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
875 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
876 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
877 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
878 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
879 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
880 ... volt-add-subscriber-access ${of_id} ${onu_port}
881 # Verify that no pending flows exist for the ONU port
882 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
883 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
884 # Verify subscriber access flows are added for the ONU port
885 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
886 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
887 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
888 ... AND Run Keyword If ${has_dataplane}
889 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
890 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
891 ... ${src['ip']} ${src['user']} ${src['pass']}
892 ... ${src['container_type']} ${src['container_name']}
893 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
894 ... ${dst['container_type']} ${dst['container_name']}
895 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
896 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
897 ... AND Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
898 ... ELSE
899 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
900 ... Wait Until Keyword Succeeds 60s 2s
901 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
902 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
903 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530904 END
905
Hardik Windlass41701e82021-01-12 17:44:44 +0000906Disable Enable PON Port Per OLT DT
907 [Arguments] ${olt_serial_number}
908 [Documentation] This keyword disables and then enables OLT PON port and
909 ... also validate ONUs for each corresponding case
910 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
911 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
912 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
913 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
914 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
915 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
916 # Disable the OLT PON Port and Validate OLT Device
917 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
918 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
919 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
920 ... DISABLED DISCOVERED
921 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
922 ... Validate OLT Device ENABLED ACTIVE REACHABLE
923 ... ${olt_serial_number}
924 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
925 ... Validate ONUs for PON OLT Disable DT ${olt_serial_number} ${olt_peer_list}
Hardik Windlass41701e82021-01-12 17:44:44 +0000926 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
927 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
928 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
929 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
930 ... ENABLED ACTIVE
931 # Waiting extra time for the ONUs to come up
Hardik Windlass5e214b22021-02-26 10:37:14 +0000932 Sleep 30s
Hardik Windlass41701e82021-01-12 17:44:44 +0000933 ${olt_peer_list_new}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
934 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
935 ... Validate ONUs for PON OLT Enable DT ${olt_serial_number} ${olt_peer_list_new}
936 END
937
Hardik Windlass16cdf962020-04-29 15:26:50 +0530938Validate ONUs for PON OLT Disable DT
Hardik Windlass41701e82021-01-12 17:44:44 +0000939 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530940 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
941 ... And Pings succeed for other Active OLT PON port ONUs
942 ... Also it removes subscriber and deletes ONUs for Disabled OLT PON port to replicate DT workflow
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800943 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530944 ${src}= Set Variable ${hosts.src[${I}]}
945 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000946 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530947 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000948 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530949 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
950 ... ${of_id}
951 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
952 Run Keyword If ${matched}
953 ... Run Keywords
954 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
955 ... Validate Device ENABLED DISCOVERED
956 ... UNREACHABLE ${src['onu']} onu=True onu_reason=stopping-openomci
957 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
958 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
959 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
960 ... Wait Until Keyword Succeeds 60s 2s
961 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
962 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
963 ... ${src['container_name']}
964 # Remove Subscriber Access (To replicate DT workflow)
965 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
966 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530967 # Delete ONU Device (To replicate DT workflow)
968 ... AND Delete Device ${onu_device_id}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530969 ... ELSE
970 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
971 ... Wait Until Keyword Succeeds 60s 2s
972 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
973 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
974 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530975 END
976
977Validate ONUs for PON OLT Enable DT
Hardik Windlass41701e82021-01-12 17:44:44 +0000978 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530979 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
980 ... Also performs subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800981 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530982 ${src}= Set Variable ${hosts.src[${I}]}
983 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000984 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530985 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000986 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530987 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
988 ... ${of_id}
989 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
990 Run Keyword If ${matched}
991 ... Run Keywords
992 # Perform Cleanup
993 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
994 # Verify ONU port status
995 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
996 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
997 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
998 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
999 ... volt-add-subscriber-access ${of_id} ${onu_port}
1000 # Verify ONU state in voltha
1001 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
1002 ... Validate Device ENABLED ACTIVE REACHABLE
1003 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
1004 # Verify subscriber access flows are added for the ONU port
1005 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
1006 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
1007 ... ${onu_port} ${nni_port} ${src['s_tag']}
1008 ... AND Run Keyword If ${has_dataplane}
1009 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
1010 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
1011 ... ${src['ip']} ${src['user']} ${src['pass']}
1012 ... ${src['container_type']} ${src['container_name']}
1013 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1014 ... ${dst['container_type']} ${dst['container_name']}
1015 ... ELSE
1016 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1017 ... Wait Until Keyword Succeeds 60s 2s
1018 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1019 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
1020 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301021 END
1022
1023Match ONU in PON OLT Peer List
1024 [Arguments] ${olt_peer_list} ${onu_device_id}
1025 [Documentation] This keyword matches if ONU device is present in OLT PON port peer list
1026 ${matched}= Set Variable False
1027 FOR ${olt_peer} IN @{olt_peer_list}
1028 ${matched}= Set Variable If '${onu_device_id}' == '${olt_peer}' True False
1029 Exit For Loop If ${matched}
1030 END
1031 [Return] ${matched}
1032
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +00001033Collect Logs
1034 [Documentation] Collect Logs from voltha and onos cli for various commands
1035 Run Keyword and Ignore Error Get Device List from Voltha
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001036 FOR ${I} IN RANGE 0 ${num_olts}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001037 Run Keyword and Ignore Error Get Device Output from Voltha ${olt_ids}[${I}][device_id]
1038 Run Keyword and Ignore Error Get Logical Device Output from Voltha ${olt_ids}[${I}][logical_id]
1039 END
1040 #Run Keyword and Ignore Error Get Device Output from Voltha ${olt_device_id}
1041 #Run Keyword and Ignore Error Get Logical Device Output from Voltha ${logical_id}
ubuntu6b6e7d42020-03-02 12:35:42 -08001042 Get ONOS Status ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001043
1044Verify ping is succesful except for given device
1045 [Arguments] ${num_onus} ${exceptional_onu_id}
1046 [Documentation] Checks that ping for all the devices are successful except the given ONU.
1047 ${pingStatus} Set Variable True
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001048 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001049 ${src}= Set Variable ${hosts.src[${I}]}
1050 ${dst}= Set Variable ${hosts.dst[${I}]}
1051 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1052 ${pingStatus} Run Keyword If '${onu_device_id}' == '${exceptional_onu_id}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001053 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1054 ... Wait Until Keyword Succeeds 60s 2s
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001055 ... Check Ping ${pingStatus} ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1056 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1057 END
Andy Bavier4a8450e2020-02-04 08:58:37 -07001058
Suchitra Vemurife309412020-12-01 19:19:52 -08001059Verify ping is successful for ONUs not on this OLT
1060 [Arguments] ${num_all_onus} ${exceptional_olt_id}
1061 [Documentation] Checks that pings work for all the ONUs except for the ONUs on the given OLT.
1062 #${pingStatus} Set Variable True
1063 FOR ${I} IN RANGE 0 ${num_all_onus}
1064 ${src}= Set Variable ${hosts.src[${I}]}
1065 ${dst}= Set Variable ${hosts.dst[${I}]}
1066 ${olt_device_id}= Get Device ID From SN ${src['olt']}
1067 Continue For Loop If "${olt_device_id}"=="${exceptional_olt_id}"
1068 #${pingStatus} Run Keyword If '${olt_device_id}' == '${exceptional_olt_id}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001069 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1070 ... Wait Until Keyword Succeeds 60s 2s
Suchitra Vemurife309412020-12-01 19:19:52 -08001071 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1072 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1073 END
1074
Andy Bavier1923ecc2020-06-18 14:06:40 -07001075Echo Message to OLT Logs
1076 [Arguments] ${message}
1077 [Documentation] Echoes ${message} into the OLT logs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001078 FOR ${I} IN RANGE 0 ${num_olts}
1079 ${olt_user} Evaluate ${olts}[${I}].get("user")
1080 ${olt_pass} Evaluate ${olts}[${I}].get("pass")
1081 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanellaebf6f0d2021-01-12 13:10:29 +01001082 Continue For Loop If "${olt_user}" == "${None}"
1083 Continue For Loop If "${olt_pass}" == "${None}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001084 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1085 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt.log
1086 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1087 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1088 ... printf '%s\n' '' '' '${message}' '' >> /var/log/dev_mgmt_daemon.log
1089 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1090 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1091 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt_process_watchdog.log
1092 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1093 END
Andy Bavier1923ecc2020-06-18 14:06:40 -07001094
Andy Bavierabeba262020-02-07 16:22:16 -07001095Start Logging
1096 [Arguments] ${label}
1097 [Documentation] Start logging for test ${label}
1098 ${kail_process}= Run Keyword If "${container_log_dir}" != "${None}" Start Process kail -n default
1099 ... -n voltha cwd=${container_log_dir} stdout=${label}-combined.log
1100 Set Test Variable ${kail_process}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001101 Run Keyword If ${has_dataplane} Echo Message to OLT Logs START ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001102
1103Stop Logging
1104 [Arguments] ${label}
1105 [Documentation] End logging for test; remove logfile if test passed
1106 Run sync
1107 Run Keyword If ${kail_process} Terminate Process ${kail_process}
1108 ${test_logfile}= Run Keyword If "${container_log_dir}" != "${None}"
1109 ... Join Path ${container_log_dir} ${label}-combined.log
1110 Run Keyword If Test Passed Run Keyword If "${test_logfile}" != "${None}" Remove File ${test_logfile}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001111 Run Keyword If ${has_dataplane} Echo Message to OLT Logs END ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001112
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001113Clean Up Linux
1114 [Documentation] Kill processes and clean up interfaces on src+dst servers
Hardik Windlass16cdf962020-04-29 15:26:50 +05301115 [Arguments] ${onu_id}=${EMPTY}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001116 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001117 ${src}= Set Variable ${hosts.src[${I}]}
1118 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301119 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1120 Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
Andy Bavier84b83282020-06-30 05:47:49 -07001121 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001122 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001123 Execute Remote Command sudo pkill dhclient ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001124 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Baviereff938d2020-06-29 18:27:49 -07001125 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1126 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1127 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1128 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001129 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1130 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1131 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1132 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1133 ... ${dst['container_type']} ${dst['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001134 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1135 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1136 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
Andy Bavierf4b7d1d2020-06-30 11:14:04 -07001137 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1138 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
Andy Baviereff938d2020-06-29 18:27:49 -07001139 ... ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001140 END
Scott Baker60e570d2020-02-02 22:10:13 -08001141
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001142Clean Up Linux Per OLT
1143 [Documentation] Kill processes and clean up interfaces on src+dst servers
1144 [Arguments] ${olt_serial_number}
1145 FOR ${I} IN RANGE 0 ${num_all_onus}
1146 ${src}= Set Variable ${hosts.src[${I}]}
1147 ${dst}= Set Variable ${hosts.dst[${I}]}
1148 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1149 ${sn}= Get Device ID From SN ${src['olt']}
1150 #Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
1151 Continue For Loop If '${olt_serial_number}' == '${sn}'
1152 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
1153 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1154 Execute Remote Command sudo pkill dhclient ${src['ip']}
1155 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1156 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1157 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1158 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1159 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
1160 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1161 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1162 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1163 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1164 ... ${dst['container_type']} ${dst['container_name']}
1165 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1166 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1167 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
1168 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1169 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
1170 ... ${dst['container_type']} ${dst['container_name']}
1171 END
1172
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001173Clean dhclient
1174 [Documentation] Kills dhclient processes only for all RGs
Hardik Windlass41701e82021-01-12 17:44:44 +00001175 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001176 ${src}= Set Variable ${hosts.src[${I}]}
1177 ${dst}= Set Variable ${hosts.dst[${I}]}
1178 Execute Remote Command sudo pkill dhclient ${src['ip']}
1179 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1180 END
1181
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001182Clean WPA Process
1183 [Documentation] Kills wpa_supplicant processes only for all RGs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001184 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001185 ${src}= Set Variable ${hosts.src[${I}]}
1186 ${dst}= Set Variable ${hosts.dst[${I}]}
1187 Run Keyword And Ignore Error Kill Linux Process [w]pa_supplicant ${src['ip']}
1188 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1189 END
1190
Scott Baker60e570d2020-02-02 22:10:13 -08001191Should Be Larger Than
1192 [Documentation] Verify that value_1 is > value_2
1193 [Arguments] ${value_1} ${value_2}
1194 Run Keyword If ${value_1} <= ${value_2}
1195 ... Fail The value ${value_1} is not larger than ${value_2}
1196
Scott Bakeree675552020-02-11 10:43:34 -08001197Should Be Larger Than Or Equal To
1198 [Documentation] Verify that value_1 is >= value_2
1199 [Arguments] ${value_1} ${value_2}
1200 Run Keyword If ${value_1} < ${value_2}
1201 ... Fail The value ${value_1} is not larger than or equal to ${value_2}
1202
Scott Baker60e570d2020-02-02 22:10:13 -08001203Should Be Float
1204 [Documentation] Verify that value is a floating point number type
1205 [Arguments] ${value}
1206 ${type} Evaluate type(${value}).__name__
1207 Should Be Equal ${type} float
1208
Scott Bakeree675552020-02-11 10:43:34 -08001209Should Be Newer Than Or Equal To
1210 [Documentation] Compare two RFC3339 dates
1211 [Arguments] ${value_1} ${value_2}
1212 ${unix_v1} Parse RFC3339 ${value_1}
1213 ${unix_v2} Parse RFC3339 ${value_2}
1214 Run Keyword If ${unix_v1} < ${unix_v2}
1215 ... Fail The value ${value_1} is not newer than or equal to ${value_2}
1216
Scott Baker60e570d2020-02-02 22:10:13 -08001217Get Current Time
1218 [Documentation] Return the current time in RFC3339 format
1219 ${output}= Run date -u +"%FT%T%:z"
1220 [return] ${output}
Scott Bakeree675552020-02-11 10:43:34 -08001221
1222Parse RFC3339
1223 [Documentation] Parse an RFC3339 timestamp
1224 [Arguments] ${dateStr}
1225 ${rc} ${output}= Run and Return Rc and Output date --date="${dateStr}" "+%s"
1226 Should Be Equal As Numbers ${rc} 0
1227 [return] ${output}
Matteo Scandolo142e6272020-04-29 17:36:59 -07001228
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001229Get Bandwidth Profile Name For Given Subscriber
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001230 [Arguments] ${subscriber_id} ${stream_type}=upstreamBandwidthProfile ${service_type}=${EMPTY}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001231 [Documentation] Keyword to get the bandwidth details of the given subscriber
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001232 ${service_type_upper}= Run Keyword If '${service_type}' != '${EMPTY}'
1233 ... Convert To Upper Case ${service_type}
1234 ${bandwidth_profile_output}= Run Keyword If '${service_type}' != '${EMPTY}'
1235 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlass1189a642021-06-04 03:25:23 +00001236 ... volt-programmed-subscribers | grep ${subscriber_id} | grep '${service_type_upper}' --color=never
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001237 ... ELSE
1238 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001239 ... volt-programmed-subscribers | grep ${subscriber_id}
1240 @{bandwidth_profile_array}= Split String ${bandwidth_profile_output} ,
1241 Log ${bandwidth_profile_array}
1242 FOR ${value} IN @{bandwidth_profile_array}
1243 @{row_value}= Split String ${value} =
1244 ${bandwidth_profile_name}= Set Variable If '${row_value[0]}' == ' ${stream_type}'
1245 ... ${row_value[1]}
1246 ${bandwidth_profile_name}= Convert To String ${bandwidth_profile_name}
1247 Run Keyword If "${bandwidth_profile_name}" != "None" Exit For Loop
1248 END
1249 Log ${bandwidth_profile_name}
1250 [Return] ${bandwidth_profile_name}
1251
1252Execute Remote Command
1253 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1254 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1255 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
Andy Baviereff938d2020-06-29 18:27:49 -07001256 ... ${container_type}=${None} ${container_name}=${None} ${timeout}=${None}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001257 ${conn_id}= SSHLibrary.Open Connection ${ip}
1258 Run Keyword If '${pass}' != '${None}'
1259 ... SSHLibrary.Login ${user} ${pass}
1260 ... ELSE
1261 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1262 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1263 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001264 ${stdout} ${stderr} ${rc}= Run Keyword If '${container_type}' == 'LXC'
1265 ... SSHLibrary.Execute Command lxc exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001266 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001267 ... ELSE IF '${container_type}' == 'K8S'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001268 ... SSHLibrary.Execute Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001269 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001270 ... ELSE
Andy Baviereff938d2020-06-29 18:27:49 -07001271 ... SSHLibrary.Execute Command ${cmd} return_stderr=True return_rc=True timeout=${timeout}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001272
1273 Log ${stdout}
1274 Log ${stderr}
1275 Log ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001276 SSHLibrary.Close Connection
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001277 [Return] ${stdout} ${stderr} ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001278
Suraj Gour33651272020-05-04 10:10:16 +05301279Start Remote Command
1280 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1281 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1282 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
1283 ... ${container_type}=${None} ${container_name}=${None}
1284 ${conn_id}= SSHLibrary.Open Connection ${ip}
1285 Run Keyword If '${pass}' != '${None}'
1286 ... SSHLibrary.Login ${user} ${pass}
1287 ... ELSE
1288 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1289 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1290 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
1291 Run Keyword If '${container_type}' == 'LXC'
1292 ... SSHLibrary.Start Command lxc exec ${container_name} -- ${cmd}
1293 ... ELSE IF '${container_type}' == 'K8S'
1294 ... SSHLibrary.Start Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
1295 ... ELSE
1296 ... SSHLibrary.Start Command ${cmd}
Andy Bavier9fb23232020-06-30 15:12:20 -07001297 # It seems that closing the connection immediately will sometimes kill the command
1298 Sleep 1s
Suraj Gour33651272020-05-04 10:10:16 +05301299 SSHLibrary.Close Connection
1300
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001301Run Iperf3 Test Client
1302 [Arguments] ${src} ${server} ${args}
1303 [Documentation] Login to ${src} and run the iperf3 client against ${server} using ${args}.
1304 ... Return a Dictionary containing the results of the test.
Girish Gowdrad769b412021-05-16 11:09:46 -07001305 ${output} ${stderr} ${rc}= Execute Remote Command iperf3 -J -c ${server} ${args} -l 1024 -M 1350 | jq -M -c '.'
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001306 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001307 Should Be Equal As Integers ${rc} 0
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001308 ${object}= Evaluate json.loads(r'''${output}''') json
1309 [Return] ${object}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001310
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -07001311Run Iperf Test Client for MCAST
1312 [Arguments] ${src} ${server} ${args}
1313 [Documentation] Login to ${src} and run the iperf client against ${server} using ${args}.
1314 ... Return a Dictionary containing the results of the test.
1315 ${output} ${stderr} ${rc}= Execute Remote Command sudo iperf -c ${server} ${args} | jq -M -c '.'
1316 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1317 Should Be Equal As Integers ${rc} 0
1318 ${object}= Evaluate json.loads(r'''${output}''') json
1319 [Return] ${object}
1320
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001321RestoreONUs
1322 [Documentation] Restore all connected ONUs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001323 [Arguments] ${num_all_onus}
1324 FOR ${I} IN RANGE 0 ${num_all_onus}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001325 ${src}= Set Variable ${hosts.src[${I}]}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001326 ${container_type}= Get Variable Value ${src['container_type']} "null"
1327 ${container_name}= Get Variable Value ${src['container_name']} "null"
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001328 ${onu_type}= Get Variable Value ${src['onu_type']} "null"
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001329 #Get ens6f0 from ens6f0.22
1330 ${if_name}= Replace String Using Regexp ${src['dp_iface_name']} \\..* \
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001331 Run Keyword IF '${onu_type}' == 'alpha' AlphaONURestoreDefault ${src['ip']} ${src['user']}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001332 ... ${src['pass']} ${if_name} admin admin ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001333 END
1334
1335AlphaONURestoreDefault
1336 [Documentation] Restore the Alpha ONU to factory setting
1337 [Arguments] ${rg_ip} ${rg_user} ${rg_pass} ${onu_ifname}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001338 ... ${onu_user} ${onu_pass} ${container_type}=${None} ${container_name}=${None}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001339 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 192.168.1.3/24
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001340 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
TorstenThieme70bc5262021-01-19 12:12:55 +00001341 ${cmd} Catenate
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001342 ... (echo open "192.168.1.1"; sleep 1;
1343 ... echo "${onu_user}"; sleep 1;
1344 ... echo "${onu_pass}"; sleep 1;
1345 ... echo "restoredefault"; sleep 1) | telnet
1346 ${output}= Login And Run Command On Remote System ${cmd}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001347 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001348 Log To Console ${output}
1349 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 0
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001350 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Suraj Gour33651272020-05-04 10:10:16 +05301351
1352Create traffic with each pbit and capture at other end
1353 [Documentation] Generates upstream traffic using Mausezahn tool
1354 ... with each pbit and validates reception at other end using tcpdump
1355 [Arguments] ${target_ip} ${target_iface} ${src_iface}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001356 ... ${packet_count} ${packet_type} ${vlan} ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301357 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
1358 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
1359 FOR ${pbit} IN RANGE 8
Andy Baviereff938d2020-06-29 18:27:49 -07001360 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301361 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001362 ${var1}= Set Variable sudo mausezahn ${src_iface} -B ${target_ip} -c ${packet_count}
1363 ${var2}= Set Variable -t ${packet_type} "dp=80, flags=rst, p=aa:aa:aa" -Q ${pbit}:${vlan}
Suraj Gour33651272020-05-04 10:10:16 +05301364 ${cmd}= Set Variable ${var1} ${var2}
1365 Start Remote Command ${cmd} ${src_ip} ${src_user} ${src_pass}
1366 ... ${src_container_type} ${src_container_name}
1367 ${output} ${stderr} ${rc}= Execute Remote Command
Andy Baviereff938d2020-06-29 18:27:49 -07001368 ... sudo tcpdump -l -U -c 30 -i ${target_iface} -e ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301369 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
Andy Baviereff938d2020-06-29 18:27:49 -07001370 ... timeout=30 seconds
1371 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301372 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001373 Run Keyword If "${tcpdump_filter}"=="tcp"
Girish Gowdraebeca682021-05-18 14:44:41 -07001374 ... Should Match Regexp ${output} , p ${pbit},
Suraj Gour33651272020-05-04 10:10:16 +05301375 END
TorstenThieme70bc5262021-01-19 12:12:55 +00001376
1377Determine Number Of ONU
1378 [Arguments] ${olt_serial_number}=${EMPTY} ${num_onus}=${num_all_onus}
1379 [Documentation] Determine the number of different ONUs for the given OLT taken from host.src
1380 ${onu_list} Create List
1381 FOR ${INDEX} IN RANGE 0 ${num_onus}
1382 Continue For Loop If "${olt_serial_number}"!="${hosts.src[${INDEX}].olt}" and "${olt_serial_number}"!="${EMPTY}"
1383 ${onu_id}= Get Index From List ${onu_list} ${hosts.src[${INDEX}].onu}
1384 Run Keyword If -1 == ${onu_id} Append To List ${onu_list} ${hosts.src[${INDEX}].onu}
1385 END
1386 ${real_num_onus}= Get Length ${onu_list}
1387 [Return] ${real_num_onus}