blob: c5180bccd03bdbc88f14b8b01135ab0042aa79b1 [file] [log] [blame]
Kailash92764922019-07-25 08:21:39 -07001# Copyright 2017-present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
Kailash92764922019-07-25 08:21:39 -070014# robot test functions
15
16*** Settings ***
17Documentation Library for various utilities
18Library SSHLibrary
Kailash92764922019-07-25 08:21:39 -070019Library String
20Library DateTime
21Library Process
22Library Collections
23Library RequestsLibrary
24Library OperatingSystem
Andy Bavier63460da2020-02-20 14:35:12 -070025Library CORDRobot
26Library ImportResource resources=CORDRobot
TorstenThiemed4f48962020-12-08 12:17:19 +000027Resource ./voltctl.robot
Kailash92764922019-07-25 08:21:39 -070028
29*** Keywords ***
Kailash528f7c02019-07-31 10:55:49 -070030Check CLI Tools Configured
31 [Documentation] Tests that use 'voltctl' and 'kubectl' should execute this keyword in suite setup
32 # check voltctl and kubectl configured
Zack Williamsa8fe75a2020-01-10 14:25:27 -070033 ${voltctl_rc}= Run And Return RC voltctl device list
34 ${kubectl_rc}= Run And Return RC kubectl get pods
Gilles Depatie675a2062019-10-22 12:44:42 -040035 Run Keyword If ${voltctl_rc} != 0 or ${kubectl_rc} != 0 FATAL ERROR
36 ... VOLTCTL and KUBECTL not configured. Please configure before executing tests.
Gilles Depatieb5682f82019-10-31 10:39:45 -040037
38Send File To Onos
Zack Williamsa8fe75a2020-01-10 14:25:27 -070039 [Documentation] Send the content of the file to Onos to selected section of configuration
40 ... using Post Request
41 [Arguments] ${CONFIG_FILE} ${section}
42 ${Headers}= Create Dictionary Content-Type application/json
43 ${File_Data}= OperatingSystem.Get File ${CONFIG_FILE}
44 Log ${Headers}
45 Log ${File_Data}
46 ${resp}= Post Request ONOS
47 ... /onos/v1/network/configuration/${section} headers=${Headers} data=${File_Data}
48 Should Be Equal As Strings ${resp.status_code} 200
Andy Bavier88cd9f62019-11-26 16:22:33 -070049
50Common Test Suite Setup
51 [Documentation] Setup the test suite
Andy Bavier88cd9f62019-11-26 16:22:33 -070052 Set Global Variable ${KUBECTL_CONFIG} export KUBECONFIG=%{KUBECONFIG}
Matteo Scandolo5899be12020-11-11 15:38:07 -080053 Set Global Variable ${VOLTCTL_CONFIG} %{VOLTCONFIG}
Andy Bavier88cd9f62019-11-26 16:22:33 -070054 ${k8s_node_ip}= Evaluate ${nodes}[0].get("ip")
ubuntu6b6e7d42020-03-02 12:35:42 -080055 ${ONOS_REST_IP}= Get Environment Variable ONOS_REST_IP ${k8s_node_ip}
56 ${ONOS_SSH_IP}= Get Environment Variable ONOS_SSH_IP ${k8s_node_ip}
57 Set Global Variable ${ONOS_REST_IP}
58 Set Global Variable ${ONOS_SSH_IP}
Andy Bavier88cd9f62019-11-26 16:22:33 -070059 ${k8s_node_user}= Evaluate ${nodes}[0].get("user")
60 ${k8s_node_pass}= Evaluate ${nodes}[0].get("pass")
61 Check CLI Tools Configured
62 ${onos_auth}= Create List karaf karaf
63 ${HEADERS} Create Dictionary Content-Type=application/json
ubuntu6b6e7d42020-03-02 12:35:42 -080064 Create Session ONOS http://${ONOS_REST_IP}:${ONOS_REST_PORT} auth=${ONOS_AUTH}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080065 ${num_olts} Get Length ${olts}
66 ${list_olts} Create List
Suchitra Vemuriac9785e2021-01-07 16:50:18 -080067 # Create olt list from the configuration file
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080068 FOR ${I} IN RANGE 0 ${num_olts}
69 ${ip} Evaluate ${olts}[${I}].get("ip")
70 ${user} Evaluate ${olts}[${I}].get("user")
71 ${pass} Evaluate ${olts}[${I}].get("pass")
72 ${serial_number} Evaluate ${olts}[${I}].get("serial")
73 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanella3dcce272021-01-15 16:04:47 +010074 ${type} Evaluate ${olts}[${I}].get("type")
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080075 ${orig_olt_port} Evaluate ${olts}[${I}].get("oltPort")
76 ${port}= Set Variable If "${orig_olt_port}" == "None" ${OLT_PORT} ${orig_olt_port}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080077 ${onu_count}= Get ONU Count For OLT ${hosts.src} ${serial_number}
Suchitra Vemurife309412020-12-01 19:19:52 -080078 ${onu_list}= Get ONU List For OLT ${hosts.src} ${serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080079 ${olt} Create Dictionary ip ${ip} user ${user} pass
Andrea Campanella3dcce272021-01-15 16:04:47 +010080 ... ${pass} sn ${serial_number} onucount ${onu_count} type ${type}
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080081 ... sship ${olt_ssh_ip} oltport ${port} onus ${onu_list}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080082 Append To List ${list_olts} ${olt}
83 END
84 ${num_all_onus}= Get Length ${hosts.src}
85 ${num_all_onus}= Convert to String ${num_all_onus}
Andy Bavier88cd9f62019-11-26 16:22:33 -070086 #send sadis file to onos
Andy Baviera2691752019-11-27 12:18:38 -070087 ${sadis_file}= Get Variable Value ${sadis.file}
Zack Williamsa8fe75a2020-01-10 14:25:27 -070088 Log To Console \nSadis File:${sadis_file}
Andy Bavier88cd9f62019-11-26 16:22:33 -070089 Run Keyword Unless '${sadis_file}' is '${None}' Send File To Onos ${sadis_file} apps/
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080090 Set Suite Variable ${num_all_onus}
91 Set Suite Variable ${num_olts}
92 Set Suite Variable ${list_olts}
93 ${olt_count}= Get Length ${list_olts}
94 Set Suite Variable ${olt_count}
Andrea Campanella3dcce272021-01-15 16:04:47 +010095 @{container_list}= Create List ${OLT_ADAPTER_APP_LABEL} adapter-open-onu voltha-api-server
Andy Bavier88cd9f62019-11-26 16:22:33 -070096 ... voltha-ro-core voltha-rw-core-11 voltha-rw-core-12 voltha-ofagent
97 Set Suite Variable ${container_list}
98 ${datetime}= Get Current Date
suraj gour7f6d5fe2019-11-29 10:56:35 +000099 Set Suite Variable ${datetime}
100
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800101Get ONU Count For OLT
102 [Arguments] ${src} ${serial_number}
103 [Documentation] Gets ONU Count for the specified OLT
104 ${src_length}= Get Length ${src}
105 ${count}= Set Variable 0
106 FOR ${I} IN RANGE 0 ${src_length}
107 ${sn} Evaluate ${src}[${I}].get("olt")
TorstenThiemed4f48962020-12-08 12:17:19 +0000108 ${count}= Run Keyword If '${serial_number}' == '${sn}' Evaluate ${count} + 1
109 ... ELSE Set Variable ${count}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800110 END
111 [Return] ${count}
112
Suchitra Vemurife309412020-12-01 19:19:52 -0800113Get ONU List For OLT
114 [Arguments] ${src} ${serial_number}
115 [Documentation] Gets ONU List for the specified OLT
116 ${src_length}= Get Length ${src}
117 ${onu_list}= Create List
118 FOR ${I} IN RANGE 0 ${src_length}
119 ${sn} Evaluate ${src}[${I}].get("olt")
120 Run Keyword If '${serial_number}' == '${sn}' Append To List ${onu_list} ${src}[${I}].get("onu")
121 ... ELSE Set Variable ${onu_list}
122 END
123 [Return] ${onu_list}
124
suraj gour7f6d5fe2019-11-29 10:56:35 +0000125WPA Reassociate
suraj gour7f6d5fe2019-11-29 10:56:35 +0000126 [Documentation] Executes a particular wpa_cli reassociate, which performs force reassociation
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700127 [Arguments] ${iface} ${ip} ${user} ${pass}=${None}
128 ... ${container_type}=${None} ${container_name}=${None}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000129 #Below for loops are used instead of sleep time, to execute reassociate command and check status
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700130 FOR ${i} IN RANGE 70
131 ${output}= Login And Run Command On Remote System
132 ... wpa_cli -i ${iface} reassociate ${ip} ${user}
133 ... ${pass} ${container_type} ${container_name}
134 ${passed}= Run Keyword And Return Status Should Contain ${output} OK
Andy Bavierb63f6d22020-03-12 15:34:37 -0700135 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700136 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700137 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700138 FOR ${i} IN RANGE 70
139 ${output}= Login And Run Command On Remote System
Andy Bavierae4a17e2020-02-25 14:54:36 -0700140 ... wpa_cli -i ${iface} status | grep SUCCESS ${ip} ${user}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700141 ... ${pass} ${container_type} ${container_name}
142 ${passed}= Run Keyword And Return Status Should Contain ${output} SUCCESS
Andy Bavierb63f6d22020-03-12 15:34:37 -0700143 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700144 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700145 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700146
suraj gour7f6d5fe2019-11-29 10:56:35 +0000147Validate Authentication After Reassociate
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700148 [Arguments] ${auth_pass} ${iface} ${ip} ${user} ${pass}=${None}
149 ... ${container_type}=${None} ${container_name}=${None}
150 [Documentation]
151 ... Executes a particular reassociate request on the RG using wpa_cli.
152 ... auth_pass determines if authentication should pass
Andy Bavier84834d42020-02-25 13:49:50 -0700153 ${wpa_log}= Catenate SEPARATOR=. /tmp/wpa ${iface} log
154 ${output}= Login And Run Command On Remote System truncate -s 0 ${wpa_log}; cat ${wpa_log}
155 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
156 Log ${output}
157 Should Not Contain ${output} authentication completed successfully
suraj gour7f6d5fe2019-11-29 10:56:35 +0000158 WPA Reassociate ${iface} ${ip} ${user} ${pass} ${container_type} ${container_name}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700159 Run Keyword If '${auth_pass}' == 'True' Wait Until Keyword Succeeds ${timeout} 2s
Andy Bavier84834d42020-02-25 13:49:50 -0700160 ... Check Remote File Contents True ${wpa_log} ${iface}.*authentication completed successfully
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700161 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000162 Run Keyword If '${auth_pass}' == 'False' Sleep 20s
Suchitra Vemuri3cb29f82020-02-25 13:59:58 -0800163 Run Keyword If '${auth_pass}' == 'False' Check Remote File Contents False /tmp/wpa.log
Andy Bavier84834d42020-02-25 13:49:50 -0700164 ... ${iface}.*authentication completed successfully ${ip} ${user} ${pass}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700165 ... ${container_type} ${container_name}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000166
167Send Dhclient Request To Release Assigned IP
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700168 [Arguments] ${iface} ${ip} ${user} ${path_dhcpleasefile} ${pass}=${None}
169 ... ${container_type}=${None} ${container_name}=${None}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000170 [Documentation] Executes a dhclient with option to release ip against a particular interface on the RG (src)
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700171 ${result}= Login And Run Command On Remote System
172 ... dhclient -nw -r ${iface} && rm ${path_dhcpleasefile}/dhclient.* ${ip} ${user}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000173 ... ${pass} ${container_type} ${container_name}
174 Log ${result}
175 #Should Contain ${result} DHCPRELEASE
176 [Return] ${result}
suraj gour1ecfae92019-12-20 15:11:40 +0000177
178Check Remote File Contents For WPA Logs
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700179 [Arguments] ${file_should_exist} ${file} ${pattern} ${ip} ${user} ${pass}=${None}
180 ... ${container_type}=${None} ${container_name}=${None} ${prompt}=~$
suraj gour1ecfae92019-12-20 15:11:40 +0000181 [Documentation] Checks for particular pattern count in a file
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700182 ${result}= Login And Run Command On Remote System
183 ... cat ${file} | grep '${pattern}' | wc -l ${ip} ${user} ${pass}
suraj gour1ecfae92019-12-20 15:11:40 +0000184 ... ${container_type} ${container_name} ${prompt}
185 [Return] ${result}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000186
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800187
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000188Perform Sanity Test
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800189 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure
190 ... for all the ONUs connected to each OLT - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000191 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
192 ... In all other (common) cases flag has to be set False (default).
193 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800194 FOR ${J} IN RANGE 0 ${num_olts}
195 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
196 ${onu_count}= Set Variable ${list_olts}[${J}][onucount]
197 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
198 ... ${olt_serial_number}
199 Set Global Variable ${of_id}
200 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
201 ... Get NNI Port in ONOS ${of_id}
202 Set Global Variable ${nni_port}
203 # Verify Default Meter in ONOS (valid only for ATT)
204 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
205 ... Verify Default Meter Present in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
206 Perform Sanity Test Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${onu_count}
TorstenThiemec3c23232021-01-13 13:06:31 +0000207 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800208 END
209
210Perform Sanity Test Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000211 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000212 [Documentation] This keyword performs Sanity Test Procedure
213 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
214 ... This keyword can be used to call in any other tests where sanity check is required
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800215 ... and avoids duplication of code. - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000216 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
217 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800218 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000219 ${src}= Set Variable ${hosts.src[${I}]}
220 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800221 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000222 ${onu_device_id}= Get Device ID From SN ${src['onu']}
223 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
224 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800225 # Check ONU port is Enabled in ONOS
226 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700227 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800228 # Verify EAPOL flows are added for the ONU port
TorstenThiemec3c23232021-01-13 13:06:31 +0000229 Run Keyword Unless ${supress_add_subscriber}
230 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
ubuntu6b6e7d42020-03-02 12:35:42 -0800231 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800232 # Verify ONU state in voltha
233 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
234 ... ENABLED ACTIVE REACHABLE
235 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
236 # Perform Authentication
Andy Bavier84834d42020-02-25 13:49:50 -0700237 ${wpa_log}= Run Keyword If ${has_dataplane} Catenate SEPARATOR=.
238 ... /tmp/wpa ${src['dp_iface_name']} log
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000239 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate Authentication True
240 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
Andy Bavier84834d42020-02-25 13:49:50 -0700241 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000242 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800243 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
TorstenThiemec3c23232021-01-13 13:06:31 +0000244 Run Keyword Unless ${supress_add_subscriber}
245 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800246 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000247 ... volt-add-subscriber-access ${of_id} ${onu_port}
Suchitra Vemuri9da44302020-03-04 14:24:49 -0800248 # Verify that no pending flows exist for the ONU port
249 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
250 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Hardik Windlass21807632020-04-14 16:24:55 +0530251 # Verify subscriber access flows are added for the ONU port
252 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
253 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
254 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530255 # Verify Meters in ONOS
256 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
257 ... Verify Meters in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000258 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
259 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
260 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
261 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
262 ... ${dst['container_name']}
263 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
ubuntu6b6e7d42020-03-02 12:35:42 -0800264 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000265 END
266
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000267Perform Sanity Test DT
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800268 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000269 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
270 ... In all other (common) cases flag has to be set False (default).
271 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800272 FOR ${J} IN RANGE 0 ${num_olts}
273 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
274 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
275 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
276 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
277 ... ${olt_serial_number}
278 Set Global Variable ${of_id}
279 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
280 ... Get NNI Port in ONOS ${of_id}
281 Set Global Variable ${nni_port}
282 Perform Sanity Test DT Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${num_onus}
TorstenThiemec3c23232021-01-13 13:06:31 +0000283 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800284 # Verify ONOS Flows
285 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
286 ${onos_flows_count}= Evaluate 4 * ${num_onus}
287 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
288 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
289 ... ${onos_flows_count}
290 # Verify VOLTHA Flows
291 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
292 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
293 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
294 ${onu_flows}= Set Variable 2
295 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
296 ... ${olt_device_id}
297 ${List_ONU_Serial} Create List
298 Set Suite Variable ${List_ONU_Serial}
Suchitra Vemuri21a47fd2020-11-16 18:39:09 -0800299 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800300 Log ${List_ONU_Serial}
301 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
302 ... ${List_ONU_Serial} ${onu_flows}
303 END
304
305
306Perform Sanity Test DT Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000307 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000308 [Documentation] This keyword performs Sanity Test Procedure for DT Workflow
309 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
310 ... This keyword can be used to call in any other tests where sanity check is required
311 ... and avoids duplication of code.
TorstenThiemec3c23232021-01-13 13:06:31 +0000312 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
313 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800314 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000315 ${src}= Set Variable ${hosts.src[${I}]}
316 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800317 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000318 ${onu_device_id}= Get Device ID From SN ${src['onu']}
319 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
320 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
321 # Check ONU port is Enabled in ONOS
322 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700323 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemec3c23232021-01-13 13:06:31 +0000324 Run Keyword Unless ${supress_add_subscriber}
325 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800326 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000327 ... volt-add-subscriber-access ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530328 # Verify subscriber access flows are added for the ONU port
329 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass25e11702020-03-30 20:05:19 +0530330 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
331 ... ${onu_port} ${nni_port} ${src['s_tag']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000332 # Verify ONU state in voltha
333 ${onu_reasons}= Create List omci-flows-pushed
334 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
335 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000336 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
337 ... ENABLED ACTIVE REACHABLE
TorstenThiemec3c23232021-01-13 13:06:31 +0000338 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530339 # Verify Meters in ONOS
340 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
341 ... Verify Meters in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530342 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000343 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
344 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
345 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
346 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
347 ... ${dst['container_name']}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000348 END
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800349
350Validate All OLT Flows
351 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
352 FOR ${J} IN RANGE 0 ${num_olts}
353 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
354 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
355 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
356 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
357 ... ${olt_serial_number}
358 Set Global Variable ${of_id}
359 # Verify ONOS Flows
360 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
361 ${onos_flows_count}= Evaluate 4 * ${num_onus}
362 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
363 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
364 ... ${onos_flows_count}
365 # Verify VOLTHA Flows
366 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
367 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
368 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
369 ${onu_flows}= Set Variable 2
370 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
371 ... ${olt_device_id}
372 ${List_ONU_Serial} Create List
373 Set Suite Variable ${List_ONU_Serial}
Andrea Campanella6391f842020-11-16 10:01:18 +0100374 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800375 Log ${List_ONU_Serial}
376 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
377 ... ${List_ONU_Serial} ${onu_flows}
378 END
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000379
TorstenThieme70bc5262021-01-19 12:12:55 +0000380Perform Sanity Tests TT
381 [Documentation] This keyword performs both Sanity Test Procedure for TT Workflow
382 ... Sanity Test TT for HSIA, VoD, VoIP services and Sanity Test TT for MCAST
383 ... For repeating sanity tests without subscriber changes set flag supress_add_subscriber=True.
384 ... In all other (common) cases flag has to be set False (default).
385 [Arguments] ${supress_add_subscriber}=False
386 Perform Sanity Test TT ${supress_add_subscriber}
TorstenThieme136ebf72021-02-26 14:27:07 +0000387 # run of mcast sanity test is currently limited for real HW
388 Run Keyword If ${has_dataplane} Perform Sanity Test TT MCAST ${supress_add_subscriber}
TorstenThieme70bc5262021-01-19 12:12:55 +0000389
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700390Perform Sanity Test TT
391 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
392 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
393 ... This keyword can be used to call in any other tests where sanity check is required
394 ... and avoids duplication of code.
TorstenThieme70bc5262021-01-19 12:12:55 +0000395 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
396 ... In all other (common) cases flag has to be set False (default).
397 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800398 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700399 ${src}= Set Variable ${hosts.src[${I}]}
400 ${dst}= Set Variable ${hosts.dst[${I}]}
401 ${service_type}= Get Variable Value ${src['service_type']} "null"
TorstenThiemea36068c2021-02-19 09:57:32 +0000402 Run Keyword IF '${service_type}' != 'mcast' Sanity Test TT one ONU ${src} ${dst} ${supress_add_subscriber}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700403 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700404
405Sanity Test TT one ONU
406 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
407 ... Tests for one ONU
408 ... Assertions apply to HSIA, VoD, VoIP services
TorstenThieme70bc5262021-01-19 12:12:55 +0000409 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
410 ... In all other (common) cases flag has to be set False (default).
411 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800412 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700413 Set Global Variable ${of_id}
414 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
415 ... Get NNI Port in ONOS ${of_id}
416 Set Global Variable ${nni_port}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700417 ${onu_device_id}= Get Device ID From SN ${src['onu']}
418 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
419 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
420 # Check ONU port is Enabled in ONOS
421 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
422 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000423 Run Keyword Unless ${supress_add_subscriber}
424 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700425 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
426 ... volt-add-subscriber-access ${of_id} ${onu_port}
427 Sleep 30s
TorstenThiemea36068c2021-02-19 09:57:32 +0000428 # Verify ONU state in voltha
429 ${onu_reasons}= Create List omci-flows-pushed
430 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
431 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700432 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
433 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800434 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700435 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
436 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
437 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
438 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
439 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
440 ... ${dst['container_name']}
Matteo Scandolo37a6cb72021-01-08 13:55:59 -0800441 Run Keyword IF '${src['service_type']}'!='hsia'
Suchitra Vemuri42819412020-10-01 17:45:43 -0700442 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -0700443 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri42819412020-10-01 17:45:43 -0700444 ... ${src['c_tag']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700445
446Perform Sanity Test TT MCAST
447 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
448 ... Adds subscribers
449 ... Validates for MCAST
TorstenThieme70bc5262021-01-19 12:12:55 +0000450 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
451 ... In all other (common) cases flag has to be set False (default).
452 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800453 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700454 ${src}= Set Variable ${hosts.src[${I}]}
455 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700456 ${service_type}= Get Variable Value ${src['service_type']} "null"
457 Run Keyword IF '${service_type}' == 'mcast' Sanity Test TT MCAST one ONU ${src}
TorstenThiemea36068c2021-02-19 09:57:32 +0000458 ... ${dst} ${supress_add_subscriber}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700459 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700460
461Sanity Test TT MCAST one ONU
462 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
463 ... Tests for one ONU
464 ... Assertions apply to MCAST services
TorstenThieme70bc5262021-01-19 12:12:55 +0000465 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
466 ... In all other (common) cases flag has to be set False (default).
467 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700468 # Check for iperf and jq tools
469 ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf jq
470 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
471 ... ${src['container_name']}
472 Pass Execution If ${rc} != 0 Skipping test: iperf / jq not found on the RG
473
474 #Reset the IP on the interface
475 ${output}= Login And Run Command On Remote System sudo ifconfig ${src['dp_iface_name']} 0
476 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
477 # Kill iperf on BNG
478 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
479 ... sudo kill -9 `pidof iperf`
480 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
481 ... ${dst['container_name']}
482
483 # Setup RG for Multi-cast test
484 ${output}= Login And Run Command On Remote System
485 ... sudo ifconfig ${src['dp_iface_name']} ${src['mcast_rg']} up ; sudo kill -9 `pidof iperf`
486 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
487 ${output}= Login And Run Command On Remote System
488 ... sudo ip route add ${src['mcast_grp_subnet_mask']} dev ${src['dp_iface_name']} scope link
489 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
490
491 # Perform operations for adding subscriber
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800492 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700493 Set Global Variable ${of_id}
494 ${nni_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
495 ... Get NNI Port in ONOS ${of_id}
496 Set Global Variable ${nni_port}
497 ${onu_device_id}= Get Device ID From SN ${src['onu']}
498 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
499 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
500 # Check ONU port is Enabled in ONOS
501 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
502 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000503 Run Keyword Unless ${supress_add_subscriber}
504 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700505 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
506 ... volt-add-subscriber-access ${of_id} ${onu_port}
507 Sleep 30s
TorstenThiemea36068c2021-02-19 09:57:32 +0000508 # Verify ONU state in voltha
509 ${onu_reasons}= Create List omci-flows-pushed
510 # In case of previous dis- and enable of ONU and no further subscriber add actions state will be onu-reenabled
511 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700512 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
513 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800514 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700515
516 # Setup iperf on the BNG
517 ${server_output}= Login And Run Command On Remote System
518 ... sudo iperf -c ${dst['dp_iface_ip_qinq']} -u -T 32 -t 60 -i 1 &
519 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
520 ... ${dst['container_name']}
521
522 # Setup iperf on the RG
523 ${rg_output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
524 ... Login And Run Command On Remote System
525 ... rm -rf /tmp/rg_output ; sudo iperf -s -u -B ${dst['dp_iface_ip_qinq']} -i 1 -D >> /tmp/rg_output
526 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
527 Log ${rg_output}
528 Sleep 60s
529 ${output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
530 ... Login And Run Command On Remote System
531 ... cat /tmp/rg_output | grep KBytes
532 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
533 Log ${output}
534 Should Contain ${output} KBytes
535
536 # Kill iperf on BNG
537 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
538 ... sudo kill -9 `pidof iperf`
539 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
540 ... ${dst['container_name']}
541
542 # Kill iperf on the RG
543 ${output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
544 ... sudo kill -9 `pidof iperf`
545 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
546
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700547
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000548Setup
549 [Documentation] Pre-test Setup
550 #test for empty device list
551 Test Empty Device List
Hardik Windlass5e214b22021-02-26 10:37:14 +0000552 # TBD: Need for this Sleep
553 Run Keyword If ${has_dataplane} Sleep 180s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800554 # Create a list of olt ids (logical and device_id)
555 ${olt_ids} Create List
556 FOR ${I} IN RANGE 0 ${num_olts}
557 #create/preprovision device
Andrea Campanella3dcce272021-01-15 16:04:47 +0100558 ${olt_device_id}= Run Keyword If "${list_olts}[${I}][type]" == "${None}"
Suchitra Vemuri09f878d2021-02-10 18:19:04 -0800559 ... Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport]
560 ... ELSE Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport] ${list_olts}[${I}][type]
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800561 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
562 #Set Suite Variable ${olt_device_id}
563 #validate olt states
564 Wait Until Keyword Succeeds ${timeout} 5s
565 ... Validate OLT Device PREPROVISIONED UNKNOWN UNKNOWN ${olt_device_id}
566 Sleep 5s
567 Enable Device ${olt_device_id}
568 Wait Until Keyword Succeeds 380s 5s
569 ... Validate OLT Device ENABLED ACTIVE REACHABLE ${olt_serial_number}
570 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
571 # Set Suite Variable ${logical_id}
572 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
573 ... ${olt_serial_number}
574 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
575 ... of_id ${of_id} sn ${olt_serial_number}
576 Append To List ${olt_ids} ${olt}
577 END
578 Set Global Variable ${olt_ids}
579
580Get ofID From OLT List
581 [Documentation] Retrieves the corresponding of_id for the OLT serial number specified
582 [Arguments] ${serial_number}
583 FOR ${I} IN RANGE 0 ${olt_count}
584 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100585 ${of_id}= Run Keyword IF "${serial_number}"=="${sn}"
586 ... Get From Dictionary ${olt_ids}[${I}] of_id ELSE Set Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800587 END
588 [Return] ${of_id}
589
590Get OLTDeviceID From OLT List
591 [Documentation] Retrieves the corresponding olt_device_id for the OLT serial number specified
592 [Arguments] ${serial_number}
Suchitra Vemuri4b8f4f52020-11-17 19:12:50 -0800593 ${olt_device_id}= Set Variable 0
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800594 FOR ${I} IN RANGE 0 ${olt_count}
595 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100596 ${olt_device_id}= Run Keyword IF "${serial_number}"=="${sn}"
597 ... Get From Dictionary ${olt_ids}[${I}] device_id ELSE Set Variable ${olt_device_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800598 END
599 [Return] ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000600
Andrea Campanellad848de02020-11-24 10:23:41 +0100601Get Num of Onus From OLT SN
602 [Documentation] Retrieves the corresponding number of ONUs for a given OLT based on serial number specified
603 [Arguments] ${serial_number}
604 ${num_of_olt_onus}= Set Variable 0
605 FOR ${I} IN RANGE 0 ${olt_count}
606 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
607 ${num_of_olt_onus}= Run Keyword IF "${serial_number}"=="${sn}"
608 ... Get From Dictionary ${list_olts}[${I}] onucount ELSE Set Variable ${num_of_olt_onus}
609 END
610 [Return] ${num_of_olt_onus}
611
Hardik Windlassaaea3402020-03-10 19:45:45 +0530612Validate ONUs After OLT Disable
613 [Documentation] Validates the ONUs state in Voltha, ONUs port state in ONOS
614 ... and that pings do not succeed After corresponding OLT is Disabled
Andrea Campanella4e507882020-11-26 11:33:11 +0100615 [Arguments] ${num_onus} ${olt_serial_number}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530616 FOR ${I} IN RANGE 0 ${num_onus}
617 ${src}= Set Variable ${hosts.src[${I}]}
618 ${dst}= Set Variable ${hosts.dst[${I}]}
Andrea Campanella4e507882020-11-26 11:33:11 +0100619 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800620 ${of_id}= Get ofID From OLT List ${src['olt']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530621 ${onu_device_id}= Get Device ID From SN ${src['onu']}
622 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
623 ... ${of_id}
624 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
625 ... Validate Device ENABLED DISCOVERED
626 ... UNREACHABLE ${src['onu']} onu=True onu_reason=stopping-openomci
627 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700628 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530629 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
630 ... Wait Until Keyword Succeeds 60s 2s
631 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
632 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530633 END
634
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000635Delete All Devices and Verify
636 [Documentation] Remove any devices from VOLTHA and ONOS
637 # Clear devices from VOLTHA
638 Disable Devices In Voltha Root=true
Suchitra Vemuri970747f2020-03-30 17:31:34 -0700639 Sleep 5s
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000640 Wait Until Keyword Succeeds ${timeout} 2s Test Devices Disabled In Voltha Root=true
641 Delete Devices In Voltha Root=true
Hardik Windlassdf5035e2021-01-27 08:34:59 +0000642 Sleep 30s
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000643 Wait Until Keyword Succeeds ${timeout} 2s Test Empty Device List
Hardik Windlasse8b99222021-01-25 10:03:14 +0000644 FOR ${I} IN RANGE 0 ${num_olts}
645 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
646 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 15s
647 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
648 END
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000649 # Clear devices from ONOS
Suchitra Vemurif7a033c2020-02-26 17:22:41 -0800650 #Remove All Devices From ONOS
ubuntu6b6e7d42020-03-02 12:35:42 -0800651 #... http://karaf:karaf@${ONOS_REST_IP}:${ONOS_REST_PORT}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000652
653Teardown
654 [Documentation] kills processes and cleans up interfaces on src+dst servers
655 Run Keyword If ${has_dataplane} Clean Up Linux
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000656
657Teardown Suite
658 [Documentation] Clean up device if desired
659 Run Keyword If ${teardown_device} Delete All Devices and Verify
660
661Delete Device and Verify
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800662 [Arguments] ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000663 [Documentation] Disable -> Delete devices via voltctl and verify its removed
Suchitra Vemuri2fa9bba2020-01-22 17:38:48 -0800664 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000665 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800666 ... voltctl -c ${VOLTCTL_CONFIG} device disable ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000667 Should Be Equal As Integers ${rc} 0
668 Sleep 5s
669 Wait Until Keyword Succeeds ${timeout} 5s
670 ... Validate OLT Device DISABLED UNKNOWN REACHABLE ${olt_serial_number}
671 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800672 ... voltctl -c ${VOLTCTL_CONFIG} device delete ${olt_device_id}
Hardik Windlassdf5035e2021-01-27 08:34:59 +0000673 Sleep 50s
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000674 Should Be Equal As Integers ${rc} 0
675 Wait Until Keyword Succeeds ${timeout} 5s Validate Device Removed ${olt_device_id}
Hardik Windlasse8b99222021-01-25 10:03:14 +0000676 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 15s
677 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000678
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000679Repeat Sanity Test
680 [Documentation] This keyword performs Sanity Test Procedure
681 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
682 ... This keyword can be used to call in any other tests where sanity check is required
683 ... with wpa reassociation
684 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
685 Set Global Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800686 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000687 ${src}= Set Variable ${hosts.src[${I}]}
688 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800689 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
690 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
691 # Check ONU port is Enabled in ONOD
692 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Suchitra Vemuri760bdd32020-06-17 12:34:48 -0700693 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800694 # Verify EAPOL flows are added for the ONU port
695 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800696 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800697 # Verify ONU state in voltha
Suchitra Vemurid1e27fb2020-02-01 16:34:37 -0800698 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri81e4f022020-02-01 13:16:02 -0800699 ... ENABLED ACTIVE REACHABLE
700 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800701 # Perform Authentication
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000702 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
703 ... Validate Authentication After Reassociate
704 ... True ${src['dp_iface_name']} ${src['ip']} ${src['user']} ${src['pass']}
705 ... ${src['container_type']} ${src['container_name']}
706 Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800707 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000708 Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800709 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000710 ... volt-add-subscriber-access ${of_id} ${onu_port}
711 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
712 ... Validate DHCP and Ping True True
713 ... ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
714 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
715 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
716 ... ${dst['container_name']}
717 Wait Until Keyword Succeeds ${timeout} 2s Run Keyword And Continue On Failure
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800718 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000719 END
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +0000720
Hardik Windlass41701e82021-01-12 17:44:44 +0000721Disable Enable PON Port Per OLT
722 [Arguments] ${olt_serial_number}
723 [Documentation] This keyword disables and then enables OLT PON port and
724 ... also validate ONUs for each corresponding case
725 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
726 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
727 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
728 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
729 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
730 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
731 # Disable the OLT PON Port and Validate OLT Device
732 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
733 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
734 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
735 ... DISABLED DISCOVERED
736 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
737 ... Validate OLT Device ENABLED ACTIVE REACHABLE
738 ... ${olt_serial_number}
739 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
740 ... Validate ONUs for PON OLT Disable ${olt_serial_number} ${olt_peer_list}
741 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
742 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
743 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
744 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
745 ... ENABLED ACTIVE
746 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
747 ... Validate ONUs for PON OLT Enable ${olt_serial_number} ${olt_peer_list}
748 END
749
Hardik Windlass16cdf962020-04-29 15:26:50 +0530750Validate ONUs for PON OLT Disable
Hardik Windlass41701e82021-01-12 17:44:44 +0000751 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530752 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
753 ... And Pings succeed for other Active OLT PON port ONUs
754 ... Also it removes subscriber for Disabled OLT PON port ONUs to replicate ATT workflow
Hardik Windlass41701e82021-01-12 17:44:44 +0000755 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530756 ${src}= Set Variable ${hosts.src[${I}]}
757 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000758 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530759 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000760 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530761 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
762 ... ${of_id}
763 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
764 Run Keyword If ${matched}
765 ... Run Keywords
766 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
767 ... Validate Device ENABLED DISCOVERED
Hardik Windlass41701e82021-01-12 17:44:44 +0000768 ... UNREACHABLE ${src['onu']} onu=True onu_reason=omci-flows-deleted
Hardik Windlass16cdf962020-04-29 15:26:50 +0530769 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
770 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
771 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
772 ... Wait Until Keyword Succeeds 60s 2s
773 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
774 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
775 ... ${src['container_name']}
776 # Remove Subscriber Access (To replicate ATT workflow)
777 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
778 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
779 ... ELSE
780 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
781 ... Wait Until Keyword Succeeds 60s 2s
782 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
783 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
784 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530785 END
786
787Validate ONUs for PON OLT Enable
Hardik Windlass41701e82021-01-12 17:44:44 +0000788 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530789 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
790 ... Also performs Auth/subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800791 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530792 ${src}= Set Variable ${hosts.src[${I}]}
793 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000794 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530795 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000796 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530797 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
798 ... ${of_id}
799 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
800 ${wpa_log}= Run Keyword If ${has_dataplane} and ${matched} Catenate SEPARATOR=.
801 ... /tmp/wpa ${src['dp_iface_name']} log
802 Run Keyword If ${matched}
803 ... Run Keywords
804 # Perform Cleanup
805 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
806 # Verify ONU port status
807 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
808 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
809 # Verify EAPOL flows are added for the ONU port
810 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
811 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
812 # Verify ONU state in voltha
813 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
814 ... Validate Device ENABLED ACTIVE REACHABLE
815 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
816 # Perform Authentication
817 ... AND Run Keyword If ${has_dataplane}
818 ... Run Keyword And Continue On Failure Validate Authentication True
819 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
820 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
821 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
822 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
823 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
824 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
825 ... volt-add-subscriber-access ${of_id} ${onu_port}
826 # Verify that no pending flows exist for the ONU port
827 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
828 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
829 # Verify subscriber access flows are added for the ONU port
830 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
831 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
832 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
833 ... AND Run Keyword If ${has_dataplane}
834 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
835 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
836 ... ${src['ip']} ${src['user']} ${src['pass']}
837 ... ${src['container_type']} ${src['container_name']}
838 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
839 ... ${dst['container_type']} ${dst['container_name']}
840 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
841 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
842 ... AND Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
843 ... ELSE
844 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
845 ... Wait Until Keyword Succeeds 60s 2s
846 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
847 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
848 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530849 END
850
Hardik Windlass41701e82021-01-12 17:44:44 +0000851Disable Enable PON Port Per OLT DT
852 [Arguments] ${olt_serial_number}
853 [Documentation] This keyword disables and then enables OLT PON port and
854 ... also validate ONUs for each corresponding case
855 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
856 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
857 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
858 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
859 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
860 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
861 # Disable the OLT PON Port and Validate OLT Device
862 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
863 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
864 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
865 ... DISABLED DISCOVERED
866 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
867 ... Validate OLT Device ENABLED ACTIVE REACHABLE
868 ... ${olt_serial_number}
869 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
870 ... Validate ONUs for PON OLT Disable DT ${olt_serial_number} ${olt_peer_list}
Hardik Windlass41701e82021-01-12 17:44:44 +0000871 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
872 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
873 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
874 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
875 ... ENABLED ACTIVE
876 # Waiting extra time for the ONUs to come up
Hardik Windlass5e214b22021-02-26 10:37:14 +0000877 Sleep 30s
Hardik Windlass41701e82021-01-12 17:44:44 +0000878 ${olt_peer_list_new}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
879 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
880 ... Validate ONUs for PON OLT Enable DT ${olt_serial_number} ${olt_peer_list_new}
881 END
882
Hardik Windlass16cdf962020-04-29 15:26:50 +0530883Validate ONUs for PON OLT Disable DT
Hardik Windlass41701e82021-01-12 17:44:44 +0000884 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530885 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
886 ... And Pings succeed for other Active OLT PON port ONUs
887 ... Also it removes subscriber and deletes ONUs for Disabled OLT PON port to replicate DT workflow
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800888 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530889 ${src}= Set Variable ${hosts.src[${I}]}
890 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000891 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530892 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000893 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530894 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
895 ... ${of_id}
896 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
897 Run Keyword If ${matched}
898 ... Run Keywords
899 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
900 ... Validate Device ENABLED DISCOVERED
901 ... UNREACHABLE ${src['onu']} onu=True onu_reason=stopping-openomci
902 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
903 ... Verify ONU Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
904 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
905 ... Wait Until Keyword Succeeds 60s 2s
906 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
907 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
908 ... ${src['container_name']}
909 # Remove Subscriber Access (To replicate DT workflow)
910 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command ${ONOS_SSH_IP}
911 ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530912 # Delete ONU Device (To replicate DT workflow)
913 ... AND Delete Device ${onu_device_id}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530914 ... ELSE
915 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
916 ... Wait Until Keyword Succeeds 60s 2s
917 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
918 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
919 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530920 END
921
922Validate ONUs for PON OLT Enable DT
Hardik Windlass41701e82021-01-12 17:44:44 +0000923 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530924 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
925 ... Also performs subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800926 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530927 ${src}= Set Variable ${hosts.src[${I}]}
928 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000929 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530930 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000931 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530932 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
933 ... ${of_id}
934 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
935 Run Keyword If ${matched}
936 ... Run Keywords
937 # Perform Cleanup
938 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
939 # Verify ONU port status
940 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
941 ... Verify ONU Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
942 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
943 ... Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
944 ... volt-add-subscriber-access ${of_id} ${onu_port}
945 # Verify ONU state in voltha
946 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
947 ... Validate Device ENABLED ACTIVE REACHABLE
948 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
949 # Verify subscriber access flows are added for the ONU port
950 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
951 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
952 ... ${onu_port} ${nni_port} ${src['s_tag']}
953 ... AND Run Keyword If ${has_dataplane}
954 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
955 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
956 ... ${src['ip']} ${src['user']} ${src['pass']}
957 ... ${src['container_type']} ${src['container_name']}
958 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
959 ... ${dst['container_type']} ${dst['container_name']}
960 ... ELSE
961 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
962 ... Wait Until Keyword Succeeds 60s 2s
963 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
964 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
965 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530966 END
967
968Match ONU in PON OLT Peer List
969 [Arguments] ${olt_peer_list} ${onu_device_id}
970 [Documentation] This keyword matches if ONU device is present in OLT PON port peer list
971 ${matched}= Set Variable False
972 FOR ${olt_peer} IN @{olt_peer_list}
973 ${matched}= Set Variable If '${onu_device_id}' == '${olt_peer}' True False
974 Exit For Loop If ${matched}
975 END
976 [Return] ${matched}
977
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +0000978Collect Logs
979 [Documentation] Collect Logs from voltha and onos cli for various commands
980 Run Keyword and Ignore Error Get Device List from Voltha
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800981 FOR ${I} IN RANGE 0 ${num_olts}
982 Run Keyword and Ignore Error Get Logical Device Output from Voltha ${logical_id}
983 Run Keyword and Ignore Error Get Device Output from Voltha ${olt_ids}[${I}][device_id]
984 Run Keyword and Ignore Error Get Logical Device Output from Voltha ${olt_ids}[${I}][logical_id]
985 END
986 #Run Keyword and Ignore Error Get Device Output from Voltha ${olt_device_id}
987 #Run Keyword and Ignore Error Get Logical Device Output from Voltha ${logical_id}
ubuntu6b6e7d42020-03-02 12:35:42 -0800988 Get ONOS Status ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +0000989
990Verify ping is succesful except for given device
991 [Arguments] ${num_onus} ${exceptional_onu_id}
992 [Documentation] Checks that ping for all the devices are successful except the given ONU.
993 ${pingStatus} Set Variable True
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800994 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +0000995 ${src}= Set Variable ${hosts.src[${I}]}
996 ${dst}= Set Variable ${hosts.dst[${I}]}
997 ${onu_device_id}= Get Device ID From SN ${src['onu']}
998 ${pingStatus} Run Keyword If '${onu_device_id}' == '${exceptional_onu_id}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -0800999 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1000 ... Wait Until Keyword Succeeds 60s 2s
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001001 ... Check Ping ${pingStatus} ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1002 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1003 END
Andy Bavier4a8450e2020-02-04 08:58:37 -07001004
Suchitra Vemurife309412020-12-01 19:19:52 -08001005Verify ping is successful for ONUs not on this OLT
1006 [Arguments] ${num_all_onus} ${exceptional_olt_id}
1007 [Documentation] Checks that pings work for all the ONUs except for the ONUs on the given OLT.
1008 #${pingStatus} Set Variable True
1009 FOR ${I} IN RANGE 0 ${num_all_onus}
1010 ${src}= Set Variable ${hosts.src[${I}]}
1011 ${dst}= Set Variable ${hosts.dst[${I}]}
1012 ${olt_device_id}= Get Device ID From SN ${src['olt']}
1013 Continue For Loop If "${olt_device_id}"=="${exceptional_olt_id}"
1014 #${pingStatus} Run Keyword If '${olt_device_id}' == '${exceptional_olt_id}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001015 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1016 ... Wait Until Keyword Succeeds 60s 2s
Suchitra Vemurife309412020-12-01 19:19:52 -08001017 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1018 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1019 END
1020
Andy Bavier1923ecc2020-06-18 14:06:40 -07001021Echo Message to OLT Logs
1022 [Arguments] ${message}
1023 [Documentation] Echoes ${message} into the OLT logs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001024 FOR ${I} IN RANGE 0 ${num_olts}
1025 ${olt_user} Evaluate ${olts}[${I}].get("user")
1026 ${olt_pass} Evaluate ${olts}[${I}].get("pass")
1027 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanellaebf6f0d2021-01-12 13:10:29 +01001028 Continue For Loop If "${olt_user}" == "${None}"
1029 Continue For Loop If "${olt_pass}" == "${None}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001030 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1031 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt.log
1032 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1033 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1034 ... printf '%s\n' '' '' '${message}' '' >> /var/log/dev_mgmt_daemon.log
1035 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1036 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1037 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt_process_watchdog.log
1038 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1039 END
Andy Bavier1923ecc2020-06-18 14:06:40 -07001040
Andy Bavierabeba262020-02-07 16:22:16 -07001041Start Logging
1042 [Arguments] ${label}
1043 [Documentation] Start logging for test ${label}
1044 ${kail_process}= Run Keyword If "${container_log_dir}" != "${None}" Start Process kail -n default
1045 ... -n voltha cwd=${container_log_dir} stdout=${label}-combined.log
1046 Set Test Variable ${kail_process}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001047 Run Keyword If ${has_dataplane} Echo Message to OLT Logs START ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001048
1049Stop Logging
1050 [Arguments] ${label}
1051 [Documentation] End logging for test; remove logfile if test passed
1052 Run sync
1053 Run Keyword If ${kail_process} Terminate Process ${kail_process}
1054 ${test_logfile}= Run Keyword If "${container_log_dir}" != "${None}"
1055 ... Join Path ${container_log_dir} ${label}-combined.log
1056 Run Keyword If Test Passed Run Keyword If "${test_logfile}" != "${None}" Remove File ${test_logfile}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001057 Run Keyword If ${has_dataplane} Echo Message to OLT Logs END ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001058
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001059Clean Up Linux
1060 [Documentation] Kill processes and clean up interfaces on src+dst servers
Hardik Windlass16cdf962020-04-29 15:26:50 +05301061 [Arguments] ${onu_id}=${EMPTY}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001062 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001063 ${src}= Set Variable ${hosts.src[${I}]}
1064 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301065 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1066 Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
Andy Bavier84b83282020-06-30 05:47:49 -07001067 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001068 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001069 Execute Remote Command sudo pkill dhclient ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001070 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Baviereff938d2020-06-29 18:27:49 -07001071 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1072 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1073 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1074 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001075 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1076 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1077 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1078 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1079 ... ${dst['container_type']} ${dst['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001080 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1081 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1082 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
Andy Bavierf4b7d1d2020-06-30 11:14:04 -07001083 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1084 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
Andy Baviereff938d2020-06-29 18:27:49 -07001085 ... ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001086 END
Scott Baker60e570d2020-02-02 22:10:13 -08001087
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001088Clean Up Linux Per OLT
1089 [Documentation] Kill processes and clean up interfaces on src+dst servers
1090 [Arguments] ${olt_serial_number}
1091 FOR ${I} IN RANGE 0 ${num_all_onus}
1092 ${src}= Set Variable ${hosts.src[${I}]}
1093 ${dst}= Set Variable ${hosts.dst[${I}]}
1094 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1095 ${sn}= Get Device ID From SN ${src['olt']}
1096 #Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
1097 Continue For Loop If '${olt_serial_number}' == '${sn}'
1098 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
1099 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1100 Execute Remote Command sudo pkill dhclient ${src['ip']}
1101 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1102 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1103 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1104 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1105 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
1106 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1107 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1108 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1109 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1110 ... ${dst['container_type']} ${dst['container_name']}
1111 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1112 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1113 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
1114 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1115 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
1116 ... ${dst['container_type']} ${dst['container_name']}
1117 END
1118
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001119Clean dhclient
1120 [Documentation] Kills dhclient processes only for all RGs
Hardik Windlass41701e82021-01-12 17:44:44 +00001121 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001122 ${src}= Set Variable ${hosts.src[${I}]}
1123 ${dst}= Set Variable ${hosts.dst[${I}]}
1124 Execute Remote Command sudo pkill dhclient ${src['ip']}
1125 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1126 END
1127
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001128Clean WPA Process
1129 [Documentation] Kills wpa_supplicant processes only for all RGs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001130 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001131 ${src}= Set Variable ${hosts.src[${I}]}
1132 ${dst}= Set Variable ${hosts.dst[${I}]}
1133 Run Keyword And Ignore Error Kill Linux Process [w]pa_supplicant ${src['ip']}
1134 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1135 END
1136
Scott Baker60e570d2020-02-02 22:10:13 -08001137Should Be Larger Than
1138 [Documentation] Verify that value_1 is > value_2
1139 [Arguments] ${value_1} ${value_2}
1140 Run Keyword If ${value_1} <= ${value_2}
1141 ... Fail The value ${value_1} is not larger than ${value_2}
1142
Scott Bakeree675552020-02-11 10:43:34 -08001143Should Be Larger Than Or Equal To
1144 [Documentation] Verify that value_1 is >= value_2
1145 [Arguments] ${value_1} ${value_2}
1146 Run Keyword If ${value_1} < ${value_2}
1147 ... Fail The value ${value_1} is not larger than or equal to ${value_2}
1148
Scott Baker60e570d2020-02-02 22:10:13 -08001149Should Be Float
1150 [Documentation] Verify that value is a floating point number type
1151 [Arguments] ${value}
1152 ${type} Evaluate type(${value}).__name__
1153 Should Be Equal ${type} float
1154
Scott Bakeree675552020-02-11 10:43:34 -08001155Should Be Newer Than Or Equal To
1156 [Documentation] Compare two RFC3339 dates
1157 [Arguments] ${value_1} ${value_2}
1158 ${unix_v1} Parse RFC3339 ${value_1}
1159 ${unix_v2} Parse RFC3339 ${value_2}
1160 Run Keyword If ${unix_v1} < ${unix_v2}
1161 ... Fail The value ${value_1} is not newer than or equal to ${value_2}
1162
Scott Baker60e570d2020-02-02 22:10:13 -08001163Get Current Time
1164 [Documentation] Return the current time in RFC3339 format
1165 ${output}= Run date -u +"%FT%T%:z"
1166 [return] ${output}
Scott Bakeree675552020-02-11 10:43:34 -08001167
1168Parse RFC3339
1169 [Documentation] Parse an RFC3339 timestamp
1170 [Arguments] ${dateStr}
1171 ${rc} ${output}= Run and Return Rc and Output date --date="${dateStr}" "+%s"
1172 Should Be Equal As Numbers ${rc} 0
1173 [return] ${output}
Matteo Scandolo142e6272020-04-29 17:36:59 -07001174
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001175Get Bandwidth Profile Name For Given Subscriber
1176 [Arguments] ${subscriber_id} ${stream_type}=upstreamBandwidthProfile
1177 [Documentation] Keyword to get the bandwidth details of the given subscriber
1178 ${bandwidth_profile_output}= Execute ONOS CLI Command ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
1179 ... volt-programmed-subscribers | grep ${subscriber_id}
1180 @{bandwidth_profile_array}= Split String ${bandwidth_profile_output} ,
1181 Log ${bandwidth_profile_array}
1182 FOR ${value} IN @{bandwidth_profile_array}
1183 @{row_value}= Split String ${value} =
1184 ${bandwidth_profile_name}= Set Variable If '${row_value[0]}' == ' ${stream_type}'
1185 ... ${row_value[1]}
1186 ${bandwidth_profile_name}= Convert To String ${bandwidth_profile_name}
1187 Run Keyword If "${bandwidth_profile_name}" != "None" Exit For Loop
1188 END
1189 Log ${bandwidth_profile_name}
1190 [Return] ${bandwidth_profile_name}
1191
1192Execute Remote Command
1193 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1194 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1195 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
Andy Baviereff938d2020-06-29 18:27:49 -07001196 ... ${container_type}=${None} ${container_name}=${None} ${timeout}=${None}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001197 ${conn_id}= SSHLibrary.Open Connection ${ip}
1198 Run Keyword If '${pass}' != '${None}'
1199 ... SSHLibrary.Login ${user} ${pass}
1200 ... ELSE
1201 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1202 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1203 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001204 ${stdout} ${stderr} ${rc}= Run Keyword If '${container_type}' == 'LXC'
1205 ... SSHLibrary.Execute Command lxc exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001206 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001207 ... ELSE IF '${container_type}' == 'K8S'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001208 ... SSHLibrary.Execute Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001209 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001210 ... ELSE
Andy Baviereff938d2020-06-29 18:27:49 -07001211 ... SSHLibrary.Execute Command ${cmd} return_stderr=True return_rc=True timeout=${timeout}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001212
1213 Log ${stdout}
1214 Log ${stderr}
1215 Log ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001216 SSHLibrary.Close Connection
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001217 [Return] ${stdout} ${stderr} ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001218
Suraj Gour33651272020-05-04 10:10:16 +05301219Start Remote Command
1220 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1221 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1222 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
1223 ... ${container_type}=${None} ${container_name}=${None}
1224 ${conn_id}= SSHLibrary.Open Connection ${ip}
1225 Run Keyword If '${pass}' != '${None}'
1226 ... SSHLibrary.Login ${user} ${pass}
1227 ... ELSE
1228 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1229 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1230 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
1231 Run Keyword If '${container_type}' == 'LXC'
1232 ... SSHLibrary.Start Command lxc exec ${container_name} -- ${cmd}
1233 ... ELSE IF '${container_type}' == 'K8S'
1234 ... SSHLibrary.Start Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
1235 ... ELSE
1236 ... SSHLibrary.Start Command ${cmd}
Andy Bavier9fb23232020-06-30 15:12:20 -07001237 # It seems that closing the connection immediately will sometimes kill the command
1238 Sleep 1s
Suraj Gour33651272020-05-04 10:10:16 +05301239 SSHLibrary.Close Connection
1240
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001241Run Iperf3 Test Client
1242 [Arguments] ${src} ${server} ${args}
1243 [Documentation] Login to ${src} and run the iperf3 client against ${server} using ${args}.
1244 ... Return a Dictionary containing the results of the test.
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001245 ${output} ${stderr} ${rc}= Execute Remote Command iperf3 -J -c ${server} ${args} | jq -M -c '.'
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001246 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001247 Should Be Equal As Integers ${rc} 0
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001248 ${object}= Evaluate json.loads(r'''${output}''') json
1249 [Return] ${object}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001250
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -07001251Run Iperf Test Client for MCAST
1252 [Arguments] ${src} ${server} ${args}
1253 [Documentation] Login to ${src} and run the iperf client against ${server} using ${args}.
1254 ... Return a Dictionary containing the results of the test.
1255 ${output} ${stderr} ${rc}= Execute Remote Command sudo iperf -c ${server} ${args} | jq -M -c '.'
1256 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1257 Should Be Equal As Integers ${rc} 0
1258 ${object}= Evaluate json.loads(r'''${output}''') json
1259 [Return] ${object}
1260
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001261RestoreONUs
1262 [Documentation] Restore all connected ONUs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001263 [Arguments] ${num_all_onus}
1264 FOR ${I} IN RANGE 0 ${num_all_onus}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001265 ${src}= Set Variable ${hosts.src[${I}]}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001266 ${container_type}= Get Variable Value ${src['container_type']} "null"
1267 ${container_name}= Get Variable Value ${src['container_name']} "null"
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001268 ${onu_type}= Get Variable Value ${src['onu_type']} "null"
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001269 #Get ens6f0 from ens6f0.22
1270 ${if_name}= Replace String Using Regexp ${src['dp_iface_name']} \\..* \
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001271 Run Keyword IF '${onu_type}' == 'alpha' AlphaONURestoreDefault ${src['ip']} ${src['user']}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001272 ... ${src['pass']} ${if_name} admin admin ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001273 END
1274
1275AlphaONURestoreDefault
1276 [Documentation] Restore the Alpha ONU to factory setting
1277 [Arguments] ${rg_ip} ${rg_user} ${rg_pass} ${onu_ifname}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001278 ... ${onu_user} ${onu_pass} ${container_type}=${None} ${container_name}=${None}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001279 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 192.168.1.3/24
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001280 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
TorstenThieme70bc5262021-01-19 12:12:55 +00001281 ${cmd} Catenate
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001282 ... (echo open "192.168.1.1"; sleep 1;
1283 ... echo "${onu_user}"; sleep 1;
1284 ... echo "${onu_pass}"; sleep 1;
1285 ... echo "restoredefault"; sleep 1) | telnet
1286 ${output}= Login And Run Command On Remote System ${cmd}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001287 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001288 Log To Console ${output}
1289 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 0
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001290 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Suraj Gour33651272020-05-04 10:10:16 +05301291
1292Create traffic with each pbit and capture at other end
1293 [Documentation] Generates upstream traffic using Mausezahn tool
1294 ... with each pbit and validates reception at other end using tcpdump
1295 [Arguments] ${target_ip} ${target_iface} ${src_iface}
1296 ... ${packet_count} ${packet_type} ${target_port} ${vlan} ${tcpdump_filter}
1297 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
1298 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
1299 FOR ${pbit} IN RANGE 8
Andy Baviereff938d2020-06-29 18:27:49 -07001300 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301301 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Andy Baviereff938d2020-06-29 18:27:49 -07001302 ${var1}= Set Variable sudo mausezahn ${src_iface} -B ${target_ip} -c ${packet_count} -d 100m
Suraj Gour33651272020-05-04 10:10:16 +05301303 ${var2}= Set Variable -t ${packet_type} "dp=${target_port}" -p 1472 -Q ${pbit}:${vlan}
1304 ${cmd}= Set Variable ${var1} ${var2}
1305 Start Remote Command ${cmd} ${src_ip} ${src_user} ${src_pass}
1306 ... ${src_container_type} ${src_container_name}
1307 ${output} ${stderr} ${rc}= Execute Remote Command
Andy Baviereff938d2020-06-29 18:27:49 -07001308 ... sudo tcpdump -l -U -c 30 -i ${target_iface} -e ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301309 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
Andy Baviereff938d2020-06-29 18:27:49 -07001310 ... timeout=30 seconds
1311 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301312 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
1313 # VOL-3262: I'm seeing untagged downstream traffic at RG for pbit 0. According to Girish this is
1314 # incorrect behavior. Simplify the following check when VOL-3262 is resolved.
1315 Run Keyword If ${pbit}==0 and "${tcpdump_filter}"=="udp"
1316 ... Should Match Regexp ${output} \\.${target_port}: UDP,
1317 ... ELSE Should Match Regexp ${output} , p ${pbit},.*\\.${target_port}: UDP,
1318 END
TorstenThieme70bc5262021-01-19 12:12:55 +00001319
1320Determine Number Of ONU
1321 [Arguments] ${olt_serial_number}=${EMPTY} ${num_onus}=${num_all_onus}
1322 [Documentation] Determine the number of different ONUs for the given OLT taken from host.src
1323 ${onu_list} Create List
1324 FOR ${INDEX} IN RANGE 0 ${num_onus}
1325 Continue For Loop If "${olt_serial_number}"!="${hosts.src[${INDEX}].olt}" and "${olt_serial_number}"!="${EMPTY}"
1326 ${onu_id}= Get Index From List ${onu_list} ${hosts.src[${INDEX}].onu}
1327 Run Keyword If -1 == ${onu_id} Append To List ${onu_list} ${hosts.src[${INDEX}].onu}
1328 END
1329 ${real_num_onus}= Get Length ${onu_list}
1330 [Return] ${real_num_onus}