blob: da7a620a9505e80e3887409e4cd7c9c32c9fc1fc [file] [log] [blame]
Kailash92764922019-07-25 08:21:39 -07001# Copyright 2017-present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
Kailash92764922019-07-25 08:21:39 -070014# robot test functions
15
16*** Settings ***
17Documentation Library for various utilities
18Library SSHLibrary
Kailash92764922019-07-25 08:21:39 -070019Library String
20Library DateTime
21Library Process
22Library Collections
23Library RequestsLibrary
24Library OperatingSystem
Andy Bavier63460da2020-02-20 14:35:12 -070025Library CORDRobot
26Library ImportResource resources=CORDRobot
TorstenThiemed4f48962020-12-08 12:17:19 +000027Resource ./voltctl.robot
Kailash92764922019-07-25 08:21:39 -070028
29*** Keywords ***
Kailash528f7c02019-07-31 10:55:49 -070030Check CLI Tools Configured
31 [Documentation] Tests that use 'voltctl' and 'kubectl' should execute this keyword in suite setup
32 # check voltctl and kubectl configured
Matteo Scandolo1eacdd82021-06-28 10:32:19 +020033 ${voltctl_rc} ${voltctl_output}= Run And Return Rc And Output voltctl -c ${VOLTCTL_CONFIG} device list
Hardik Windlass13803172021-04-26 08:17:07 +000034 Log ${voltctl_output}
35 ${kubectl_rc} ${kubectl_output}= Run And Return Rc And Output kubectl get pods
36 Log ${kubectl_output}
Gilles Depatie675a2062019-10-22 12:44:42 -040037 Run Keyword If ${voltctl_rc} != 0 or ${kubectl_rc} != 0 FATAL ERROR
38 ... VOLTCTL and KUBECTL not configured. Please configure before executing tests.
Gilles Depatieb5682f82019-10-31 10:39:45 -040039
40Send File To Onos
Zack Williamsa8fe75a2020-01-10 14:25:27 -070041 [Documentation] Send the content of the file to Onos to selected section of configuration
42 ... using Post Request
Huseyin Ahmet AYDIN42d3b712021-06-10 14:46:17 +000043 [Arguments] ${CONFIG_FILE} ${section}=${EMPTY}
Zack Williamsa8fe75a2020-01-10 14:25:27 -070044 ${Headers}= Create Dictionary Content-Type application/json
45 ${File_Data}= OperatingSystem.Get File ${CONFIG_FILE}
46 Log ${Headers}
47 Log ${File_Data}
48 ${resp}= Post Request ONOS
49 ... /onos/v1/network/configuration/${section} headers=${Headers} data=${File_Data}
50 Should Be Equal As Strings ${resp.status_code} 200
Andy Bavier88cd9f62019-11-26 16:22:33 -070051
52Common Test Suite Setup
53 [Documentation] Setup the test suite
Andy Bavier88cd9f62019-11-26 16:22:33 -070054 Set Global Variable ${KUBECTL_CONFIG} export KUBECONFIG=%{KUBECONFIG}
Matteo Scandolo5899be12020-11-11 15:38:07 -080055 Set Global Variable ${VOLTCTL_CONFIG} %{VOLTCONFIG}
Andy Bavier88cd9f62019-11-26 16:22:33 -070056 ${k8s_node_ip}= Evaluate ${nodes}[0].get("ip")
ubuntu6b6e7d42020-03-02 12:35:42 -080057 ${ONOS_REST_IP}= Get Environment Variable ONOS_REST_IP ${k8s_node_ip}
58 ${ONOS_SSH_IP}= Get Environment Variable ONOS_SSH_IP ${k8s_node_ip}
59 Set Global Variable ${ONOS_REST_IP}
60 Set Global Variable ${ONOS_SSH_IP}
Andy Bavier88cd9f62019-11-26 16:22:33 -070061 ${k8s_node_user}= Evaluate ${nodes}[0].get("user")
62 ${k8s_node_pass}= Evaluate ${nodes}[0].get("pass")
63 Check CLI Tools Configured
64 ${onos_auth}= Create List karaf karaf
65 ${HEADERS} Create Dictionary Content-Type=application/json
ubuntu6b6e7d42020-03-02 12:35:42 -080066 Create Session ONOS http://${ONOS_REST_IP}:${ONOS_REST_PORT} auth=${ONOS_AUTH}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080067 ${num_olts} Get Length ${olts}
68 ${list_olts} Create List
Suchitra Vemuriac9785e2021-01-07 16:50:18 -080069 # Create olt list from the configuration file
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080070 FOR ${I} IN RANGE 0 ${num_olts}
71 ${ip} Evaluate ${olts}[${I}].get("ip")
72 ${user} Evaluate ${olts}[${I}].get("user")
73 ${pass} Evaluate ${olts}[${I}].get("pass")
74 ${serial_number} Evaluate ${olts}[${I}].get("serial")
75 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanella3dcce272021-01-15 16:04:47 +010076 ${type} Evaluate ${olts}[${I}].get("type")
Hardik Windlassc4d1fd62022-04-12 13:12:28 +000077 ${power_switch_port} Evaluate ${olts}[${I}].get("power_switch_port")
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080078 ${orig_olt_port} Evaluate ${olts}[${I}].get("oltPort")
79 ${port}= Set Variable If "${orig_olt_port}" == "None" ${OLT_PORT} ${orig_olt_port}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080080 ${onu_count}= Get ONU Count For OLT ${hosts.src} ${serial_number}
Suchitra Vemurife309412020-12-01 19:19:52 -080081 ${onu_list}= Get ONU List For OLT ${hosts.src} ${serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080082 ${olt} Create Dictionary ip ${ip} user ${user} pass
Andrea Campanella3dcce272021-01-15 16:04:47 +010083 ... ${pass} sn ${serial_number} onucount ${onu_count} type ${type}
Hardik Windlassc4d1fd62022-04-12 13:12:28 +000084 ... sship ${olt_ssh_ip} oltport ${port} powerswitchport ${power_switch_port}
85 ... onus ${onu_list}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080086 Append To List ${list_olts} ${olt}
87 END
88 ${num_all_onus}= Get Length ${hosts.src}
89 ${num_all_onus}= Convert to String ${num_all_onus}
Andy Bavier88cd9f62019-11-26 16:22:33 -070090 #send sadis file to onos
Andy Baviera2691752019-11-27 12:18:38 -070091 ${sadis_file}= Get Variable Value ${sadis.file}
Zack Williamsa8fe75a2020-01-10 14:25:27 -070092 Log To Console \nSadis File:${sadis_file}
Andy Bavier88cd9f62019-11-26 16:22:33 -070093 Run Keyword Unless '${sadis_file}' is '${None}' Send File To Onos ${sadis_file} apps/
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080094 Set Suite Variable ${num_all_onus}
95 Set Suite Variable ${num_olts}
96 Set Suite Variable ${list_olts}
97 ${olt_count}= Get Length ${list_olts}
98 Set Suite Variable ${olt_count}
Andrea Campanella3dcce272021-01-15 16:04:47 +010099 @{container_list}= Create List ${OLT_ADAPTER_APP_LABEL} adapter-open-onu voltha-api-server
Andy Bavier88cd9f62019-11-26 16:22:33 -0700100 ... voltha-ro-core voltha-rw-core-11 voltha-rw-core-12 voltha-ofagent
101 Set Suite Variable ${container_list}
102 ${datetime}= Get Current Date
suraj gour7f6d5fe2019-11-29 10:56:35 +0000103 Set Suite Variable ${datetime}
104
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800105Get ONU Count For OLT
106 [Arguments] ${src} ${serial_number}
107 [Documentation] Gets ONU Count for the specified OLT
108 ${src_length}= Get Length ${src}
109 ${count}= Set Variable 0
110 FOR ${I} IN RANGE 0 ${src_length}
111 ${sn} Evaluate ${src}[${I}].get("olt")
TorstenThiemed4f48962020-12-08 12:17:19 +0000112 ${count}= Run Keyword If '${serial_number}' == '${sn}' Evaluate ${count} + 1
113 ... ELSE Set Variable ${count}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800114 END
115 [Return] ${count}
116
Suchitra Vemurife309412020-12-01 19:19:52 -0800117Get ONU List For OLT
118 [Arguments] ${src} ${serial_number}
119 [Documentation] Gets ONU List for the specified OLT
120 ${src_length}= Get Length ${src}
121 ${onu_list}= Create List
122 FOR ${I} IN RANGE 0 ${src_length}
123 ${sn} Evaluate ${src}[${I}].get("olt")
Matteo Scandolo243288d2021-09-20 14:48:58 -0700124 Run Keyword If '${serial_number}' == '${sn}' Append To List ${onu_list} ${src}[${I}][onu]
Suchitra Vemurife309412020-12-01 19:19:52 -0800125 ... ELSE Set Variable ${onu_list}
126 END
127 [Return] ${onu_list}
128
suraj gour7f6d5fe2019-11-29 10:56:35 +0000129WPA Reassociate
suraj gour7f6d5fe2019-11-29 10:56:35 +0000130 [Documentation] Executes a particular wpa_cli reassociate, which performs force reassociation
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700131 [Arguments] ${iface} ${ip} ${user} ${pass}=${None}
132 ... ${container_type}=${None} ${container_name}=${None}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000133 #Below for loops are used instead of sleep time, to execute reassociate command and check status
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700134 FOR ${i} IN RANGE 70
135 ${output}= Login And Run Command On Remote System
136 ... wpa_cli -i ${iface} reassociate ${ip} ${user}
137 ... ${pass} ${container_type} ${container_name}
138 ${passed}= Run Keyword And Return Status Should Contain ${output} OK
Andy Bavierb63f6d22020-03-12 15:34:37 -0700139 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700140 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700141 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700142 FOR ${i} IN RANGE 70
143 ${output}= Login And Run Command On Remote System
Andy Bavierae4a17e2020-02-25 14:54:36 -0700144 ... wpa_cli -i ${iface} status | grep SUCCESS ${ip} ${user}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700145 ... ${pass} ${container_type} ${container_name}
146 ${passed}= Run Keyword And Return Status Should Contain ${output} SUCCESS
Andy Bavierb63f6d22020-03-12 15:34:37 -0700147 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700148 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700149 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700150
suraj gour7f6d5fe2019-11-29 10:56:35 +0000151Validate Authentication After Reassociate
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700152 [Arguments] ${auth_pass} ${iface} ${ip} ${user} ${pass}=${None}
153 ... ${container_type}=${None} ${container_name}=${None}
154 [Documentation]
155 ... Executes a particular reassociate request on the RG using wpa_cli.
156 ... auth_pass determines if authentication should pass
Andy Bavier84834d42020-02-25 13:49:50 -0700157 ${wpa_log}= Catenate SEPARATOR=. /tmp/wpa ${iface} log
158 ${output}= Login And Run Command On Remote System truncate -s 0 ${wpa_log}; cat ${wpa_log}
159 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
160 Log ${output}
161 Should Not Contain ${output} authentication completed successfully
suraj gour7f6d5fe2019-11-29 10:56:35 +0000162 WPA Reassociate ${iface} ${ip} ${user} ${pass} ${container_type} ${container_name}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700163 Run Keyword If '${auth_pass}' == 'True' Wait Until Keyword Succeeds ${timeout} 2s
Andy Bavier84834d42020-02-25 13:49:50 -0700164 ... Check Remote File Contents True ${wpa_log} ${iface}.*authentication completed successfully
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700165 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000166 Run Keyword If '${auth_pass}' == 'False' Sleep 20s
Suchitra Vemuri3cb29f82020-02-25 13:59:58 -0800167 Run Keyword If '${auth_pass}' == 'False' Check Remote File Contents False /tmp/wpa.log
Andy Bavier84834d42020-02-25 13:49:50 -0700168 ... ${iface}.*authentication completed successfully ${ip} ${user} ${pass}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700169 ... ${container_type} ${container_name}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000170
171Send Dhclient Request To Release Assigned IP
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700172 [Arguments] ${iface} ${ip} ${user} ${path_dhcpleasefile} ${pass}=${None}
173 ... ${container_type}=${None} ${container_name}=${None}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000174 [Documentation] Executes a dhclient with option to release ip against a particular interface on the RG (src)
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700175 ${result}= Login And Run Command On Remote System
176 ... dhclient -nw -r ${iface} && rm ${path_dhcpleasefile}/dhclient.* ${ip} ${user}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000177 ... ${pass} ${container_type} ${container_name}
178 Log ${result}
179 #Should Contain ${result} DHCPRELEASE
180 [Return] ${result}
suraj gour1ecfae92019-12-20 15:11:40 +0000181
182Check Remote File Contents For WPA Logs
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700183 [Arguments] ${file_should_exist} ${file} ${pattern} ${ip} ${user} ${pass}=${None}
184 ... ${container_type}=${None} ${container_name}=${None} ${prompt}=~$
suraj gour1ecfae92019-12-20 15:11:40 +0000185 [Documentation] Checks for particular pattern count in a file
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700186 ${result}= Login And Run Command On Remote System
187 ... cat ${file} | grep '${pattern}' | wc -l ${ip} ${user} ${pass}
suraj gour1ecfae92019-12-20 15:11:40 +0000188 ... ${container_type} ${container_name} ${prompt}
189 [Return] ${result}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000190
191Perform Sanity Test
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800192 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure
193 ... for all the ONUs connected to each OLT - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000194 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
195 ... In all other (common) cases flag has to be set False (default).
196 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800197 FOR ${J} IN RANGE 0 ${num_olts}
198 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
199 ${onu_count}= Set Variable ${list_olts}[${J}][onucount]
200 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
201 ... ${olt_serial_number}
202 Set Global Variable ${of_id}
TorstenThiemedda37652021-11-11 16:22:05 +0000203 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800204 Perform Sanity Test Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${onu_count}
TorstenThiemec3c23232021-01-13 13:06:31 +0000205 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800206 END
207
208Perform Sanity Test Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000209 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000210 [Documentation] This keyword performs Sanity Test Procedure
211 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
212 ... This keyword can be used to call in any other tests where sanity check is required
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800213 ... and avoids duplication of code. - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000214 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
215 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800216 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000217 ${src}= Set Variable ${hosts.src[${I}]}
218 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800219 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000220 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700221 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000222 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800223 # Check ONU port is Enabled in ONOS
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700224 Wait Until Keyword Succeeds 120s 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000225 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Matteo Scandoloebf2be42021-09-22 09:46:50 -0700226 # Verify Default Meter in ONOS (valid only for ATT and only if subscriber is not provisioned)
227 Run Keyword Unless ${supress_add_subscriber}
228 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo243288d2021-09-20 14:48:58 -0700229 ... Verify Default Meter Present in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700230 # Verify default EAPOL flows are added for the ONU port
TorstenThiemec3c23232021-01-13 13:06:31 +0000231 Run Keyword Unless ${supress_add_subscriber}
232 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700233 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800234 # Verify LLDP flow in ONOS
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800235 Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800236 ... Verify LLDP Flow Added ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} 1
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800237 # Verify ONU state in voltha
Hardik Windlass58b23a32022-05-10 11:06:48 +0530238 Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800239 ... ENABLED ACTIVE REACHABLE
240 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
241 # Perform Authentication
Andy Bavier84834d42020-02-25 13:49:50 -0700242 ${wpa_log}= Run Keyword If ${has_dataplane} Catenate SEPARATOR=.
243 ... /tmp/wpa ${src['dp_iface_name']} log
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700244 Run Keyword If ${has_dataplane} Validate Authentication True
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000245 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
Andy Bavier84834d42020-02-25 13:49:50 -0700246 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700247 Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800248 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
TorstenThiemec3c23232021-01-13 13:06:31 +0000249 Run Keyword Unless ${supress_add_subscriber}
TorstenThieme4e2168e2021-06-22 14:01:47 +0000250 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000251 ... volt-add-subscriber-access ${of_id} ${onu_port}
Suchitra Vemuri9da44302020-03-04 14:24:49 -0800252 # Verify that no pending flows exist for the ONU port
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700253 Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri9da44302020-03-04 14:24:49 -0800254 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Hardik Windlass21807632020-04-14 16:24:55 +0530255 # Verify subscriber access flows are added for the ONU port
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700256 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass21807632020-04-14 16:24:55 +0530257 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
258 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700259 # Verify subscriber EAPOL flow is installed
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700260 Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700261 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
262 ... ${onu_port} ${src['c_tag']}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530263 # Verify Meters in ONOS
Hardik Windlass58b23a32022-05-10 11:06:48 +0530264 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530265 ... Verify Meters in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700266 Run Keyword If ${has_dataplane} Validate DHCP and Ping True
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000267 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
268 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
269 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
270 ... ${dst['container_name']}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700271 Wait Until Keyword Succeeds ${timeout} 2s
ubuntu6b6e7d42020-03-02 12:35:42 -0800272 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000273 END
274
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000275Perform Sanity Test DT
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800276 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000277 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
278 ... In all other (common) cases flag has to be set False (default).
279 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800280 FOR ${J} IN RANGE 0 ${num_olts}
281 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
282 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
283 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
284 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
285 ... ${olt_serial_number}
286 Set Global Variable ${of_id}
TorstenThiemedda37652021-11-11 16:22:05 +0000287 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800288 Perform Sanity Test DT Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${num_onus}
TorstenThiemec3c23232021-01-13 13:06:31 +0000289 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800290 # Verify ONOS Flows
291 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
292 ${onos_flows_count}= Evaluate 4 * ${num_onus}
293 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
294 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
295 ... ${onos_flows_count}
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800296 # Verify LLDP flow in ONOS
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800297 Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800298 ... Verify LLDP Flow Added ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} 1
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800299 # Verify VOLTHA Flows
300 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
301 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
302 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
303 ${onu_flows}= Set Variable 2
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800304 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000305 ... ${olt_flows} ${olt_device_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800306 ${List_ONU_Serial} Create List
307 Set Suite Variable ${List_ONU_Serial}
Suchitra Vemuri21a47fd2020-11-16 18:39:09 -0800308 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800309 Log ${List_ONU_Serial}
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000310 Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800311 ... ${List_ONU_Serial} ${onu_flows}
312 END
313
314
315Perform Sanity Test DT Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000316 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000317 [Documentation] This keyword performs Sanity Test Procedure for DT Workflow
318 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
319 ... This keyword can be used to call in any other tests where sanity check is required
320 ... and avoids duplication of code.
TorstenThiemec3c23232021-01-13 13:06:31 +0000321 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
322 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800323 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000324 ${src}= Set Variable ${hosts.src[${I}]}
325 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800326 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000327 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700328 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
Emrehan UZUNabef5182021-11-26 10:54:24 +0000329 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000330 # Check ONU port is Enabled in ONOS
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700331 Wait Until Keyword Succeeds 120s 2s
Emrehan UZUNabef5182021-11-26 10:54:24 +0000332 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
TorstenThiemec3c23232021-01-13 13:06:31 +0000333 Run Keyword Unless ${supress_add_subscriber}
TorstenThieme4e2168e2021-06-22 14:01:47 +0000334 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000335 ... volt-add-subscriber-access ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530336 # Verify subscriber access flows are added for the ONU port
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700337 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass25e11702020-03-30 20:05:19 +0530338 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
339 ... ${onu_port} ${nni_port} ${src['s_tag']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000340 # Verify ONU state in voltha
341 ${onu_reasons}= Create List omci-flows-pushed
Andrea Campanella753510e2022-04-28 23:26:27 +0200342 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700343 Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000344 ... ENABLED ACTIVE REACHABLE
TorstenThiemec3c23232021-01-13 13:06:31 +0000345 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530346 # Verify Meters in ONOS
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000347 Wait Until Keyword Succeeds ${timeout} 5s
Girish Gowdra21ec25d2021-05-24 10:07:01 -0700348 ... Verify Meters in ONOS Ietf ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530349 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700350 Run Keyword If ${has_dataplane} Validate DHCP and Ping True
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000351 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
352 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
353 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
354 ... ${dst['container_name']}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000355 END
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800356
Hardik Windlassa7b34be2022-03-22 17:28:31 +0000357Perform Sanity Test DT FTTB
358 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT-FTTB workflow
359 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
360 ... In all other (common) cases flag has to be set False (default).
361 [Arguments] ${supress_add_subscriber}=False
362 FOR ${J} IN RANGE 0 ${num_olts}
363 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
364 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
365 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
366 ... ${olt_serial_number}
367 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
368 Perform Sanity Test DT FTTB Per OLT ${of_id} ${nni_port} ${olt_serial_number}
369 ... ${supress_add_subscriber}
370 END
371
372Perform Sanity Test DT FTTB Per OLT
373 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${supress_add_subscriber}=False
374 [Documentation] This keyword performs Sanity Test Procedure for DT-FTTB Workflow
375 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
376 ... This keyword can be used to call in any other tests where sanity check is required
377 ... and avoids duplication of code.
378 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
379 ... In all other (common) cases flag has to be set False (default).
380 FOR ${I} IN RANGE 0 ${num_all_onus}
381 ${src}= Set Variable ${hosts.src[${I}]}
382 ${dst}= Set Variable ${hosts.dst[${I}]}
383 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
384 ${onu_device_id}= Get Device ID From SN ${src['onu']}
385 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
386 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
387 # Check ONU port is Enabled in ONOS
388 Wait Until Keyword Succeeds 120s 2s
389 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
390 Run Keyword Unless ${supress_add_subscriber}
391 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
392 ... volt-add-subscriber-access ${of_id} ${onu_port}
393 # Verify ONOS flows are added for the ONU port
394 Wait Until Keyword Succeeds ${timeout} 5s
395 ... Verify ONOS Flows Added For DT FTTB ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
396 ... ${onu_port} ${nni_port} ${src['service']}
397 # Verify that the Subscriber is present at the given location
398 Wait Until Keyword Succeeds ${timeout} 5s
399 ... Verify Programmed Subscribers DT FTTB ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
400 ... ${onu_port} ${src['service']}
401 # Verify ONU state in voltha
402 ${onu_reasons}= Create List omci-flows-pushed
Andrea Campanella753510e2022-04-28 23:26:27 +0200403 Run Keyword If ${supress_add_subscriber} Append To List ${onu_reasons} onu-reenabled
Hardik Windlassa7b34be2022-03-22 17:28:31 +0000404 Wait Until Keyword Succeeds ${timeout} 5s Validate Device
405 ... ENABLED ACTIVE REACHABLE
406 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
407 # Verify Meters in ONOS
408 Wait Until Keyword Succeeds ${timeout} 5s
409 ... Verify Meters in ONOS Ietf ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Hardik Windlass256993e2022-05-24 09:55:46 +0530410 ... FTTB_SUBSCRIBER_TRAFFIC
Hardik Windlassa7b34be2022-03-22 17:28:31 +0000411 # Verify Mac Learner Mappings
412 Wait Until Keyword Succeeds ${timeout} 5s Validate Mac Learner Mapping in ONOS
Hardik Windlass256993e2022-05-24 09:55:46 +0530413 ... ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port} ${src['service'][0]['s_tag']}
Hardik Windlassa7b34be2022-03-22 17:28:31 +0000414 Run Keyword If ${has_dataplane} Validate DHCP and Ping True
415 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
416 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
417 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
418 ... ${dst['container_name']}
419 END
420
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800421Validate All OLT Flows
422 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
423 FOR ${J} IN RANGE 0 ${num_olts}
424 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
425 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
426 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
427 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
428 ... ${olt_serial_number}
429 Set Global Variable ${of_id}
430 # Verify ONOS Flows
431 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
432 ${onos_flows_count}= Evaluate 4 * ${num_onus}
433 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
434 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
435 ... ${onos_flows_count}
436 # Verify VOLTHA Flows
437 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
438 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
439 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
440 ${onu_flows}= Set Variable 2
441 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
442 ... ${olt_device_id}
443 ${List_ONU_Serial} Create List
444 Set Suite Variable ${List_ONU_Serial}
Andrea Campanella6391f842020-11-16 10:01:18 +0100445 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800446 Log ${List_ONU_Serial}
447 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
448 ... ${List_ONU_Serial} ${onu_flows}
449 END
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000450
TorstenThieme70bc5262021-01-19 12:12:55 +0000451Perform Sanity Tests TT
452 [Documentation] This keyword performs both Sanity Test Procedure for TT Workflow
453 ... Sanity Test TT for HSIA, VoD, VoIP services and Sanity Test TT for MCAST
454 ... For repeating sanity tests without subscriber changes set flag supress_add_subscriber=True.
455 ... In all other (common) cases flag has to be set False (default).
456 [Arguments] ${supress_add_subscriber}=False
457 Perform Sanity Test TT ${supress_add_subscriber}
TorstenThieme136ebf72021-02-26 14:27:07 +0000458 # run of mcast sanity test is currently limited for real HW
459 Run Keyword If ${has_dataplane} Perform Sanity Test TT MCAST ${supress_add_subscriber}
TorstenThieme70bc5262021-01-19 12:12:55 +0000460
Huseyin Ahmet AYDIN7cb5ae62021-10-28 11:07:27 +0000461Provision Subscription TT
462 [Documentation] Provision Subscription TT
463 [Arguments] ${supress_add_subscriber}=False
464 FOR ${I} IN RANGE 0 ${num_all_onus}
465 ${src}= Set Variable ${hosts.src[${I}]}
466 ${dst}= Set Variable ${hosts.dst[${I}]}
467 ${service_type}= Get Variable Value ${src['service_type']} "null"
468 Run Keyword IF '${service_type}' != 'mcast' Provision Subscription for ONU TT ${src} ${dst}
469 ... ${supress_add_subscriber}
470 END
471
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700472Perform Sanity Test TT
473 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
474 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
475 ... This keyword can be used to call in any other tests where sanity check is required
476 ... and avoids duplication of code.
TorstenThieme70bc5262021-01-19 12:12:55 +0000477 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
478 ... In all other (common) cases flag has to be set False (default).
Hardik Windlassc609eb02022-02-22 11:28:37 +0000479 [Arguments] ${supress_add_subscriber}=False ${maclearning_enabled}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800480 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700481 ${src}= Set Variable ${hosts.src[${I}]}
482 ${dst}= Set Variable ${hosts.dst[${I}]}
483 ${service_type}= Get Variable Value ${src['service_type']} "null"
Hardik Windlassc609eb02022-02-22 11:28:37 +0000484 Run Keyword IF '${service_type}' != 'mcast' Sanity Test TT one ONU ${src} ${dst}
485 ... ${supress_add_subscriber} ${maclearning_enabled}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700486 END
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000487 # Verify Subscriber Access Flow Count
488 @{particular_onu_device_port}= Create List
489 FOR ${I} IN RANGE 0 ${num_all_onus}
490 ${src}= Set Variable ${hosts.src[${I}]}
491 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000492 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS
493 ... ${src['onu']} ${of_id} ${src['uni_id']}
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000494 Append To List ${particular_onu_device_port} ${onu_port}
495 END
496 ${list_onu_port}= Remove Duplicates ${particular_onu_device_port}
497 ${num_of_provisioned_onus}= Get Length ${list_onu_port}
498 FOR ${I} IN RANGE 0 ${olt_count}
499 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
500 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
Hardik Windlass315d6152021-06-09 08:22:44 +0000501 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000502 ${num_onus}= Set Variable ${list_olts}[${I}][onucount]
503 # Verify ONOS Flows
504 # Number of Access Flows on ONOS equals 16 * the Number of Active ONUs + 3 for default LLDP, IGMP and DHCP
505 ${onos_flows_count}= Run Keyword If ${has_dataplane} Evaluate 16 * ${num_of_provisioned_onus} + 3
506 ... ELSE Evaluate 15 * ${num_of_provisioned_onus} + 3
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700507 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000508 ... Verify Added Flow Count for OLT TT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
509 ... ${onos_flows_count}
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800510 # Verify LLDP flow in ONOS
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800511 Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800512 ... Verify LLDP Flow Added ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} 1
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000513 # Verify VOLTHA Flows
514 # Number of per OLT Flows equals 10 * Number of Active ONUs + 3 for default LLDP, IGMP and DHCP
515 ${olt_flows}= Run Keyword If ${has_dataplane} Evaluate 10 * ${num_of_provisioned_onus} + 3
516 ... ELSE Evaluate 9 * ${num_of_provisioned_onus} + 3
517 # Number of per ONU Flows equals 6 for 3play service data plane + 4 for Trap to Host Flows
518 ${onu_flows}= Run Keyword If ${has_dataplane} Set Variable 10
519 ... ELSE Set Variable 9
520 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
521 ... ${olt_device_id}
522 ${List_ONU_Serial} Create List
523 Set Suite Variable ${List_ONU_Serial}
524 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number} ${num_onus}
525 Log ${List_ONU_Serial}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000526 # TODO: Fix ${onu_flows} calculations based on UNIs provisioned
527 # Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
528 # ... ${List_ONU_Serial} ${onu_flows}
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000529 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700530
Huseyin Ahmet AYDIN7cb5ae62021-10-28 11:07:27 +0000531Provision Subscription for ONU TT
532 [Documentation] This keyword performs provision services a single ONU for TT workflow
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700533 ... Tests for one ONU
TorstenThieme70bc5262021-01-19 12:12:55 +0000534 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
535 ... In all other (common) cases flag has to be set False (default).
536 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800537 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700538 Set Global Variable ${of_id}
TorstenThiemedda37652021-11-11 16:22:05 +0000539 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700540 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000541 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000542 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700543 # Check ONU port is Enabled in ONOS
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000544 Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000545 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlassb1bda362021-11-24 11:54:36 +0000546 # Add subscriber
547 ${add_sub_cmd}= Run Keyword If ${unitag_sub}
548 ... Catenate volt-add-subscriber-unitag --tpId ${src['tp_id']} --sTag ${src['s_tag']}
549 ... --cTag ${src['c_tag']} ${src['onu']}-${src['uni_id']}
550 ... ELSE
551 ... Set Variable volt-add-subscriber-access ${of_id} ${onu_port}
TorstenThiemea36068c2021-02-19 09:57:32 +0000552 Run Keyword Unless ${supress_add_subscriber}
Hardik Windlassb1bda362021-11-24 11:54:36 +0000553 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${add_sub_cmd}
TorstenThiemea36068c2021-02-19 09:57:32 +0000554 # Verify ONU state in voltha
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000555 ${onu_reasons}= Create List omci-flows-pushed onu-reenabled
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000556 Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700557 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800558 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Huseyin Ahmet AYDIN7cb5ae62021-10-28 11:07:27 +0000559
560Sanity Test TT one ONU
561 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
562 ... Tests for one ONU
563 ... Assertions apply to HSIA, VoD, VoIP services
564 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
565 ... In all other (common) cases flag has to be set False (default).
Hardik Windlassc609eb02022-02-22 11:28:37 +0000566 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False ${maclearning_enabled}=False
Huseyin Ahmet AYDIN7cb5ae62021-10-28 11:07:27 +0000567 Provision Subscription for ONU TT ${src} ${dst} ${supress_add_subscriber}
568 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
569 Set Global Variable ${of_id}
570 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
571 ... ${of_id} ${src['uni_id']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700572 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
573 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
574 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
575 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
576 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
577 ... ${dst['container_name']}
Hardik Windlassc609eb02022-02-22 11:28:37 +0000578 Run Keyword If '${src['service_type']}'!='hsia'
579 ... Run Keywords
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000580 ... Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -0700581 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri42819412020-10-01 17:45:43 -0700582 ... ${src['c_tag']}
Hardik Windlassc609eb02022-02-22 11:28:37 +0000583 ... AND Run Keyword If ${maclearning_enabled}
584 ... Wait Until Keyword Succeeds ${timeout} 5s Validate Mac Learner Mapping in ONOS
585 ... ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port} ${src['c_tag']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700586
587Perform Sanity Test TT MCAST
588 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
589 ... Adds subscribers
590 ... Validates for MCAST
TorstenThieme70bc5262021-01-19 12:12:55 +0000591 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
592 ... In all other (common) cases flag has to be set False (default).
593 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800594 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700595 ${src}= Set Variable ${hosts.src[${I}]}
596 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700597 ${service_type}= Get Variable Value ${src['service_type']} "null"
598 Run Keyword IF '${service_type}' == 'mcast' Sanity Test TT MCAST one ONU ${src}
TorstenThiemea36068c2021-02-19 09:57:32 +0000599 ... ${dst} ${supress_add_subscriber}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700600 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700601
602Sanity Test TT MCAST one ONU
603 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
604 ... Tests for one ONU
605 ... Assertions apply to MCAST services
TorstenThieme70bc5262021-01-19 12:12:55 +0000606 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
607 ... In all other (common) cases flag has to be set False (default).
608 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700609 # Check for iperf and jq tools
610 ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf jq
611 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
612 ... ${src['container_name']}
613 Pass Execution If ${rc} != 0 Skipping test: iperf / jq not found on the RG
614
615 #Reset the IP on the interface
616 ${output}= Login And Run Command On Remote System sudo ifconfig ${src['dp_iface_name']} 0
617 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
618 # Kill iperf on BNG
619 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
620 ... sudo kill -9 `pidof iperf`
621 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
622 ... ${dst['container_name']}
623
624 # Setup RG for Multi-cast test
625 ${output}= Login And Run Command On Remote System
626 ... sudo ifconfig ${src['dp_iface_name']} ${src['mcast_rg']} up ; sudo kill -9 `pidof iperf`
627 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
628 ${output}= Login And Run Command On Remote System
629 ... sudo ip route add ${src['mcast_grp_subnet_mask']} dev ${src['dp_iface_name']} scope link
630 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
631
632 # Perform operations for adding subscriber
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800633 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700634 Set Global Variable ${of_id}
TorstenThiemedda37652021-11-11 16:22:05 +0000635 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700636 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000637 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000638 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700639 # Check ONU port is Enabled in ONOS
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000640 Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000641 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000642 Run Keyword Unless ${supress_add_subscriber}
TorstenThieme4e2168e2021-06-22 14:01:47 +0000643 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700644 ... volt-add-subscriber-access ${of_id} ${onu_port}
TorstenThiemea36068c2021-02-19 09:57:32 +0000645 # Verify ONU state in voltha
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000646 ${onu_reasons}= Create List omci-flows-pushed onu-reenabled
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000647 Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700648 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800649 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700650
651 # Setup iperf on the BNG
652 ${server_output}= Login And Run Command On Remote System
653 ... sudo iperf -c ${dst['dp_iface_ip_qinq']} -u -T 32 -t 60 -i 1 &
654 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
655 ... ${dst['container_name']}
656
657 # Setup iperf on the RG
658 ${rg_output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
659 ... Login And Run Command On Remote System
660 ... rm -rf /tmp/rg_output ; sudo iperf -s -u -B ${dst['dp_iface_ip_qinq']} -i 1 -D >> /tmp/rg_output
661 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
662 Log ${rg_output}
663 Sleep 60s
664 ${output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
665 ... Login And Run Command On Remote System
666 ... cat /tmp/rg_output | grep KBytes
667 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
668 Log ${output}
669 Should Contain ${output} KBytes
670
671 # Kill iperf on BNG
672 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
673 ... sudo kill -9 `pidof iperf`
674 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
675 ... ${dst['container_name']}
676
677 # Kill iperf on the RG
678 ${output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
679 ... sudo kill -9 `pidof iperf`
680 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
681
Hardik Windlass62db9d92021-05-17 09:32:40 +0000682Setup Soak
683 [Documentation] Pre-test Setup for Soak Job
684 ${olt_ids} Create List
685 FOR ${I} IN RANGE 0 ${num_olts}
686 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
687 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
688 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
689 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
690 ... ${olt_serial_number}
TorstenThiemedda37652021-11-11 16:22:05 +0000691 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Hardik Windlass62db9d92021-05-17 09:32:40 +0000692 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
693 ... of_id ${of_id} sn ${olt_serial_number}
694 Append To List ${olt_ids} ${olt}
695 END
696 Set Global Variable ${olt_ids}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700697
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000698Setup
699 [Documentation] Pre-test Setup
Hardik Windlass4ed54502021-05-14 07:34:15 +0000700 [Arguments] ${skip_empty_device_list_test}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000701 #test for empty device list
Hardik Windlass4ed54502021-05-14 07:34:15 +0000702 Run Keyword If '${skip_empty_device_list_test}'=='False' Test Empty Device List
Hardik Windlass5e214b22021-02-26 10:37:14 +0000703 # TBD: Need for this Sleep
704 Run Keyword If ${has_dataplane} Sleep 180s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800705 # Create a list of olt ids (logical and device_id)
706 ${olt_ids} Create List
707 FOR ${I} IN RANGE 0 ${num_olts}
708 #create/preprovision device
Andrea Campanella3dcce272021-01-15 16:04:47 +0100709 ${olt_device_id}= Run Keyword If "${list_olts}[${I}][type]" == "${None}"
Suchitra Vemuri09f878d2021-02-10 18:19:04 -0800710 ... Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport]
711 ... ELSE Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport] ${list_olts}[${I}][type]
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800712 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
713 #Set Suite Variable ${olt_device_id}
714 #validate olt states
715 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass8b446492021-06-10 06:25:23 +0000716 ... Validate OLT Device PREPROVISIONED UNKNOWN UNKNOWN ${olt_device_id} by_dev_id=True
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800717 Sleep 5s
718 Enable Device ${olt_device_id}
Suchitra Vemuricf6e89c2021-03-24 19:14:15 -0700719 # Increasing the timer to incorporate wait time for in-band
720 Wait Until Keyword Succeeds 540s 5s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800721 ... Validate OLT Device ENABLED ACTIVE REACHABLE ${olt_serial_number}
722 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
723 # Set Suite Variable ${logical_id}
724 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
725 ... ${olt_serial_number}
726 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
727 ... of_id ${of_id} sn ${olt_serial_number}
728 Append To List ${olt_ids} ${olt}
729 END
730 Set Global Variable ${olt_ids}
731
732Get ofID From OLT List
733 [Documentation] Retrieves the corresponding of_id for the OLT serial number specified
734 [Arguments] ${serial_number}
735 FOR ${I} IN RANGE 0 ${olt_count}
736 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100737 ${of_id}= Run Keyword IF "${serial_number}"=="${sn}"
738 ... Get From Dictionary ${olt_ids}[${I}] of_id ELSE Set Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800739 END
740 [Return] ${of_id}
741
742Get OLTDeviceID From OLT List
743 [Documentation] Retrieves the corresponding olt_device_id for the OLT serial number specified
744 [Arguments] ${serial_number}
Suchitra Vemuri4b8f4f52020-11-17 19:12:50 -0800745 ${olt_device_id}= Set Variable 0
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800746 FOR ${I} IN RANGE 0 ${olt_count}
747 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100748 ${olt_device_id}= Run Keyword IF "${serial_number}"=="${sn}"
749 ... Get From Dictionary ${olt_ids}[${I}] device_id ELSE Set Variable ${olt_device_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800750 END
751 [Return] ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000752
Andrea Campanellad848de02020-11-24 10:23:41 +0100753Get Num of Onus From OLT SN
754 [Documentation] Retrieves the corresponding number of ONUs for a given OLT based on serial number specified
755 [Arguments] ${serial_number}
756 ${num_of_olt_onus}= Set Variable 0
757 FOR ${I} IN RANGE 0 ${olt_count}
758 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
759 ${num_of_olt_onus}= Run Keyword IF "${serial_number}"=="${sn}"
760 ... Get From Dictionary ${list_olts}[${I}] onucount ELSE Set Variable ${num_of_olt_onus}
761 END
762 [Return] ${num_of_olt_onus}
763
Hardik Windlassaaea3402020-03-10 19:45:45 +0530764Validate ONUs After OLT Disable
765 [Documentation] Validates the ONUs state in Voltha, ONUs port state in ONOS
766 ... and that pings do not succeed After corresponding OLT is Disabled
Andrea Campanella4e507882020-11-26 11:33:11 +0100767 [Arguments] ${num_onus} ${olt_serial_number}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530768 FOR ${I} IN RANGE 0 ${num_onus}
769 ${src}= Set Variable ${hosts.src[${I}]}
770 ${dst}= Set Variable ${hosts.dst[${I}]}
Andrea Campanella4e507882020-11-26 11:33:11 +0100771 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800772 ${of_id}= Get ofID From OLT List ${src['olt']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530773 ${onu_device_id}= Get Device ID From SN ${src['onu']}
774 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
775 ... ${of_id}
Girish Gowdra3f0fadb2021-11-08 16:49:28 -0800776 ${valid_onu_states}= Create List stopping-openomci omci-flows-deleted
Hardik Windlassaaea3402020-03-10 19:45:45 +0530777 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
778 ... Validate Device ENABLED DISCOVERED
Girish Gowdra3f0fadb2021-11-08 16:49:28 -0800779 ... UNREACHABLE ${src['onu']} onu=True onu_reason=${valid_onu_states}
Hardik Windlass58b23a32022-05-10 11:06:48 +0530780 Wait Until Keyword Succeeds ${timeout} 2s
Emrehan UZUNabef5182021-11-26 10:54:24 +0000781 ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530782 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass58b23a32022-05-10 11:06:48 +0530783 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlassaaea3402020-03-10 19:45:45 +0530784 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
785 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530786 END
787
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000788Delete All Devices and Verify
789 [Documentation] Remove any devices from VOLTHA and ONOS
Hardik Windlassc609eb02022-02-22 11:28:37 +0000790 [Arguments] ${maclearning_enabled}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000791 # Clear devices from VOLTHA
792 Disable Devices In Voltha Root=true
793 Wait Until Keyword Succeeds ${timeout} 2s Test Devices Disabled In Voltha Root=true
794 Delete Devices In Voltha Root=true
795 Wait Until Keyword Succeeds ${timeout} 2s Test Empty Device List
Hardik Windlasse8b99222021-01-25 10:03:14 +0000796 FOR ${I} IN RANGE 0 ${num_olts}
797 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
Matteo Scandolo71ff08a2021-10-21 17:47:27 -0700798 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlasse8b99222021-01-25 10:03:14 +0000799 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
Hardik Windlassc609eb02022-02-22 11:28:37 +0000800 ... ${maclearning_enabled}
Hardik Windlasse8b99222021-01-25 10:03:14 +0000801 END
Hardik Windlass44abec12021-09-27 07:52:33 +0000802 Wait Until Keyword Succeeds ${timeout} 5s Validate Cleanup In ETCD ${INFRA_NAMESPACE}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000803
804Teardown
805 [Documentation] kills processes and cleans up interfaces on src+dst servers
806 Run Keyword If ${has_dataplane} Clean Up Linux
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000807
808Teardown Suite
809 [Documentation] Clean up device if desired
Andrea Campanella82add372021-11-05 12:01:15 +0100810 Start Logging Setup or Teardown Teardown-${SUITE NAME}
Hardik Windlass81375222021-12-02 10:48:01 +0000811 Run Keyword If ${has_dataplane} Clean Up Linux
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000812 Run Keyword If ${teardown_device} Delete All Devices and Verify
Andrea Campanella1ff03222021-09-10 10:14:21 +0200813 Run Keyword And Continue On Failure Collect Logs
TorstenThieme4e2168e2021-06-22 14:01:47 +0000814 Close All ONOS SSH Connections
Hardik Windlass81375222021-12-02 10:48:01 +0000815 Run Keyword If ${has_dataplane} Clean Up All Nodes
Andrea Campanella82add372021-11-05 12:01:15 +0100816 Stop Logging Setup or Teardown Teardown-${SUITE NAME}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000817
818Delete Device and Verify
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800819 [Arguments] ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000820 [Documentation] Disable -> Delete devices via voltctl and verify its removed
Suchitra Vemuri2fa9bba2020-01-22 17:38:48 -0800821 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000822 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800823 ... voltctl -c ${VOLTCTL_CONFIG} device disable ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000824 Should Be Equal As Integers ${rc} 0
825 Sleep 5s
826 Wait Until Keyword Succeeds ${timeout} 5s
827 ... Validate OLT Device DISABLED UNKNOWN REACHABLE ${olt_serial_number}
828 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800829 ... voltctl -c ${VOLTCTL_CONFIG} device delete ${olt_device_id}
Hardik Windlassdf5035e2021-01-27 08:34:59 +0000830 Sleep 50s
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000831 Should Be Equal As Integers ${rc} 0
832 Wait Until Keyword Succeeds ${timeout} 5s Validate Device Removed ${olt_device_id}
Hardik Windlasse8b99222021-01-25 10:03:14 +0000833 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 15s
834 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000835
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000836Repeat Sanity Test
837 [Documentation] This keyword performs Sanity Test Procedure
838 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
839 ... This keyword can be used to call in any other tests where sanity check is required
840 ... with wpa reassociation
841 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
842 Set Global Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800843 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000844 ${src}= Set Variable ${hosts.src[${I}]}
845 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800846 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Emrehan UZUNabef5182021-11-26 10:54:24 +0000847 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800848 # Check ONU port is Enabled in ONOD
849 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Emrehan UZUNabef5182021-11-26 10:54:24 +0000850 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800851 # Verify EAPOL flows are added for the ONU port
852 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700853 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800854 # Verify ONU state in voltha
Suchitra Vemurid1e27fb2020-02-01 16:34:37 -0800855 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri81e4f022020-02-01 13:16:02 -0800856 ... ENABLED ACTIVE REACHABLE
857 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800858 # Perform Authentication
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000859 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
860 ... Validate Authentication After Reassociate
861 ... True ${src['dp_iface_name']} ${src['ip']} ${src['user']} ${src['pass']}
862 ... ${src['container_type']} ${src['container_name']}
863 Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800864 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000865 Wait Until Keyword Succeeds ${timeout} 2s
TorstenThieme4e2168e2021-06-22 14:01:47 +0000866 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000867 ... volt-add-subscriber-access ${of_id} ${onu_port}
868 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
869 ... Validate DHCP and Ping True True
870 ... ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
871 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
872 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
873 ... ${dst['container_name']}
874 Wait Until Keyword Succeeds ${timeout} 2s Run Keyword And Continue On Failure
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800875 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000876 END
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +0000877
Hardik Windlass41701e82021-01-12 17:44:44 +0000878Disable Enable PON Port Per OLT
879 [Arguments] ${olt_serial_number}
880 [Documentation] This keyword disables and then enables OLT PON port and
881 ... also validate ONUs for each corresponding case
882 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
883 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
884 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
885 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
886 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
887 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
888 # Disable the OLT PON Port and Validate OLT Device
889 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
890 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
891 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
892 ... DISABLED DISCOVERED
893 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
894 ... Validate OLT Device ENABLED ACTIVE REACHABLE
895 ... ${olt_serial_number}
Hardik Windlass58b23a32022-05-10 11:06:48 +0530896 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +0000897 ... Validate ONUs for PON OLT Disable ${olt_serial_number} ${olt_peer_list}
898 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
899 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
Hardik Windlass58b23a32022-05-10 11:06:48 +0530900 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +0000901 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
902 ... ENABLED ACTIVE
Hardik Windlass58b23a32022-05-10 11:06:48 +0530903 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +0000904 ... Validate ONUs for PON OLT Enable ${olt_serial_number} ${olt_peer_list}
905 END
906
Hardik Windlass16cdf962020-04-29 15:26:50 +0530907Validate ONUs for PON OLT Disable
Hardik Windlass41701e82021-01-12 17:44:44 +0000908 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530909 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
910 ... And Pings succeed for other Active OLT PON port ONUs
911 ... Also it removes subscriber for Disabled OLT PON port ONUs to replicate ATT workflow
Hardik Windlass41701e82021-01-12 17:44:44 +0000912 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530913 ${src}= Set Variable ${hosts.src[${I}]}
914 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000915 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530916 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000917 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530918 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000919 ... ${of_id} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530920 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
921 Run Keyword If ${matched}
922 ... Run Keywords
923 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
924 ... Validate Device ENABLED DISCOVERED
Andrea Campanellaa9b59b42021-09-21 16:13:17 +0000925 ... UNREACHABLE ${src['onu']} onu=True onu_reason=omci-flows-deleted
Hardik Windlass58b23a32022-05-10 11:06:48 +0530926 ... AND Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000927 ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530928 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass58b23a32022-05-10 11:06:48 +0530929 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +0530930 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
931 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
932 ... ${src['container_name']}
933 # Remove Subscriber Access (To replicate ATT workflow)
TorstenThieme4e2168e2021-06-22 14:01:47 +0000934 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection
935 ... ${ONOS_SSH_IP} ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
Hardik Windlass223a1732021-07-09 05:21:40 +0000936 # Additional Sleep to let subscriber delete process
937 ... AND Sleep 5s
Hardik Windlass16cdf962020-04-29 15:26:50 +0530938 ... ELSE
939 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass58b23a32022-05-10 11:06:48 +0530940 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +0530941 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
942 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
943 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530944 END
945
946Validate ONUs for PON OLT Enable
Hardik Windlass41701e82021-01-12 17:44:44 +0000947 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530948 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
949 ... Also performs Auth/subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800950 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530951 ${src}= Set Variable ${hosts.src[${I}]}
952 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000953 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530954 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000955 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
TorstenThiemedda37652021-11-11 16:22:05 +0000956 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530957 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000958 ... ${of_id} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530959 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
960 ${wpa_log}= Run Keyword If ${has_dataplane} and ${matched} Catenate SEPARATOR=.
961 ... /tmp/wpa ${src['dp_iface_name']} log
962 Run Keyword If ${matched}
963 ... Run Keywords
964 # Perform Cleanup
965 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
966 # Verify ONU port status
Hardik Windlass58b23a32022-05-10 11:06:48 +0530967 ... AND Wait Until Keyword Succeeds 120s 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000968 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530969 # Verify EAPOL flows are added for the ONU port
970 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700971 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530972 # Verify ONU state in voltha
Hardik Windlass58b23a32022-05-10 11:06:48 +0530973 ... AND Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass16cdf962020-04-29 15:26:50 +0530974 ... Validate Device ENABLED ACTIVE REACHABLE
975 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
976 # Perform Authentication
977 ... AND Run Keyword If ${has_dataplane}
978 ... Run Keyword And Continue On Failure Validate Authentication True
979 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
980 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
Hardik Windlass58b23a32022-05-10 11:06:48 +0530981 ... AND Wait Until Keyword Succeeds ${timeout} 2
Hardik Windlass16cdf962020-04-29 15:26:50 +0530982 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Hardik Windlass58b23a32022-05-10 11:06:48 +0530983 ... AND Wait Until Keyword Succeeds ${timeout} 2
TorstenThieme4e2168e2021-06-22 14:01:47 +0000984 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530985 ... volt-add-subscriber-access ${of_id} ${onu_port}
986 # Verify that no pending flows exist for the ONU port
987 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
988 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
989 # Verify subscriber access flows are added for the ONU port
Hardik Windlass58b23a32022-05-10 11:06:48 +0530990 ... AND Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass16cdf962020-04-29 15:26:50 +0530991 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
992 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
993 ... AND Run Keyword If ${has_dataplane}
994 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
995 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
996 ... ${src['ip']} ${src['user']} ${src['pass']}
997 ... ${src['container_type']} ${src['container_name']}
998 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
999 ... ${dst['container_type']} ${dst['container_name']}
Hardik Windlass58b23a32022-05-10 11:06:48 +05301000 ... AND Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301001 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
1002 ... AND Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
1003 ... ELSE
1004 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass58b23a32022-05-10 11:06:48 +05301005 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301006 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1007 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
1008 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301009 END
1010
Hardik Windlass41701e82021-01-12 17:44:44 +00001011Disable Enable PON Port Per OLT DT
1012 [Arguments] ${olt_serial_number}
1013 [Documentation] This keyword disables and then enables OLT PON port and
1014 ... also validate ONUs for each corresponding case
1015 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
1016 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
1017 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
1018 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
1019 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
1020 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
TorstenThieme17d6fd22021-09-23 10:00:08 +00001021 ${olt_peer_list_len}= Get Length ${olt_peer_list}
Hardik Windlass41701e82021-01-12 17:44:44 +00001022 # Disable the OLT PON Port and Validate OLT Device
1023 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
1024 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
1025 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
1026 ... DISABLED DISCOVERED
1027 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
1028 ... Validate OLT Device ENABLED ACTIVE REACHABLE
1029 ... ${olt_serial_number}
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001030 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +00001031 ... Validate ONUs for PON OLT Disable DT ${olt_serial_number} ${olt_peer_list}
Hardik Windlass41701e82021-01-12 17:44:44 +00001032 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
1033 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001034 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +00001035 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
1036 ... ENABLED ACTIVE
TorstenThieme17d6fd22021-09-23 10:00:08 +00001037 ${olt_peer_list_new}= Wait Until Keyword Succeeds ${timeout} 5s
1038 ... Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port} ${olt_peer_list_len}
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001039 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +00001040 ... Validate ONUs for PON OLT Enable DT ${olt_serial_number} ${olt_peer_list_new}
1041 END
1042
Hardik Windlass16cdf962020-04-29 15:26:50 +05301043Validate ONUs for PON OLT Disable DT
Hardik Windlass41701e82021-01-12 17:44:44 +00001044 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301045 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
1046 ... And Pings succeed for other Active OLT PON port ONUs
1047 ... Also it removes subscriber and deletes ONUs for Disabled OLT PON port to replicate DT workflow
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001048 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301049 ${src}= Set Variable ${hosts.src[${I}]}
1050 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +00001051 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +05301052 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +00001053 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301054 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
Emrehan UZUNabef5182021-11-26 10:54:24 +00001055 ... ${of_id} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301056 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
Girish Gowdra3f0fadb2021-11-08 16:49:28 -08001057 ${valid_onu_states}= Create List stopping-openomci omci-flows-deleted
Hardik Windlass16cdf962020-04-29 15:26:50 +05301058 Run Keyword If ${matched}
1059 ... Run Keywords
1060 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
1061 ... Validate Device ENABLED DISCOVERED
Girish Gowdra3f0fadb2021-11-08 16:49:28 -08001062 ... UNREACHABLE ${src['onu']} onu=True onu_reason=${valid_onu_states}
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001063 ... AND Wait Until Keyword Succeeds ${timeout} 2s
Emrehan UZUNabef5182021-11-26 10:54:24 +00001064 ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301065 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001066 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301067 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1068 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
1069 ... ${src['container_name']}
1070 # Remove Subscriber Access (To replicate DT workflow)
TorstenThieme4e2168e2021-06-22 14:01:47 +00001071 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection
1072 ... ${ONOS_SSH_IP} ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301073 # Delete ONU Device (To replicate DT workflow)
1074 ... AND Delete Device ${onu_device_id}
Hardik Windlass223a1732021-07-09 05:21:40 +00001075 # Additional Sleep to let subscriber and ONU delete process
1076 ... AND Sleep 10s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301077 ... ELSE
1078 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001079 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301080 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1081 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
1082 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301083 END
1084
1085Validate ONUs for PON OLT Enable DT
Hardik Windlass41701e82021-01-12 17:44:44 +00001086 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301087 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
1088 ... Also performs subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001089 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301090 ${src}= Set Variable ${hosts.src[${I}]}
1091 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +00001092 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +05301093 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +00001094 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
TorstenThiemedda37652021-11-11 16:22:05 +00001095 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301096 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
Emrehan UZUNabef5182021-11-26 10:54:24 +00001097 ... ${of_id} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301098 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
1099 Run Keyword If ${matched}
1100 ... Run Keywords
1101 # Perform Cleanup
1102 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
1103 # Verify ONU port status
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001104 ... AND Wait Until Keyword Succeeds 120s 2s
Emrehan UZUNabef5182021-11-26 10:54:24 +00001105 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001106 ... AND Wait Until Keyword Succeeds ${timeout} 2
TorstenThieme4e2168e2021-06-22 14:01:47 +00001107 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301108 ... volt-add-subscriber-access ${of_id} ${onu_port}
1109 # Verify ONU state in voltha
1110 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
1111 ... Validate Device ENABLED ACTIVE REACHABLE
1112 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
1113 # Verify subscriber access flows are added for the ONU port
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001114 ... AND Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301115 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
1116 ... ${onu_port} ${nni_port} ${src['s_tag']}
1117 ... AND Run Keyword If ${has_dataplane}
1118 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
1119 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
1120 ... ${src['ip']} ${src['user']} ${src['pass']}
1121 ... ${src['container_type']} ${src['container_name']}
1122 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1123 ... ${dst['container_type']} ${dst['container_name']}
1124 ... ELSE
1125 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001126 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301127 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1128 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
1129 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301130 END
1131
1132Match ONU in PON OLT Peer List
1133 [Arguments] ${olt_peer_list} ${onu_device_id}
1134 [Documentation] This keyword matches if ONU device is present in OLT PON port peer list
1135 ${matched}= Set Variable False
1136 FOR ${olt_peer} IN @{olt_peer_list}
1137 ${matched}= Set Variable If '${onu_device_id}' == '${olt_peer}' True False
1138 Exit For Loop If ${matched}
1139 END
1140 [Return] ${matched}
1141
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +00001142Collect Logs
1143 [Documentation] Collect Logs from voltha and onos cli for various commands
1144 Run Keyword and Ignore Error Get Device List from Voltha
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001145 FOR ${I} IN RANGE 0 ${num_olts}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001146 Run Keyword and Ignore Error Get Device Output from Voltha ${olt_ids}[${I}][device_id]
1147 Run Keyword and Ignore Error Get Logical Device Output from Voltha ${olt_ids}[${I}][logical_id]
1148 END
1149 #Run Keyword and Ignore Error Get Device Output from Voltha ${olt_device_id}
1150 #Run Keyword and Ignore Error Get Logical Device Output from Voltha ${logical_id}
ubuntu6b6e7d42020-03-02 12:35:42 -08001151 Get ONOS Status ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001152
Hardik Windlassb75cf1b2021-01-18 06:59:09 +00001153Verify ping is successful except for given device
1154 [Arguments] ${num_onus} ${exceptional_onu}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001155 [Documentation] Checks that ping for all the devices are successful except the given ONU.
1156 ${pingStatus} Set Variable True
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001157 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001158 ${src}= Set Variable ${hosts.src[${I}]}
1159 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlassb75cf1b2021-01-18 06:59:09 +00001160 ${pingStatus} Run Keyword If '${src['onu']}' == '${exceptional_onu}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001161 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1162 ... Wait Until Keyword Succeeds 60s 2s
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001163 ... Check Ping ${pingStatus} ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1164 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1165 END
Andy Bavier4a8450e2020-02-04 08:58:37 -07001166
Suchitra Vemurife309412020-12-01 19:19:52 -08001167Verify ping is successful for ONUs not on this OLT
1168 [Arguments] ${num_all_onus} ${exceptional_olt_id}
1169 [Documentation] Checks that pings work for all the ONUs except for the ONUs on the given OLT.
1170 #${pingStatus} Set Variable True
1171 FOR ${I} IN RANGE 0 ${num_all_onus}
1172 ${src}= Set Variable ${hosts.src[${I}]}
1173 ${dst}= Set Variable ${hosts.dst[${I}]}
1174 ${olt_device_id}= Get Device ID From SN ${src['olt']}
1175 Continue For Loop If "${olt_device_id}"=="${exceptional_olt_id}"
1176 #${pingStatus} Run Keyword If '${olt_device_id}' == '${exceptional_olt_id}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001177 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1178 ... Wait Until Keyword Succeeds 60s 2s
Suchitra Vemurife309412020-12-01 19:19:52 -08001179 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1180 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1181 END
1182
Andy Bavier1923ecc2020-06-18 14:06:40 -07001183Echo Message to OLT Logs
1184 [Arguments] ${message}
1185 [Documentation] Echoes ${message} into the OLT logs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001186 FOR ${I} IN RANGE 0 ${num_olts}
1187 ${olt_user} Evaluate ${olts}[${I}].get("user")
1188 ${olt_pass} Evaluate ${olts}[${I}].get("pass")
1189 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
TorstenThieme10bddb42022-05-02 12:28:00 +00001190 ${olt_type} Evaluate ${olts}[${I}].get("type")
Andrea Campanellaebf6f0d2021-01-12 13:10:29 +01001191 Continue For Loop If "${olt_user}" == "${None}"
1192 Continue For Loop If "${olt_pass}" == "${None}"
TorstenThieme10bddb42022-05-02 12:28:00 +00001193 ${command_timeout}= Set Variable If "${olt_type}"=="adtranolt" 300s 180s
1194 Wait Until Keyword Succeeds ${command_timeout} 10s Execute Remote Command
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001195 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt.log
1196 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
TorstenThieme10bddb42022-05-02 12:28:00 +00001197 Wait Until Keyword Succeeds ${command_timeout} 10s Execute Remote Command
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001198 ... printf '%s\n' '' '' '${message}' '' >> /var/log/dev_mgmt_daemon.log
1199 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
TorstenThieme10bddb42022-05-02 12:28:00 +00001200 Wait Until Keyword Succeeds ${command_timeout} 10s Execute Remote Command
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001201 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt_process_watchdog.log
1202 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1203 END
Andy Bavier1923ecc2020-06-18 14:06:40 -07001204
Andy Bavierabeba262020-02-07 16:22:16 -07001205Start Logging
1206 [Arguments] ${label}
1207 [Documentation] Start logging for test ${label}
Hardik Windlass9e3db232021-10-14 07:10:47 +00001208 ${kail_process}= Run Keyword If "${container_log_dir}" != "${None}" Start Process kail -n ${NAMESPACE}
Hardik Windlassa9a896a2021-11-23 04:31:51 +00001209 ... -n ${INFRA_NAMESPACE} cwd=${container_log_dir} stdout=${label}-combined.log
Andy Bavierabeba262020-02-07 16:22:16 -07001210 Set Test Variable ${kail_process}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001211 Run Keyword If ${has_dataplane} Echo Message to OLT Logs START ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001212
Andrea Campanella82add372021-11-05 12:01:15 +01001213Start Logging Setup or Teardown
1214 [Arguments] ${label}
1215 [Documentation] Start logging for suite ${label}
Matteo Scandolo6a90bda2021-11-30 11:31:38 -08001216 ${file}= Replace String ${label} ${SPACE} -
Andrea Campanella82add372021-11-05 12:01:15 +01001217 ${kail_process}= Run Keyword If "${container_log_dir}" != "${None}" Start Process kail -n ${NAMESPACE}
Matteo Scandolo6a90bda2021-11-30 11:31:38 -08001218 ... -n ${INFRA_NAMESPACE} cwd=${container_log_dir} stdout=${file}-combined.log
Andrea Campanella82add372021-11-05 12:01:15 +01001219 Set Suite Variable ${kail_process}
1220 Run Keyword If ${has_dataplane} Echo Message to OLT Logs START ${label}
1221
1222Stop Logging Setup or Teardown
1223 [Arguments] ${label}
1224 [Documentation] End logging for suite;
1225 Run sync
1226 Run Keyword If ${kail_process} Terminate Process ${kail_process}
1227 ${test_logfile}= Run Keyword If "${container_log_dir}" != "${None}"
1228 ... Join Path ${container_log_dir} ${label}-combined.log
1229 Run Keyword If ${has_dataplane} Echo Message to OLT Logs END ${label}
1230
Andy Bavierabeba262020-02-07 16:22:16 -07001231Stop Logging
1232 [Arguments] ${label}
Matteo Scandoloda1c64b2021-07-20 10:14:49 -07001233 [Documentation] End logging for test; remove logfile if test passed and ${logging} is set to False
Andy Bavierabeba262020-02-07 16:22:16 -07001234 Run sync
1235 Run Keyword If ${kail_process} Terminate Process ${kail_process}
1236 ${test_logfile}= Run Keyword If "${container_log_dir}" != "${None}"
1237 ... Join Path ${container_log_dir} ${label}-combined.log
Matteo Scandoloda1c64b2021-07-20 10:14:49 -07001238 Run Keyword If Test Passed
1239 ... Run Keyword If "${logging}" == "False"
1240 ... Run Keyword If "${test_logfile}" != "${None}"
1241 ... Remove File ${test_logfile}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001242 Run Keyword If ${has_dataplane} Echo Message to OLT Logs END ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001243
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001244Clean Up Linux
1245 [Documentation] Kill processes and clean up interfaces on src+dst servers
Hardik Windlass16cdf962020-04-29 15:26:50 +05301246 [Arguments] ${onu_id}=${EMPTY}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001247 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001248 ${src}= Set Variable ${hosts.src[${I}]}
1249 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301250 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1251 Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
Andy Bavier84b83282020-06-30 05:47:49 -07001252 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001253 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001254 Execute Remote Command sudo pkill dhclient ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001255 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Baviereff938d2020-06-29 18:27:49 -07001256 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1257 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1258 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1259 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001260 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1261 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1262 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1263 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1264 ... ${dst['container_type']} ${dst['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001265 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1266 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1267 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
Andy Bavierf4b7d1d2020-06-30 11:14:04 -07001268 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1269 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
Andy Baviereff938d2020-06-29 18:27:49 -07001270 ... ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001271 END
Scott Baker60e570d2020-02-02 22:10:13 -08001272
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001273Clean Up Linux Per OLT
1274 [Documentation] Kill processes and clean up interfaces on src+dst servers
1275 [Arguments] ${olt_serial_number}
1276 FOR ${I} IN RANGE 0 ${num_all_onus}
1277 ${src}= Set Variable ${hosts.src[${I}]}
1278 ${dst}= Set Variable ${hosts.dst[${I}]}
1279 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1280 ${sn}= Get Device ID From SN ${src['olt']}
1281 #Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
1282 Continue For Loop If '${olt_serial_number}' == '${sn}'
1283 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
1284 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1285 Execute Remote Command sudo pkill dhclient ${src['ip']}
1286 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1287 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1288 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1289 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1290 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
1291 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1292 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1293 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1294 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1295 ... ${dst['container_type']} ${dst['container_name']}
1296 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1297 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1298 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
1299 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1300 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
1301 ... ${dst['container_type']} ${dst['container_name']}
1302 END
1303
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001304Clean dhclient
1305 [Documentation] Kills dhclient processes only for all RGs
Hardik Windlass41701e82021-01-12 17:44:44 +00001306 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001307 ${src}= Set Variable ${hosts.src[${I}]}
1308 ${dst}= Set Variable ${hosts.dst[${I}]}
1309 Execute Remote Command sudo pkill dhclient ${src['ip']}
1310 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1311 END
1312
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001313Clean WPA Process
1314 [Documentation] Kills wpa_supplicant processes only for all RGs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001315 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001316 ${src}= Set Variable ${hosts.src[${I}]}
1317 ${dst}= Set Variable ${hosts.dst[${I}]}
1318 Run Keyword And Ignore Error Kill Linux Process [w]pa_supplicant ${src['ip']}
1319 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1320 END
1321
Scott Baker60e570d2020-02-02 22:10:13 -08001322Should Be Larger Than
1323 [Documentation] Verify that value_1 is > value_2
1324 [Arguments] ${value_1} ${value_2}
1325 Run Keyword If ${value_1} <= ${value_2}
1326 ... Fail The value ${value_1} is not larger than ${value_2}
1327
Scott Bakeree675552020-02-11 10:43:34 -08001328Should Be Larger Than Or Equal To
1329 [Documentation] Verify that value_1 is >= value_2
1330 [Arguments] ${value_1} ${value_2}
1331 Run Keyword If ${value_1} < ${value_2}
1332 ... Fail The value ${value_1} is not larger than or equal to ${value_2}
1333
Huseyin Ahmet AYDIN175d1582021-11-23 14:51:41 +00001334Should Be Lower Than
1335 [Documentation] Verify that value_1 is < value_2
1336 [Arguments] ${value_1} ${value_2}
1337 Run Keyword If ${value_1} >= ${value_2}
1338 ... Fail The value ${value_1} is not lower than ${value_2}
1339
Scott Baker60e570d2020-02-02 22:10:13 -08001340Should Be Float
1341 [Documentation] Verify that value is a floating point number type
1342 [Arguments] ${value}
1343 ${type} Evaluate type(${value}).__name__
1344 Should Be Equal ${type} float
1345
Scott Bakeree675552020-02-11 10:43:34 -08001346Should Be Newer Than Or Equal To
1347 [Documentation] Compare two RFC3339 dates
1348 [Arguments] ${value_1} ${value_2}
1349 ${unix_v1} Parse RFC3339 ${value_1}
1350 ${unix_v2} Parse RFC3339 ${value_2}
1351 Run Keyword If ${unix_v1} < ${unix_v2}
1352 ... Fail The value ${value_1} is not newer than or equal to ${value_2}
1353
Scott Baker60e570d2020-02-02 22:10:13 -08001354Get Current Time
1355 [Documentation] Return the current time in RFC3339 format
1356 ${output}= Run date -u +"%FT%T%:z"
1357 [return] ${output}
Scott Bakeree675552020-02-11 10:43:34 -08001358
1359Parse RFC3339
1360 [Documentation] Parse an RFC3339 timestamp
1361 [Arguments] ${dateStr}
1362 ${rc} ${output}= Run and Return Rc and Output date --date="${dateStr}" "+%s"
1363 Should Be Equal As Numbers ${rc} 0
1364 [return] ${output}
Matteo Scandolo142e6272020-04-29 17:36:59 -07001365
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001366Get Bandwidth Profile Name For Given Subscriber
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001367 [Arguments] ${subscriber_id} ${stream_type}=upstreamBandwidthProfile ${service_type}=${EMPTY}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001368 [Documentation] Keyword to get the bandwidth details of the given subscriber
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001369 ${service_type_upper}= Run Keyword If '${service_type}' != '${EMPTY}'
1370 ... Convert To Upper Case ${service_type}
1371 ${bandwidth_profile_output}= Run Keyword If '${service_type}' != '${EMPTY}'
TorstenThieme4e2168e2021-06-22 14:01:47 +00001372 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlass1189a642021-06-04 03:25:23 +00001373 ... volt-programmed-subscribers | grep ${subscriber_id} | grep '${service_type_upper}' --color=never
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001374 ... ELSE
TorstenThieme4e2168e2021-06-22 14:01:47 +00001375 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001376 ... volt-programmed-subscribers | grep ${subscriber_id}
1377 @{bandwidth_profile_array}= Split String ${bandwidth_profile_output} ,
1378 Log ${bandwidth_profile_array}
1379 FOR ${value} IN @{bandwidth_profile_array}
1380 @{row_value}= Split String ${value} =
1381 ${bandwidth_profile_name}= Set Variable If '${row_value[0]}' == ' ${stream_type}'
1382 ... ${row_value[1]}
1383 ${bandwidth_profile_name}= Convert To String ${bandwidth_profile_name}
1384 Run Keyword If "${bandwidth_profile_name}" != "None" Exit For Loop
1385 END
1386 Log ${bandwidth_profile_name}
1387 [Return] ${bandwidth_profile_name}
1388
1389Execute Remote Command
1390 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1391 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1392 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
Andy Baviereff938d2020-06-29 18:27:49 -07001393 ... ${container_type}=${None} ${container_name}=${None} ${timeout}=${None}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001394 ${conn_id}= SSHLibrary.Open Connection ${ip}
1395 Run Keyword If '${pass}' != '${None}'
1396 ... SSHLibrary.Login ${user} ${pass}
1397 ... ELSE
1398 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1399 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1400 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001401 ${stdout} ${stderr} ${rc}= Run Keyword If '${container_type}' == 'LXC'
1402 ... SSHLibrary.Execute Command lxc exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001403 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001404 ... ELSE IF '${container_type}' == 'K8S'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001405 ... SSHLibrary.Execute Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001406 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001407 ... ELSE
Andy Baviereff938d2020-06-29 18:27:49 -07001408 ... SSHLibrary.Execute Command ${cmd} return_stderr=True return_rc=True timeout=${timeout}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001409
1410 Log ${stdout}
1411 Log ${stderr}
1412 Log ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001413 SSHLibrary.Close Connection
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001414 [Return] ${stdout} ${stderr} ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001415
Suraj Gour33651272020-05-04 10:10:16 +05301416Start Remote Command
1417 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1418 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1419 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
1420 ... ${container_type}=${None} ${container_name}=${None}
1421 ${conn_id}= SSHLibrary.Open Connection ${ip}
1422 Run Keyword If '${pass}' != '${None}'
1423 ... SSHLibrary.Login ${user} ${pass}
1424 ... ELSE
1425 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1426 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1427 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
1428 Run Keyword If '${container_type}' == 'LXC'
1429 ... SSHLibrary.Start Command lxc exec ${container_name} -- ${cmd}
1430 ... ELSE IF '${container_type}' == 'K8S'
1431 ... SSHLibrary.Start Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
1432 ... ELSE
1433 ... SSHLibrary.Start Command ${cmd}
Andy Bavier9fb23232020-06-30 15:12:20 -07001434 # It seems that closing the connection immediately will sometimes kill the command
1435 Sleep 1s
Suraj Gour33651272020-05-04 10:10:16 +05301436 SSHLibrary.Close Connection
1437
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001438Run Iperf3 Test Client
1439 [Arguments] ${src} ${server} ${args}
1440 [Documentation] Login to ${src} and run the iperf3 client against ${server} using ${args}.
1441 ... Return a Dictionary containing the results of the test.
Girish Gowdrad769b412021-05-16 11:09:46 -07001442 ${output} ${stderr} ${rc}= Execute Remote Command iperf3 -J -c ${server} ${args} -l 1024 -M 1350 | jq -M -c '.'
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001443 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001444 Should Be Equal As Integers ${rc} 0
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001445 ${object}= Evaluate json.loads(r'''${output}''') json
1446 [Return] ${object}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001447
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -07001448Run Iperf Test Client for MCAST
1449 [Arguments] ${src} ${server} ${args}
1450 [Documentation] Login to ${src} and run the iperf client against ${server} using ${args}.
1451 ... Return a Dictionary containing the results of the test.
1452 ${output} ${stderr} ${rc}= Execute Remote Command sudo iperf -c ${server} ${args} | jq -M -c '.'
1453 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1454 Should Be Equal As Integers ${rc} 0
1455 ${object}= Evaluate json.loads(r'''${output}''') json
1456 [Return] ${object}
1457
Hardik Windlassd19af862021-08-12 11:40:20 +00001458Run Ping In Background
1459 [Arguments] ${output_file} ${dst_ip} ${iface} ${ip} ${user} ${pass}=${None}
1460 ... ${container_type}=${None} ${container_name}=${None}
1461 [Documentation] Runs the 'ping' on remote system in background and stores the result in a file
1462 ${result}= Login And Run Command On Remote System
Hardik Windlass4e0e7c12021-08-26 08:07:35 +00001463 ... echo "ping -I ${iface} ${dst_ip} > ${output_file} &" > ping.sh; chmod +x ping.sh; ./ping.sh
Hardik Windlassd19af862021-08-12 11:40:20 +00001464 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
1465 Log ${result}
1466
1467Stop Ping Running In Background
1468 [Arguments] ${ip} ${user} ${pass}=${None}
1469 ... ${container_type}=${None} ${container_name}=${None}
1470 [Documentation] Stops the 'ping' running in background on remote system
Hardik Windlassa04efa52021-08-13 08:17:24 +00001471 ${cmd}= Run Keyword If '${container_type}' == 'LXC' or '${container_type}' == 'K8S'
1472 ... Set Variable kill -SIGINT `pgrep ping`
1473 ... ELSE
1474 ... Set Variable sudo kill -SIGINT `pgrep ping`
Hardik Windlassd19af862021-08-12 11:40:20 +00001475 ${result}= Login And Run Command On Remote System
Hardik Windlassa04efa52021-08-13 08:17:24 +00001476 ... ${cmd} ${ip} ${user} ${pass} ${container_type} ${container_name}
Hardik Windlassd19af862021-08-12 11:40:20 +00001477 Log ${result}
1478
1479Retrieve Remote File Contents
1480 [Documentation] Retrieves the contents of the file on remote system
1481 [Arguments] ${file} ${ip} ${user} ${pass}=${None}
1482 ... ${container_type}=${None} ${container_name}=${None} ${prompt}=~$
1483 ${output}= Login And Run Command On Remote System
1484 ... cat ${file}
1485 ... ${ip} ${user} ${pass} ${container_type} ${container_name} ${prompt}
1486 [Return] ${output}
1487
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001488RestoreONUs
1489 [Documentation] Restore all connected ONUs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001490 [Arguments] ${num_all_onus}
1491 FOR ${I} IN RANGE 0 ${num_all_onus}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001492 ${src}= Set Variable ${hosts.src[${I}]}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001493 ${container_type}= Get Variable Value ${src['container_type']} "null"
1494 ${container_name}= Get Variable Value ${src['container_name']} "null"
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001495 ${onu_type}= Get Variable Value ${src['onu_type']} "null"
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001496 #Get ens6f0 from ens6f0.22
1497 ${if_name}= Replace String Using Regexp ${src['dp_iface_name']} \\..* \
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001498 Run Keyword IF '${onu_type}' == 'alpha' AlphaONURestoreDefault ${src['ip']} ${src['user']}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001499 ... ${src['pass']} ${if_name} admin admin ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001500 END
1501
1502AlphaONURestoreDefault
1503 [Documentation] Restore the Alpha ONU to factory setting
1504 [Arguments] ${rg_ip} ${rg_user} ${rg_pass} ${onu_ifname}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001505 ... ${onu_user} ${onu_pass} ${container_type}=${None} ${container_name}=${None}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001506 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 192.168.1.3/24
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001507 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
TorstenThieme70bc5262021-01-19 12:12:55 +00001508 ${cmd} Catenate
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001509 ... (echo open "192.168.1.1"; sleep 1;
1510 ... echo "${onu_user}"; sleep 1;
1511 ... echo "${onu_pass}"; sleep 1;
1512 ... echo "restoredefault"; sleep 1) | telnet
1513 ${output}= Login And Run Command On Remote System ${cmd}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001514 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001515 Log To Console ${output}
1516 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 0
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001517 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Suraj Gour33651272020-05-04 10:10:16 +05301518
1519Create traffic with each pbit and capture at other end
1520 [Documentation] Generates upstream traffic using Mausezahn tool
1521 ... with each pbit and validates reception at other end using tcpdump
1522 [Arguments] ${target_ip} ${target_iface} ${src_iface}
Girish Gowdra66cd95d2021-07-08 10:31:54 -07001523 ... ${packet_count} ${packet_type} ${c_vlan} ${s_vlan} ${direction} ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301524 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
1525 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
1526 FOR ${pbit} IN RANGE 8
Andy Baviereff938d2020-06-29 18:27:49 -07001527 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301528 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001529 ${var1}= Set Variable sudo mausezahn ${src_iface} -B ${target_ip} -c ${packet_count}
Girish Gowdra66cd95d2021-07-08 10:31:54 -07001530 ${var2}= Run Keyword If "${direction}"=="downstream"
1531 ... Set Variable -t ${packet_type} "dp=80, flags=rst, p=aa:aa:aa" -Q ${pbit}:${s_vlan},${pbit}:${c_vlan}
1532 ... ELSE
1533 ... Set Variable -t ${packet_type} "dp=80, flags=rst, p=aa:aa:aa" -Q ${pbit}:${c_vlan}
Suraj Gour33651272020-05-04 10:10:16 +05301534 ${cmd}= Set Variable ${var1} ${var2}
1535 Start Remote Command ${cmd} ${src_ip} ${src_user} ${src_pass}
1536 ... ${src_container_type} ${src_container_name}
1537 ${output} ${stderr} ${rc}= Execute Remote Command
Andy Baviereff938d2020-06-29 18:27:49 -07001538 ... sudo tcpdump -l -U -c 30 -i ${target_iface} -e ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301539 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
Andy Baviereff938d2020-06-29 18:27:49 -07001540 ... timeout=30 seconds
1541 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301542 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001543 Run Keyword If "${tcpdump_filter}"=="tcp"
Girish Gowdraebeca682021-05-18 14:44:41 -07001544 ... Should Match Regexp ${output} , p ${pbit},
Suraj Gour33651272020-05-04 10:10:16 +05301545 END
TorstenThieme70bc5262021-01-19 12:12:55 +00001546
1547Determine Number Of ONU
1548 [Arguments] ${olt_serial_number}=${EMPTY} ${num_onus}=${num_all_onus}
1549 [Documentation] Determine the number of different ONUs for the given OLT taken from host.src
1550 ${onu_list} Create List
1551 FOR ${INDEX} IN RANGE 0 ${num_onus}
1552 Continue For Loop If "${olt_serial_number}"!="${hosts.src[${INDEX}].olt}" and "${olt_serial_number}"!="${EMPTY}"
1553 ${onu_id}= Get Index From List ${onu_list} ${hosts.src[${INDEX}].onu}
1554 Run Keyword If -1 == ${onu_id} Append To List ${onu_list} ${hosts.src[${INDEX}].onu}
1555 END
1556 ${real_num_onus}= Get Length ${onu_list}
1557 [Return] ${real_num_onus}
Hardik Windlass44abec12021-09-27 07:52:33 +00001558
1559Validate Cleanup In ETCD
1560 [Documentation] The keyword verifies that device, ports, flows, meters are all cleared in ETCD
Andrea Campanella388cd872022-02-10 09:11:39 +01001561 [Arguments] ${namespace}=default ${defaultkvstoreprefix}=voltha/voltha_voltha
Hardik Windlass44abec12021-09-27 07:52:33 +00001562 ${podname}= Set Variable etcd
1563 ${kvstoreprefix}= Get Kv Store Prefix ${defaultkvstoreprefix}
1564 # Log Devices Output and Verify Output Should be Empty
1565 ${commandget}= Catenate
1566 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/devices --keys-only'
1567 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1568 Log ${result}
1569 Should Be Empty ${result} Stale Devices Data in Etcd!
1570 # Log Flows Output and Verify Output Should be Empty
1571 ${commandget}= Catenate
1572 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/flows --keys-only'
1573 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1574 Log ${result}
1575 Should Be Empty ${result} Stale Flows Data in Etcd!
1576 # Log LogicalDevices Output and Verify Output Should be Empty
1577 ${commandget}= Catenate
1578 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/logical_devices --keys-only'
1579 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1580 Log ${result}
1581 Should Be Empty ${result} Stale Logical Devices Data in Etcd!
1582 # Log LogicalFlows Output and Verify Output Should be Empty
1583 ${commandget}= Catenate
1584 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/logical_flows --keys-only'
1585 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1586 Log ${result}
1587 Should Be Empty ${result} Stale Logical Flows Data in Etcd!
1588 # Log LogicalMeters Output and Verify Output Should be Empty
1589 ${commandget}= Catenate
1590 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/logical_meters --keys-only'
1591 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1592 Log ${result}
1593 Should Be Empty ${result} Stale Logical Meters Data in Etcd!
1594 # Log LogicalPorts Output and Verify Output Should be Empty
1595 ${commandget}= Catenate
1596 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/logical_ports --keys-only'
1597 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1598 Log ${result}
1599 Should Be Empty ${result} Stale Logical Ports Data in Etcd!
1600 # Log Openolt Output and Verify Output Should be Empty
1601 ${commandget}= Catenate
1602 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/openolt --keys-only'
1603 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1604 Log ${result}
1605 Should Be Empty ${result} Stale Openolt Data in Etcd!
1606 # Log Openonu Output and Verify Output Should be Empty
1607 ${commandget}= Catenate
1608 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/openonu --keys-only'
1609 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1610 Log ${result}
1611 Should Be Empty ${result} Stale Openonu Data in Etcd!
1612 # Log Ports Output and Verify Output Should be Empty
1613 ${commandget}= Catenate
1614 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/ports --keys-only'
1615 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1616 Log ${result}
1617 Should Be Empty ${result} Stale Ports Data in Etcd!
1618 # Log ResourceInstances Output and Verify Output Should be Empty
1619 ${commandget}= Catenate
1620 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/resource_instances --keys-only'
1621 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1622 Log ${result}
1623 Should Be Empty ${result} Stale Resource Instances Data in Etcd!
1624 # Log ResourceManager Output and Verify Output Should be Empty
1625 ${commandget}= Catenate
1626 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/resource_manager --keys-only'
1627 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1628 Log ${result}
1629 Should Be Empty ${result} Stale Resource Manager Data in Etcd!
Hardik Windlass81375222021-12-02 10:48:01 +00001630
Hardik Windlass81375222021-12-02 10:48:01 +00001631Clean Up All Nodes
1632 [Documentation] Login to each node and kill all stale lxc prcoesses
1633 ${num_nodes}= Get Length ${nodes}
1634 FOR ${I} IN RANGE 0 ${num_nodes}
1635 ${node_ip}= Evaluate ${nodes}[${I}].get("ip")
1636 ${node_user}= Evaluate ${nodes}[${I}].get("user")
1637 ${node_pass}= Evaluate ${nodes}[${I}].get("pass")
1638 Run Keyword And Continue On Failure Start Remote Command kill -9 `pidof lxc`
1639 ... ${node_ip} ${node_user} ${node_pass}
1640 END
Girish Gowdrafc0bdf22021-12-06 16:57:50 +05301641
1642Reboot XGSPON ONU
1643 [Documentation] Reboots the XGSPON ONU and verifies the ONU state after the reboot
1644 [Arguments] ${olt_sn} ${onu_sn} ${reason}
1645 FOR ${I} IN RANGE 0 ${num_olts}
1646 ${serial_number} Evaluate ${olts}[${I}].get("serial")
1647 Continue For Loop If "${serial_number}"!="${olt_sn}"
1648 ${board_tech} Evaluate ${olts}[${I}].get("board_technology")
1649 ${onu_device_id}= Get Device ID From SN ${onu_sn}
1650 Run Keyword If "${board_tech}"=="XGS-PON" Run Keywords
1651 ... Reboot Device ${onu_device_id}
1652 ... AND Wait Until Keyword Succeeds 120s 5s
1653 ... Validate Device ENABLED ACTIVE
1654 ... REACHABLE ${onu_sn} onu=True onu_reason=${reason}
1655 END
Girish Gowdra8fd96962021-12-14 16:20:04 +05301656
1657Set Non-Critical Tag for XGSPON Tech
1658 [Documentation] Dynamically sets the test tag for xgs-pon based to non-critical
1659 FOR ${I} IN RANGE 0 ${num_olts}
1660 ${board_tech} Evaluate ${olts}[${I}].get("board_technology")
1661 Run Keyword If "${board_tech}"=="XGS-PON" Run Keywords
1662 ... Set Tags non-critical
1663 ... AND Exit For Loop
1664 END
Hardik Windlassc4d1fd62022-04-12 13:12:28 +00001665
1666Perform Reboot ONUs and OLTs Physically
1667 [Documentation] This keyword reboots ONUs and OLTs physically
1668 ... It runs only on the PODs that are configured with PowerSwitch that
1669 ... controls the power off/on ONUs/OLT remotely (simulating a physical reboot)
1670 [Arguments] ${power_cycle_olt}=False
1671 Power Switch Connection Suite ${web_power_switch.ip} ${web_power_switch.user} ${web_power_switch.password}
1672 @{onu_list}= Create List
1673 FOR ${I} IN RANGE 0 ${num_all_onus}
1674 ${src}= Set Variable ${hosts.src[${I}]}
1675 ${dst}= Set Variable ${hosts.dst[${I}]}
1676 # If the power switch port is not specified, continue
1677 Continue For Loop If '${src["power_switch_port"]}' == '${None}'
1678 # Skip if we have already handled this ONU
1679 ${sn}= Set Variable ${src['onu']}
1680 ${onu_id}= Get Index From List ${onu_list} ${sn}
1681 Continue For Loop If -1 != ${onu_id}
1682 Append To List ${onu_list} ${sn}
1683 Disable Switch Outlet ${src['power_switch_port']}
1684 Sleep 10s
1685 Enable Switch Outlet ${src['power_switch_port']}
1686 END
1687 Pass Execution If '${power_cycle_olt}'=='False' Skipping OLT(s) Power Switch Reboot
1688 # Waiting extra time for the ONUs to come up
1689 Sleep 30s
1690 FOR ${I} IN RANGE 0 ${olt_count}
Hardik Windlass2cd43652022-04-21 16:44:06 +05301691 ${olt_serial_number}= Get From Dictionary ${list_olts}[${I}] sn
Hardik Windlassc4d1fd62022-04-12 13:12:28 +00001692 ${power_switch_port}= Get From Dictionary ${list_olts}[${I}] powerswitchport
1693 ${olt_ssh_ip}= Get From Dictionary ${list_olts}[${I}] sship
1694 # If the power switch port is not specified, continue
1695 Continue For Loop If '${power_switch_port}' == '${None}'
1696 Disable Switch Outlet ${power_switch_port}
1697 Sleep 10s
1698 Enable Switch Outlet ${power_switch_port}
1699 Run Keyword If ${has_dataplane} Wait Until Keyword Succeeds 120s 10s
1700 ... Check Remote System Reachability True ${olt_ssh_ip}
1701 END
1702 # Waiting extra time for the ONUs to come up
1703 Sleep 60s