blob: cfd42354ba78835a103af9c04f5b65a72a31c554 [file] [log] [blame]
Kailash92764922019-07-25 08:21:39 -07001# Copyright 2017-present Open Networking Foundation
2#
3# Licensed under the Apache License, Version 2.0 (the "License");
4# you may not use this file except in compliance with the License.
5# You may obtain a copy of the License at
6#
7# http://www.apache.org/licenses/LICENSE-2.0
8#
9# Unless required by applicable law or agreed to in writing, software
10# distributed under the License is distributed on an "AS IS" BASIS,
11# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12# See the License for the specific language governing permissions and
13# limitations under the License.
Kailash92764922019-07-25 08:21:39 -070014# robot test functions
15
16*** Settings ***
17Documentation Library for various utilities
18Library SSHLibrary
Kailash92764922019-07-25 08:21:39 -070019Library String
20Library DateTime
21Library Process
22Library Collections
23Library RequestsLibrary
24Library OperatingSystem
Andy Bavier63460da2020-02-20 14:35:12 -070025Library CORDRobot
26Library ImportResource resources=CORDRobot
TorstenThiemed4f48962020-12-08 12:17:19 +000027Resource ./voltctl.robot
Kailash92764922019-07-25 08:21:39 -070028
29*** Keywords ***
Kailash528f7c02019-07-31 10:55:49 -070030Check CLI Tools Configured
31 [Documentation] Tests that use 'voltctl' and 'kubectl' should execute this keyword in suite setup
32 # check voltctl and kubectl configured
Matteo Scandolo1eacdd82021-06-28 10:32:19 +020033 ${voltctl_rc} ${voltctl_output}= Run And Return Rc And Output voltctl -c ${VOLTCTL_CONFIG} device list
Hardik Windlass13803172021-04-26 08:17:07 +000034 Log ${voltctl_output}
35 ${kubectl_rc} ${kubectl_output}= Run And Return Rc And Output kubectl get pods
36 Log ${kubectl_output}
Gilles Depatie675a2062019-10-22 12:44:42 -040037 Run Keyword If ${voltctl_rc} != 0 or ${kubectl_rc} != 0 FATAL ERROR
38 ... VOLTCTL and KUBECTL not configured. Please configure before executing tests.
Gilles Depatieb5682f82019-10-31 10:39:45 -040039
40Send File To Onos
Zack Williamsa8fe75a2020-01-10 14:25:27 -070041 [Documentation] Send the content of the file to Onos to selected section of configuration
42 ... using Post Request
Huseyin Ahmet AYDIN42d3b712021-06-10 14:46:17 +000043 [Arguments] ${CONFIG_FILE} ${section}=${EMPTY}
Zack Williamsa8fe75a2020-01-10 14:25:27 -070044 ${Headers}= Create Dictionary Content-Type application/json
45 ${File_Data}= OperatingSystem.Get File ${CONFIG_FILE}
46 Log ${Headers}
47 Log ${File_Data}
48 ${resp}= Post Request ONOS
49 ... /onos/v1/network/configuration/${section} headers=${Headers} data=${File_Data}
50 Should Be Equal As Strings ${resp.status_code} 200
Andy Bavier88cd9f62019-11-26 16:22:33 -070051
52Common Test Suite Setup
53 [Documentation] Setup the test suite
Andy Bavier88cd9f62019-11-26 16:22:33 -070054 Set Global Variable ${KUBECTL_CONFIG} export KUBECONFIG=%{KUBECONFIG}
Matteo Scandolo5899be12020-11-11 15:38:07 -080055 Set Global Variable ${VOLTCTL_CONFIG} %{VOLTCONFIG}
Andy Bavier88cd9f62019-11-26 16:22:33 -070056 ${k8s_node_ip}= Evaluate ${nodes}[0].get("ip")
ubuntu6b6e7d42020-03-02 12:35:42 -080057 ${ONOS_REST_IP}= Get Environment Variable ONOS_REST_IP ${k8s_node_ip}
58 ${ONOS_SSH_IP}= Get Environment Variable ONOS_SSH_IP ${k8s_node_ip}
59 Set Global Variable ${ONOS_REST_IP}
60 Set Global Variable ${ONOS_SSH_IP}
Andy Bavier88cd9f62019-11-26 16:22:33 -070061 ${k8s_node_user}= Evaluate ${nodes}[0].get("user")
62 ${k8s_node_pass}= Evaluate ${nodes}[0].get("pass")
63 Check CLI Tools Configured
64 ${onos_auth}= Create List karaf karaf
65 ${HEADERS} Create Dictionary Content-Type=application/json
ubuntu6b6e7d42020-03-02 12:35:42 -080066 Create Session ONOS http://${ONOS_REST_IP}:${ONOS_REST_PORT} auth=${ONOS_AUTH}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080067 ${num_olts} Get Length ${olts}
68 ${list_olts} Create List
Suchitra Vemuriac9785e2021-01-07 16:50:18 -080069 # Create olt list from the configuration file
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080070 FOR ${I} IN RANGE 0 ${num_olts}
71 ${ip} Evaluate ${olts}[${I}].get("ip")
72 ${user} Evaluate ${olts}[${I}].get("user")
73 ${pass} Evaluate ${olts}[${I}].get("pass")
74 ${serial_number} Evaluate ${olts}[${I}].get("serial")
75 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanella3dcce272021-01-15 16:04:47 +010076 ${type} Evaluate ${olts}[${I}].get("type")
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080077 ${orig_olt_port} Evaluate ${olts}[${I}].get("oltPort")
78 ${port}= Set Variable If "${orig_olt_port}" == "None" ${OLT_PORT} ${orig_olt_port}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080079 ${onu_count}= Get ONU Count For OLT ${hosts.src} ${serial_number}
Suchitra Vemurife309412020-12-01 19:19:52 -080080 ${onu_list}= Get ONU List For OLT ${hosts.src} ${serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080081 ${olt} Create Dictionary ip ${ip} user ${user} pass
Andrea Campanella3dcce272021-01-15 16:04:47 +010082 ... ${pass} sn ${serial_number} onucount ${onu_count} type ${type}
Suchitra Vemuri09f878d2021-02-10 18:19:04 -080083 ... sship ${olt_ssh_ip} oltport ${port} onus ${onu_list}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080084 Append To List ${list_olts} ${olt}
85 END
86 ${num_all_onus}= Get Length ${hosts.src}
87 ${num_all_onus}= Convert to String ${num_all_onus}
Andy Bavier88cd9f62019-11-26 16:22:33 -070088 #send sadis file to onos
Andy Baviera2691752019-11-27 12:18:38 -070089 ${sadis_file}= Get Variable Value ${sadis.file}
Zack Williamsa8fe75a2020-01-10 14:25:27 -070090 Log To Console \nSadis File:${sadis_file}
Andy Bavier88cd9f62019-11-26 16:22:33 -070091 Run Keyword Unless '${sadis_file}' is '${None}' Send File To Onos ${sadis_file} apps/
Suchitra Vemuria6879aa2020-11-03 11:03:11 -080092 Set Suite Variable ${num_all_onus}
93 Set Suite Variable ${num_olts}
94 Set Suite Variable ${list_olts}
95 ${olt_count}= Get Length ${list_olts}
96 Set Suite Variable ${olt_count}
Andrea Campanella3dcce272021-01-15 16:04:47 +010097 @{container_list}= Create List ${OLT_ADAPTER_APP_LABEL} adapter-open-onu voltha-api-server
Andy Bavier88cd9f62019-11-26 16:22:33 -070098 ... voltha-ro-core voltha-rw-core-11 voltha-rw-core-12 voltha-ofagent
99 Set Suite Variable ${container_list}
100 ${datetime}= Get Current Date
suraj gour7f6d5fe2019-11-29 10:56:35 +0000101 Set Suite Variable ${datetime}
102
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800103Get ONU Count For OLT
104 [Arguments] ${src} ${serial_number}
105 [Documentation] Gets ONU Count for the specified OLT
106 ${src_length}= Get Length ${src}
107 ${count}= Set Variable 0
108 FOR ${I} IN RANGE 0 ${src_length}
109 ${sn} Evaluate ${src}[${I}].get("olt")
TorstenThiemed4f48962020-12-08 12:17:19 +0000110 ${count}= Run Keyword If '${serial_number}' == '${sn}' Evaluate ${count} + 1
111 ... ELSE Set Variable ${count}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800112 END
113 [Return] ${count}
114
Suchitra Vemurife309412020-12-01 19:19:52 -0800115Get ONU List For OLT
116 [Arguments] ${src} ${serial_number}
117 [Documentation] Gets ONU List for the specified OLT
118 ${src_length}= Get Length ${src}
119 ${onu_list}= Create List
120 FOR ${I} IN RANGE 0 ${src_length}
121 ${sn} Evaluate ${src}[${I}].get("olt")
Matteo Scandolo243288d2021-09-20 14:48:58 -0700122 Run Keyword If '${serial_number}' == '${sn}' Append To List ${onu_list} ${src}[${I}][onu]
Suchitra Vemurife309412020-12-01 19:19:52 -0800123 ... ELSE Set Variable ${onu_list}
124 END
125 [Return] ${onu_list}
126
suraj gour7f6d5fe2019-11-29 10:56:35 +0000127WPA Reassociate
suraj gour7f6d5fe2019-11-29 10:56:35 +0000128 [Documentation] Executes a particular wpa_cli reassociate, which performs force reassociation
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700129 [Arguments] ${iface} ${ip} ${user} ${pass}=${None}
130 ... ${container_type}=${None} ${container_name}=${None}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000131 #Below for loops are used instead of sleep time, to execute reassociate command and check status
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700132 FOR ${i} IN RANGE 70
133 ${output}= Login And Run Command On Remote System
134 ... wpa_cli -i ${iface} reassociate ${ip} ${user}
135 ... ${pass} ${container_type} ${container_name}
136 ${passed}= Run Keyword And Return Status Should Contain ${output} OK
Andy Bavierb63f6d22020-03-12 15:34:37 -0700137 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700138 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700139 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700140 FOR ${i} IN RANGE 70
141 ${output}= Login And Run Command On Remote System
Andy Bavierae4a17e2020-02-25 14:54:36 -0700142 ... wpa_cli -i ${iface} status | grep SUCCESS ${ip} ${user}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700143 ... ${pass} ${container_type} ${container_name}
144 ${passed}= Run Keyword And Return Status Should Contain ${output} SUCCESS
Andy Bavierb63f6d22020-03-12 15:34:37 -0700145 Exit For Loop If ${passed}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700146 END
Andy Bavierb63f6d22020-03-12 15:34:37 -0700147 Should Be True ${passed} Status does not contain 'SUCCESS'
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700148
suraj gour7f6d5fe2019-11-29 10:56:35 +0000149Validate Authentication After Reassociate
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700150 [Arguments] ${auth_pass} ${iface} ${ip} ${user} ${pass}=${None}
151 ... ${container_type}=${None} ${container_name}=${None}
152 [Documentation]
153 ... Executes a particular reassociate request on the RG using wpa_cli.
154 ... auth_pass determines if authentication should pass
Andy Bavier84834d42020-02-25 13:49:50 -0700155 ${wpa_log}= Catenate SEPARATOR=. /tmp/wpa ${iface} log
156 ${output}= Login And Run Command On Remote System truncate -s 0 ${wpa_log}; cat ${wpa_log}
157 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
158 Log ${output}
159 Should Not Contain ${output} authentication completed successfully
suraj gour7f6d5fe2019-11-29 10:56:35 +0000160 WPA Reassociate ${iface} ${ip} ${user} ${pass} ${container_type} ${container_name}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700161 Run Keyword If '${auth_pass}' == 'True' Wait Until Keyword Succeeds ${timeout} 2s
Andy Bavier84834d42020-02-25 13:49:50 -0700162 ... Check Remote File Contents True ${wpa_log} ${iface}.*authentication completed successfully
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700163 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
suraj gour7f6d5fe2019-11-29 10:56:35 +0000164 Run Keyword If '${auth_pass}' == 'False' Sleep 20s
Suchitra Vemuri3cb29f82020-02-25 13:59:58 -0800165 Run Keyword If '${auth_pass}' == 'False' Check Remote File Contents False /tmp/wpa.log
Andy Bavier84834d42020-02-25 13:49:50 -0700166 ... ${iface}.*authentication completed successfully ${ip} ${user} ${pass}
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700167 ... ${container_type} ${container_name}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000168
169Send Dhclient Request To Release Assigned IP
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700170 [Arguments] ${iface} ${ip} ${user} ${path_dhcpleasefile} ${pass}=${None}
171 ... ${container_type}=${None} ${container_name}=${None}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000172 [Documentation] Executes a dhclient with option to release ip against a particular interface on the RG (src)
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700173 ${result}= Login And Run Command On Remote System
174 ... dhclient -nw -r ${iface} && rm ${path_dhcpleasefile}/dhclient.* ${ip} ${user}
suraj gourd5cfdbb2019-12-13 12:44:55 +0000175 ... ${pass} ${container_type} ${container_name}
176 Log ${result}
177 #Should Contain ${result} DHCPRELEASE
178 [Return] ${result}
suraj gour1ecfae92019-12-20 15:11:40 +0000179
180Check Remote File Contents For WPA Logs
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700181 [Arguments] ${file_should_exist} ${file} ${pattern} ${ip} ${user} ${pass}=${None}
182 ... ${container_type}=${None} ${container_name}=${None} ${prompt}=~$
suraj gour1ecfae92019-12-20 15:11:40 +0000183 [Documentation] Checks for particular pattern count in a file
Zack Williamsa8fe75a2020-01-10 14:25:27 -0700184 ${result}= Login And Run Command On Remote System
185 ... cat ${file} | grep '${pattern}' | wc -l ${ip} ${user} ${pass}
suraj gour1ecfae92019-12-20 15:11:40 +0000186 ... ${container_type} ${container_name} ${prompt}
187 [Return] ${result}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000188
189Perform Sanity Test
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800190 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure
191 ... for all the ONUs connected to each OLT - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000192 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
193 ... In all other (common) cases flag has to be set False (default).
194 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800195 FOR ${J} IN RANGE 0 ${num_olts}
196 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
197 ${onu_count}= Set Variable ${list_olts}[${J}][onucount]
198 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
199 ... ${olt_serial_number}
200 Set Global Variable ${of_id}
TorstenThiemedda37652021-11-11 16:22:05 +0000201 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800202 Perform Sanity Test Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${onu_count}
TorstenThiemec3c23232021-01-13 13:06:31 +0000203 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800204 END
205
206Perform Sanity Test Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000207 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000208 [Documentation] This keyword performs Sanity Test Procedure
209 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
210 ... This keyword can be used to call in any other tests where sanity check is required
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800211 ... and avoids duplication of code. - ATT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000212 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
213 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800214 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000215 ${src}= Set Variable ${hosts.src[${I}]}
216 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800217 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000218 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700219 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000220 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800221 # Check ONU port is Enabled in ONOS
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700222 Wait Until Keyword Succeeds 120s 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000223 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Matteo Scandoloebf2be42021-09-22 09:46:50 -0700224 # Verify Default Meter in ONOS (valid only for ATT and only if subscriber is not provisioned)
225 Run Keyword Unless ${supress_add_subscriber}
226 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo243288d2021-09-20 14:48:58 -0700227 ... Verify Default Meter Present in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700228 # Verify default EAPOL flows are added for the ONU port
TorstenThiemec3c23232021-01-13 13:06:31 +0000229 Run Keyword Unless ${supress_add_subscriber}
230 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700231 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800232 # Verify LLDP flow in ONOS
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800233 Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800234 ... Verify LLDP Flow Added ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} 1
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800235 # Verify ONU state in voltha
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800236 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800237 ... ENABLED ACTIVE REACHABLE
238 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
239 # Perform Authentication
Andy Bavier84834d42020-02-25 13:49:50 -0700240 ${wpa_log}= Run Keyword If ${has_dataplane} Catenate SEPARATOR=.
241 ... /tmp/wpa ${src['dp_iface_name']} log
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700242 Run Keyword If ${has_dataplane} Validate Authentication True
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000243 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
Andy Bavier84834d42020-02-25 13:49:50 -0700244 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700245 Wait Until Keyword Succeeds ${timeout} 2
ubuntu6b6e7d42020-03-02 12:35:42 -0800246 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
TorstenThiemec3c23232021-01-13 13:06:31 +0000247 Run Keyword Unless ${supress_add_subscriber}
TorstenThieme4e2168e2021-06-22 14:01:47 +0000248 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000249 ... volt-add-subscriber-access ${of_id} ${onu_port}
Suchitra Vemuri9da44302020-03-04 14:24:49 -0800250 # Verify that no pending flows exist for the ONU port
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700251 Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri9da44302020-03-04 14:24:49 -0800252 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Hardik Windlass21807632020-04-14 16:24:55 +0530253 # Verify subscriber access flows are added for the ONU port
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700254 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass21807632020-04-14 16:24:55 +0530255 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
256 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700257 # Verify subscriber EAPOL flow is installed
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700258 Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700259 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
260 ... ${onu_port} ${src['c_tag']}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530261 # Verify Meters in ONOS
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800262 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530263 ... Verify Meters in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700264 Run Keyword If ${has_dataplane} Validate DHCP and Ping True
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000265 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
266 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
267 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
268 ... ${dst['container_name']}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700269 Wait Until Keyword Succeeds ${timeout} 2s
ubuntu6b6e7d42020-03-02 12:35:42 -0800270 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000271 END
272
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000273Perform Sanity Test DT
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800274 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
TorstenThiemec3c23232021-01-13 13:06:31 +0000275 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
276 ... In all other (common) cases flag has to be set False (default).
277 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800278 FOR ${J} IN RANGE 0 ${num_olts}
279 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
280 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
281 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
282 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
283 ... ${olt_serial_number}
284 Set Global Variable ${of_id}
TorstenThiemedda37652021-11-11 16:22:05 +0000285 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800286 Perform Sanity Test DT Per OLT ${of_id} ${nni_port} ${olt_serial_number} ${num_onus}
TorstenThiemec3c23232021-01-13 13:06:31 +0000287 ... ${supress_add_subscriber}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800288 # Verify ONOS Flows
289 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
290 ${onos_flows_count}= Evaluate 4 * ${num_onus}
291 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
292 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
293 ... ${onos_flows_count}
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800294 # Verify LLDP flow in ONOS
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800295 Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800296 ... Verify LLDP Flow Added ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} 1
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800297 # Verify VOLTHA Flows
298 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
299 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
300 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
301 ${onu_flows}= Set Variable 2
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800302 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000303 ... ${olt_flows} ${olt_device_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800304 ${List_ONU_Serial} Create List
305 Set Suite Variable ${List_ONU_Serial}
Suchitra Vemuri21a47fd2020-11-16 18:39:09 -0800306 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800307 Log ${List_ONU_Serial}
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000308 Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800309 ... ${List_ONU_Serial} ${onu_flows}
310 END
311
312
313Perform Sanity Test DT Per OLT
TorstenThiemec3c23232021-01-13 13:06:31 +0000314 [Arguments] ${of_id} ${nni_port} ${olt_serial_number} ${num_onus} ${supress_add_subscriber}=False
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000315 [Documentation] This keyword performs Sanity Test Procedure for DT Workflow
316 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
317 ... This keyword can be used to call in any other tests where sanity check is required
318 ... and avoids duplication of code.
TorstenThiemec3c23232021-01-13 13:06:31 +0000319 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
320 ... In all other (common) cases flag has to be set False (default).
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800321 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000322 ${src}= Set Variable ${hosts.src[${I}]}
323 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800324 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000325 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700326 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000327 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
328 # Check ONU port is Enabled in ONOS
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700329 Wait Until Keyword Succeeds 120s 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000330 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
TorstenThiemec3c23232021-01-13 13:06:31 +0000331 Run Keyword Unless ${supress_add_subscriber}
TorstenThieme4e2168e2021-06-22 14:01:47 +0000332 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000333 ... volt-add-subscriber-access ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530334 # Verify subscriber access flows are added for the ONU port
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700335 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass25e11702020-03-30 20:05:19 +0530336 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
337 ... ${onu_port} ${nni_port} ${src['s_tag']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000338 # Verify ONU state in voltha
339 ${onu_reasons}= Create List omci-flows-pushed
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700340 Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000341 ... ENABLED ACTIVE REACHABLE
TorstenThiemec3c23232021-01-13 13:06:31 +0000342 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Hardik Windlass2a9b1592020-07-23 18:28:13 +0530343 # Verify Meters in ONOS
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000344 Wait Until Keyword Succeeds ${timeout} 5s
Girish Gowdra21ec25d2021-05-24 10:07:01 -0700345 ... Verify Meters in ONOS Ietf ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Hardik Windlassfb5eace2020-03-26 14:49:01 +0530346 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700347 Run Keyword If ${has_dataplane} Validate DHCP and Ping True
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000348 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
349 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
350 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
351 ... ${dst['container_name']}
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000352 END
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800353
354Validate All OLT Flows
355 [Documentation] This keyword iterate all OLTs and performs Sanity Test Procedure for DT workflow
356 FOR ${J} IN RANGE 0 ${num_olts}
357 ${olt_serial_number}= Set Variable ${list_olts}[${J}][sn]
358 ${num_onus}= Set Variable ${list_olts}[${J}][onucount]
359 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
360 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
361 ... ${olt_serial_number}
362 Set Global Variable ${of_id}
363 # Verify ONOS Flows
364 # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream)
365 ${onos_flows_count}= Evaluate 4 * ${num_onus}
366 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
367 ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
368 ... ${onos_flows_count}
369 # Verify VOLTHA Flows
370 # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP
371 ${olt_flows}= Evaluate 2 * ${num_onus} + 1
372 # Number of per ONU Flows equals 2 (one each for downstream and upstream)
373 ${onu_flows}= Set Variable 2
374 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
375 ... ${olt_device_id}
376 ${List_ONU_Serial} Create List
377 Set Suite Variable ${List_ONU_Serial}
Andrea Campanella6391f842020-11-16 10:01:18 +0100378 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800379 Log ${List_ONU_Serial}
380 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
381 ... ${List_ONU_Serial} ${onu_flows}
382 END
Hardik Windlassa3d04b92020-02-17 15:06:05 +0000383
TorstenThieme70bc5262021-01-19 12:12:55 +0000384Perform Sanity Tests TT
385 [Documentation] This keyword performs both Sanity Test Procedure for TT Workflow
386 ... Sanity Test TT for HSIA, VoD, VoIP services and Sanity Test TT for MCAST
387 ... For repeating sanity tests without subscriber changes set flag supress_add_subscriber=True.
388 ... In all other (common) cases flag has to be set False (default).
389 [Arguments] ${supress_add_subscriber}=False
390 Perform Sanity Test TT ${supress_add_subscriber}
TorstenThieme136ebf72021-02-26 14:27:07 +0000391 # run of mcast sanity test is currently limited for real HW
392 Run Keyword If ${has_dataplane} Perform Sanity Test TT MCAST ${supress_add_subscriber}
TorstenThieme70bc5262021-01-19 12:12:55 +0000393
Huseyin Ahmet AYDIN7cb5ae62021-10-28 11:07:27 +0000394Provision Subscription TT
395 [Documentation] Provision Subscription TT
396 [Arguments] ${supress_add_subscriber}=False
397 FOR ${I} IN RANGE 0 ${num_all_onus}
398 ${src}= Set Variable ${hosts.src[${I}]}
399 ${dst}= Set Variable ${hosts.dst[${I}]}
400 ${service_type}= Get Variable Value ${src['service_type']} "null"
401 Run Keyword IF '${service_type}' != 'mcast' Provision Subscription for ONU TT ${src} ${dst}
402 ... ${supress_add_subscriber}
403 END
404
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700405Perform Sanity Test TT
406 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
407 ... Sanity test performs dhcp and pings (without EAPOL and DHCP flows) for all the ONUs given for the POD
408 ... This keyword can be used to call in any other tests where sanity check is required
409 ... and avoids duplication of code.
TorstenThieme70bc5262021-01-19 12:12:55 +0000410 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
411 ... In all other (common) cases flag has to be set False (default).
412 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800413 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700414 ${src}= Set Variable ${hosts.src[${I}]}
415 ${dst}= Set Variable ${hosts.dst[${I}]}
416 ${service_type}= Get Variable Value ${src['service_type']} "null"
TorstenThiemea36068c2021-02-19 09:57:32 +0000417 Run Keyword IF '${service_type}' != 'mcast' Sanity Test TT one ONU ${src} ${dst} ${supress_add_subscriber}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700418 END
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000419 # Verify Subscriber Access Flow Count
420 @{particular_onu_device_port}= Create List
421 FOR ${I} IN RANGE 0 ${num_all_onus}
422 ${src}= Set Variable ${hosts.src[${I}]}
423 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000424 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS
425 ... ${src['onu']} ${of_id} ${src['uni_id']}
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000426 Append To List ${particular_onu_device_port} ${onu_port}
427 END
428 ${list_onu_port}= Remove Duplicates ${particular_onu_device_port}
429 ${num_of_provisioned_onus}= Get Length ${list_onu_port}
430 FOR ${I} IN RANGE 0 ${olt_count}
431 ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn
432 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
Hardik Windlass315d6152021-06-09 08:22:44 +0000433 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000434 ${num_onus}= Set Variable ${list_olts}[${I}][onucount]
435 # Verify ONOS Flows
436 # Number of Access Flows on ONOS equals 16 * the Number of Active ONUs + 3 for default LLDP, IGMP and DHCP
437 ${onos_flows_count}= Run Keyword If ${has_dataplane} Evaluate 16 * ${num_of_provisioned_onus} + 3
438 ... ELSE Evaluate 15 * ${num_of_provisioned_onus} + 3
Matteo Scandoloc2f48fa2021-09-29 13:32:55 -0700439 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000440 ... Verify Added Flow Count for OLT TT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
441 ... ${onos_flows_count}
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800442 # Verify LLDP flow in ONOS
Matteo Scandolo6a90bda2021-11-30 11:31:38 -0800443 Wait Until Keyword Succeeds ${timeout} 5s
Matteo Scandolo7bdbe2d2021-11-29 15:48:25 -0800444 ... Verify LLDP Flow Added ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} 1
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000445 # Verify VOLTHA Flows
446 # Number of per OLT Flows equals 10 * Number of Active ONUs + 3 for default LLDP, IGMP and DHCP
447 ${olt_flows}= Run Keyword If ${has_dataplane} Evaluate 10 * ${num_of_provisioned_onus} + 3
448 ... ELSE Evaluate 9 * ${num_of_provisioned_onus} + 3
449 # Number of per ONU Flows equals 6 for 3play service data plane + 4 for Trap to Host Flows
450 ${onu_flows}= Run Keyword If ${has_dataplane} Set Variable 10
451 ... ELSE Set Variable 9
452 Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows ${olt_flows}
453 ... ${olt_device_id}
454 ${List_ONU_Serial} Create List
455 Set Suite Variable ${List_ONU_Serial}
456 Build ONU SN List ${List_ONU_Serial} ${olt_serial_number} ${num_onus}
457 Log ${List_ONU_Serial}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000458 # TODO: Fix ${onu_flows} calculations based on UNIs provisioned
459 # Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows
460 # ... ${List_ONU_Serial} ${onu_flows}
Hardik Windlass3ec9d4f2021-06-08 05:48:15 +0000461 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700462
Huseyin Ahmet AYDIN7cb5ae62021-10-28 11:07:27 +0000463Provision Subscription for ONU TT
464 [Documentation] This keyword performs provision services a single ONU for TT workflow
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700465 ... Tests for one ONU
TorstenThieme70bc5262021-01-19 12:12:55 +0000466 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
467 ... In all other (common) cases flag has to be set False (default).
468 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800469 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700470 Set Global Variable ${of_id}
TorstenThiemedda37652021-11-11 16:22:05 +0000471 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700472 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000473 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000474 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700475 # Check ONU port is Enabled in ONOS
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000476 Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000477 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlassb1bda362021-11-24 11:54:36 +0000478 # Add subscriber
479 ${add_sub_cmd}= Run Keyword If ${unitag_sub}
480 ... Catenate volt-add-subscriber-unitag --tpId ${src['tp_id']} --sTag ${src['s_tag']}
481 ... --cTag ${src['c_tag']} ${src['onu']}-${src['uni_id']}
482 ... ELSE
483 ... Set Variable volt-add-subscriber-access ${of_id} ${onu_port}
TorstenThiemea36068c2021-02-19 09:57:32 +0000484 Run Keyword Unless ${supress_add_subscriber}
Hardik Windlassb1bda362021-11-24 11:54:36 +0000485 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${add_sub_cmd}
TorstenThiemea36068c2021-02-19 09:57:32 +0000486 # Verify ONU state in voltha
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000487 ${onu_reasons}= Create List omci-flows-pushed onu-reenabled
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000488 Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700489 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800490 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Huseyin Ahmet AYDIN7cb5ae62021-10-28 11:07:27 +0000491
492Sanity Test TT one ONU
493 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
494 ... Tests for one ONU
495 ... Assertions apply to HSIA, VoD, VoIP services
496 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
497 ... In all other (common) cases flag has to be set False (default).
498 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
499 Provision Subscription for ONU TT ${src} ${dst} ${supress_add_subscriber}
500 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
501 Set Global Variable ${of_id}
502 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
503 ... ${of_id} ${src['uni_id']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700504 # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652)
505 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True
506 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
507 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
508 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
509 ... ${dst['container_name']}
Matteo Scandolo37a6cb72021-01-08 13:55:59 -0800510 Run Keyword IF '${src['service_type']}'!='hsia'
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000511 ... Wait Until Keyword Succeeds ${timeout} 2s
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -0700512 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Suchitra Vemuri42819412020-10-01 17:45:43 -0700513 ... ${src['c_tag']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700514
515Perform Sanity Test TT MCAST
516 [Documentation] This keyword performs Sanity Test Procedure for TT Workflow
517 ... Adds subscribers
518 ... Validates for MCAST
TorstenThieme70bc5262021-01-19 12:12:55 +0000519 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
520 ... In all other (common) cases flag has to be set False (default).
521 [Arguments] ${supress_add_subscriber}=False
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800522 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700523 ${src}= Set Variable ${hosts.src[${I}]}
524 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700525 ${service_type}= Get Variable Value ${src['service_type']} "null"
526 Run Keyword IF '${service_type}' == 'mcast' Sanity Test TT MCAST one ONU ${src}
TorstenThiemea36068c2021-02-19 09:57:32 +0000527 ... ${dst} ${supress_add_subscriber}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700528 END
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700529
530Sanity Test TT MCAST one ONU
531 [Documentation] This keyword performs sanity test for a single ONU for TT workflow
532 ... Tests for one ONU
533 ... Assertions apply to MCAST services
TorstenThieme70bc5262021-01-19 12:12:55 +0000534 ... For repeating sanity test without subscriber changes set flag supress_add_subscriber=True.
535 ... In all other (common) cases flag has to be set False (default).
536 [Arguments] ${src} ${dst} ${supress_add_subscriber}=False
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700537 # Check for iperf and jq tools
538 ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf jq
539 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
540 ... ${src['container_name']}
541 Pass Execution If ${rc} != 0 Skipping test: iperf / jq not found on the RG
542
543 #Reset the IP on the interface
544 ${output}= Login And Run Command On Remote System sudo ifconfig ${src['dp_iface_name']} 0
545 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
546 # Kill iperf on BNG
547 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
548 ... sudo kill -9 `pidof iperf`
549 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
550 ... ${dst['container_name']}
551
552 # Setup RG for Multi-cast test
553 ${output}= Login And Run Command On Remote System
554 ... sudo ifconfig ${src['dp_iface_name']} ${src['mcast_rg']} up ; sudo kill -9 `pidof iperf`
555 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
556 ${output}= Login And Run Command On Remote System
557 ... sudo ip route add ${src['mcast_grp_subnet_mask']} dev ${src['dp_iface_name']} scope link
558 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
559
560 # Perform operations for adding subscriber
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800561 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700562 Set Global Variable ${of_id}
TorstenThiemedda37652021-11-11 16:22:05 +0000563 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700564 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000565 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000566 ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700567 # Check ONU port is Enabled in ONOS
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000568 Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000569 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
TorstenThiemea36068c2021-02-19 09:57:32 +0000570 Run Keyword Unless ${supress_add_subscriber}
TorstenThieme4e2168e2021-06-22 14:01:47 +0000571 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700572 ... volt-add-subscriber-access ${of_id} ${onu_port}
TorstenThiemea36068c2021-02-19 09:57:32 +0000573 # Verify ONU state in voltha
Emrehan UZUNec59bea2021-05-27 13:45:57 +0000574 ${onu_reasons}= Create List omci-flows-pushed onu-reenabled
Hardik Windlass5a2d1f42021-11-12 12:52:04 +0000575 Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700576 ... ENABLED ACTIVE REACHABLE
Matteo Scandolo74bd5c32020-12-08 09:52:19 -0800577 ... ${src['onu']} onu=True onu_reason=${onu_reasons}
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -0700578
579 # Setup iperf on the BNG
580 ${server_output}= Login And Run Command On Remote System
581 ... sudo iperf -c ${dst['dp_iface_ip_qinq']} -u -T 32 -t 60 -i 1 &
582 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
583 ... ${dst['container_name']}
584
585 # Setup iperf on the RG
586 ${rg_output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
587 ... Login And Run Command On Remote System
588 ... rm -rf /tmp/rg_output ; sudo iperf -s -u -B ${dst['dp_iface_ip_qinq']} -i 1 -D >> /tmp/rg_output
589 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
590 Log ${rg_output}
591 Sleep 60s
592 ${output}= Run Keyword and Continue On Failure Wait Until Keyword Succeeds 90s 5s
593 ... Login And Run Command On Remote System
594 ... cat /tmp/rg_output | grep KBytes
595 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
596 Log ${output}
597 Should Contain ${output} KBytes
598
599 # Kill iperf on BNG
600 ${rg_output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
601 ... sudo kill -9 `pidof iperf`
602 ... ${dst['bng_ip']} ${dst['bng_user']} ${dst['bng_pass']} ${dst['container_type']}
603 ... ${dst['container_name']}
604
605 # Kill iperf on the RG
606 ${output}= Run Keyword and Continue On Failure Login And Run Command On Remote System
607 ... sudo kill -9 `pidof iperf`
608 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
609
Hardik Windlass62db9d92021-05-17 09:32:40 +0000610Setup Soak
611 [Documentation] Pre-test Setup for Soak Job
612 ${olt_ids} Create List
613 FOR ${I} IN RANGE 0 ${num_olts}
614 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
615 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
616 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
617 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
618 ... ${olt_serial_number}
TorstenThiemedda37652021-11-11 16:22:05 +0000619 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Hardik Windlass62db9d92021-05-17 09:32:40 +0000620 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
621 ... of_id ${of_id} sn ${olt_serial_number}
622 Append To List ${olt_ids} ${olt}
623 END
624 Set Global Variable ${olt_ids}
Suchitra Vemuri2f1e07d2020-06-26 19:18:01 -0700625
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000626Setup
627 [Documentation] Pre-test Setup
Hardik Windlass4ed54502021-05-14 07:34:15 +0000628 [Arguments] ${skip_empty_device_list_test}=False
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000629 #test for empty device list
Hardik Windlass4ed54502021-05-14 07:34:15 +0000630 Run Keyword If '${skip_empty_device_list_test}'=='False' Test Empty Device List
Hardik Windlass5e214b22021-02-26 10:37:14 +0000631 # TBD: Need for this Sleep
632 Run Keyword If ${has_dataplane} Sleep 180s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800633 # Create a list of olt ids (logical and device_id)
634 ${olt_ids} Create List
635 FOR ${I} IN RANGE 0 ${num_olts}
636 #create/preprovision device
Andrea Campanella3dcce272021-01-15 16:04:47 +0100637 ${olt_device_id}= Run Keyword If "${list_olts}[${I}][type]" == "${None}"
Suchitra Vemuri09f878d2021-02-10 18:19:04 -0800638 ... Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport]
639 ... ELSE Create Device ${list_olts}[${I}][ip] ${list_olts}[${I}][oltport] ${list_olts}[${I}][type]
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800640 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
641 #Set Suite Variable ${olt_device_id}
642 #validate olt states
643 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass8b446492021-06-10 06:25:23 +0000644 ... Validate OLT Device PREPROVISIONED UNKNOWN UNKNOWN ${olt_device_id} by_dev_id=True
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800645 Sleep 5s
646 Enable Device ${olt_device_id}
Suchitra Vemuricf6e89c2021-03-24 19:14:15 -0700647 # Increasing the timer to incorporate wait time for in-band
648 Wait Until Keyword Succeeds 540s 5s
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800649 ... Validate OLT Device ENABLED ACTIVE REACHABLE ${olt_serial_number}
650 ${logical_id}= Get Logical Device ID From SN ${olt_serial_number}
651 # Set Suite Variable ${logical_id}
652 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS
653 ... ${olt_serial_number}
654 ${olt} Create Dictionary device_id ${olt_device_id} logical_id ${logical_id}
655 ... of_id ${of_id} sn ${olt_serial_number}
656 Append To List ${olt_ids} ${olt}
657 END
658 Set Global Variable ${olt_ids}
659
660Get ofID From OLT List
661 [Documentation] Retrieves the corresponding of_id for the OLT serial number specified
662 [Arguments] ${serial_number}
663 FOR ${I} IN RANGE 0 ${olt_count}
664 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100665 ${of_id}= Run Keyword IF "${serial_number}"=="${sn}"
666 ... Get From Dictionary ${olt_ids}[${I}] of_id ELSE Set Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800667 END
668 [Return] ${of_id}
669
670Get OLTDeviceID From OLT List
671 [Documentation] Retrieves the corresponding olt_device_id for the OLT serial number specified
672 [Arguments] ${serial_number}
Suchitra Vemuri4b8f4f52020-11-17 19:12:50 -0800673 ${olt_device_id}= Set Variable 0
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800674 FOR ${I} IN RANGE 0 ${olt_count}
675 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
Andrea Campanella317a94c2020-11-13 10:38:19 +0100676 ${olt_device_id}= Run Keyword IF "${serial_number}"=="${sn}"
677 ... Get From Dictionary ${olt_ids}[${I}] device_id ELSE Set Variable ${olt_device_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800678 END
679 [Return] ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000680
Andrea Campanellad848de02020-11-24 10:23:41 +0100681Get Num of Onus From OLT SN
682 [Documentation] Retrieves the corresponding number of ONUs for a given OLT based on serial number specified
683 [Arguments] ${serial_number}
684 ${num_of_olt_onus}= Set Variable 0
685 FOR ${I} IN RANGE 0 ${olt_count}
686 ${sn}= Get From Dictionary ${olt_ids}[${I}] sn
687 ${num_of_olt_onus}= Run Keyword IF "${serial_number}"=="${sn}"
688 ... Get From Dictionary ${list_olts}[${I}] onucount ELSE Set Variable ${num_of_olt_onus}
689 END
690 [Return] ${num_of_olt_onus}
691
Hardik Windlassaaea3402020-03-10 19:45:45 +0530692Validate ONUs After OLT Disable
693 [Documentation] Validates the ONUs state in Voltha, ONUs port state in ONOS
694 ... and that pings do not succeed After corresponding OLT is Disabled
Andrea Campanella4e507882020-11-26 11:33:11 +0100695 [Arguments] ${num_onus} ${olt_serial_number}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530696 FOR ${I} IN RANGE 0 ${num_onus}
697 ${src}= Set Variable ${hosts.src[${I}]}
698 ${dst}= Set Variable ${hosts.dst[${I}]}
Andrea Campanella4e507882020-11-26 11:33:11 +0100699 Continue For Loop If "${olt_serial_number}"!="${src['olt']}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800700 ${of_id}= Get ofID From OLT List ${src['olt']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530701 ${onu_device_id}= Get Device ID From SN ${src['onu']}
702 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
703 ... ${of_id}
Girish Gowdra3f0fadb2021-11-08 16:49:28 -0800704 ${valid_onu_states}= Create List stopping-openomci omci-flows-deleted
Hardik Windlassaaea3402020-03-10 19:45:45 +0530705 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
706 ... Validate Device ENABLED DISCOVERED
Girish Gowdra3f0fadb2021-11-08 16:49:28 -0800707 ... UNREACHABLE ${src['onu']} onu=True onu_reason=${valid_onu_states}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530708 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000709 ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530710 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
711 ... Wait Until Keyword Succeeds 60s 2s
712 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
713 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Hardik Windlassaaea3402020-03-10 19:45:45 +0530714 END
715
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000716Delete All Devices and Verify
717 [Documentation] Remove any devices from VOLTHA and ONOS
718 # Clear devices from VOLTHA
719 Disable Devices In Voltha Root=true
720 Wait Until Keyword Succeeds ${timeout} 2s Test Devices Disabled In Voltha Root=true
721 Delete Devices In Voltha Root=true
722 Wait Until Keyword Succeeds ${timeout} 2s Test Empty Device List
Hardik Windlasse8b99222021-01-25 10:03:14 +0000723 FOR ${I} IN RANGE 0 ${num_olts}
724 ${olt_serial_number}= Set Variable ${list_olts}[${I}][sn]
Matteo Scandolo71ff08a2021-10-21 17:47:27 -0700725 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlasse8b99222021-01-25 10:03:14 +0000726 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
727 END
Hardik Windlass44abec12021-09-27 07:52:33 +0000728 Wait Until Keyword Succeeds ${timeout} 5s Validate Cleanup In ETCD ${INFRA_NAMESPACE}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000729
730Teardown
731 [Documentation] kills processes and cleans up interfaces on src+dst servers
732 Run Keyword If ${has_dataplane} Clean Up Linux
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000733
734Teardown Suite
735 [Documentation] Clean up device if desired
Andrea Campanella82add372021-11-05 12:01:15 +0100736 Start Logging Setup or Teardown Teardown-${SUITE NAME}
Hardik Windlass81375222021-12-02 10:48:01 +0000737 Run Keyword If ${has_dataplane} Clean Up Linux
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000738 Run Keyword If ${teardown_device} Delete All Devices and Verify
Andrea Campanella1ff03222021-09-10 10:14:21 +0200739 Run Keyword And Continue On Failure Collect Logs
TorstenThieme4e2168e2021-06-22 14:01:47 +0000740 Close All ONOS SSH Connections
Hardik Windlass81375222021-12-02 10:48:01 +0000741 Run Keyword If ${has_dataplane} Clean Up All Nodes
Andrea Campanella82add372021-11-05 12:01:15 +0100742 Stop Logging Setup or Teardown Teardown-${SUITE NAME}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000743
744Delete Device and Verify
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800745 [Arguments] ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000746 [Documentation] Disable -> Delete devices via voltctl and verify its removed
Suchitra Vemuri2fa9bba2020-01-22 17:38:48 -0800747 ${olt_device_id}= Get Device ID From SN ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000748 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800749 ... voltctl -c ${VOLTCTL_CONFIG} device disable ${olt_device_id}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000750 Should Be Equal As Integers ${rc} 0
751 Sleep 5s
752 Wait Until Keyword Succeeds ${timeout} 5s
753 ... Validate OLT Device DISABLED UNKNOWN REACHABLE ${olt_serial_number}
754 ${rc} ${output}= Run and Return Rc and Output
Matteo Scandolo5899be12020-11-11 15:38:07 -0800755 ... voltctl -c ${VOLTCTL_CONFIG} device delete ${olt_device_id}
Hardik Windlassdf5035e2021-01-27 08:34:59 +0000756 Sleep 50s
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000757 Should Be Equal As Integers ${rc} 0
758 Wait Until Keyword Succeeds ${timeout} 5s Validate Device Removed ${olt_device_id}
Hardik Windlasse8b99222021-01-25 10:03:14 +0000759 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 15s
760 ... Validate Deleted Device Cleanup In ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${olt_serial_number}
Gayathri.Selvanee4a91b2020-01-17 06:49:53 +0000761
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000762Repeat Sanity Test
763 [Documentation] This keyword performs Sanity Test Procedure
764 ... Sanity test performs authentication, dhcp and pings for all the ONUs given for the POD
765 ... This keyword can be used to call in any other tests where sanity check is required
766 ... with wpa reassociation
767 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${olt_serial_number}
768 Set Global Variable ${of_id}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800769 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000770 ${src}= Set Variable ${hosts.src[${I}]}
771 ${dst}= Set Variable ${hosts.dst[${I}]}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800772 ${onu_port}= Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
773 ... Get ONU Port in ONOS ${src['onu']} ${of_id}
774 # Check ONU port is Enabled in ONOD
775 Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000776 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800777 # Verify EAPOL flows are added for the ONU port
778 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700779 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800780 # Verify ONU state in voltha
Suchitra Vemurid1e27fb2020-02-01 16:34:37 -0800781 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device
Suchitra Vemuri81e4f022020-02-01 13:16:02 -0800782 ... ENABLED ACTIVE REACHABLE
783 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
Suchitra Vemuri8078b972020-02-06 19:07:41 -0800784 # Perform Authentication
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000785 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
786 ... Validate Authentication After Reassociate
787 ... True ${src['dp_iface_name']} ${src['ip']} ${src['user']} ${src['pass']}
788 ... ${src['container_type']} ${src['container_name']}
789 Wait Until Keyword Succeeds ${timeout} 2s
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800790 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000791 Wait Until Keyword Succeeds ${timeout} 2s
TorstenThieme4e2168e2021-06-22 14:01:47 +0000792 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000793 ... volt-add-subscriber-access ${of_id} ${onu_port}
794 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
795 ... Validate DHCP and Ping True True
796 ... ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
797 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
798 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']}
799 ... ${dst['container_name']}
800 Wait Until Keyword Succeeds ${timeout} 2s Run Keyword And Continue On Failure
David K. Bainbridgec0617c92020-03-05 21:17:19 -0800801 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
Gayathri.Selvan283a63c2020-01-23 04:09:18 +0000802 END
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +0000803
Hardik Windlass41701e82021-01-12 17:44:44 +0000804Disable Enable PON Port Per OLT
805 [Arguments] ${olt_serial_number}
806 [Documentation] This keyword disables and then enables OLT PON port and
807 ... also validate ONUs for each corresponding case
808 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
809 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
810 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
811 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
812 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
813 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
814 # Disable the OLT PON Port and Validate OLT Device
815 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
816 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
817 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
818 ... DISABLED DISCOVERED
819 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
820 ... Validate OLT Device ENABLED ACTIVE REACHABLE
821 ... ${olt_serial_number}
822 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
823 ... Validate ONUs for PON OLT Disable ${olt_serial_number} ${olt_peer_list}
824 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
825 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
826 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
827 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
828 ... ENABLED ACTIVE
829 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
830 ... Validate ONUs for PON OLT Enable ${olt_serial_number} ${olt_peer_list}
831 END
832
Hardik Windlass16cdf962020-04-29 15:26:50 +0530833Validate ONUs for PON OLT Disable
Hardik Windlass41701e82021-01-12 17:44:44 +0000834 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530835 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
836 ... And Pings succeed for other Active OLT PON port ONUs
837 ... Also it removes subscriber for Disabled OLT PON port ONUs to replicate ATT workflow
Hardik Windlass41701e82021-01-12 17:44:44 +0000838 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530839 ${src}= Set Variable ${hosts.src[${I}]}
840 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000841 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530842 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000843 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530844 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000845 ... ${of_id} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530846 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
847 Run Keyword If ${matched}
848 ... Run Keywords
849 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
850 ... Validate Device ENABLED DISCOVERED
Andrea Campanellaa9b59b42021-09-21 16:13:17 +0000851 ... UNREACHABLE ${src['onu']} onu=True onu_reason=omci-flows-deleted
Hardik Windlass16cdf962020-04-29 15:26:50 +0530852 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000853 ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530854 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
855 ... Wait Until Keyword Succeeds 60s 2s
856 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
857 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
858 ... ${src['container_name']}
859 # Remove Subscriber Access (To replicate ATT workflow)
TorstenThieme4e2168e2021-06-22 14:01:47 +0000860 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection
861 ... ${ONOS_SSH_IP} ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
Hardik Windlass223a1732021-07-09 05:21:40 +0000862 # Additional Sleep to let subscriber delete process
863 ... AND Sleep 5s
Hardik Windlass16cdf962020-04-29 15:26:50 +0530864 ... ELSE
865 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
866 ... Wait Until Keyword Succeeds 60s 2s
867 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
868 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
869 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530870 END
871
872Validate ONUs for PON OLT Enable
Hardik Windlass41701e82021-01-12 17:44:44 +0000873 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530874 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
875 ... Also performs Auth/subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800876 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530877 ${src}= Set Variable ${hosts.src[${I}]}
878 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000879 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530880 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000881 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
TorstenThiemedda37652021-11-11 16:22:05 +0000882 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530883 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
Hardik Windlass1ed2eee2021-06-25 09:51:03 +0000884 ... ${of_id} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530885 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
886 ${wpa_log}= Run Keyword If ${has_dataplane} and ${matched} Catenate SEPARATOR=.
887 ... /tmp/wpa ${src['dp_iface_name']} log
888 Run Keyword If ${matched}
889 ... Run Keywords
890 # Perform Cleanup
891 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
892 # Verify ONU port status
893 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds 120s 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000894 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530895 # Verify EAPOL flows are added for the ONU port
896 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
Matteo Scandolo7e519fb2021-08-13 11:35:16 -0700897 ... Verify Eapol Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530898 # Verify ONU state in voltha
899 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
900 ... Validate Device ENABLED ACTIVE REACHABLE
901 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
902 # Perform Authentication
903 ... AND Run Keyword If ${has_dataplane}
904 ... Run Keyword And Continue On Failure Validate Authentication True
905 ... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}
906 ... ${src['container_type']} ${src['container_name']} ${wpa_log}
907 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
908 ... Verify ONU in AAA-Users ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
909 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2
TorstenThieme4e2168e2021-06-22 14:01:47 +0000910 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530911 ... volt-add-subscriber-access ${of_id} ${onu_port}
912 # Verify that no pending flows exist for the ONU port
913 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
914 ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
915 # Verify subscriber access flows are added for the ONU port
916 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
917 ... Verify Subscriber Access Flows Added For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
918 ... ${onu_port} ${nni_port} ${src['c_tag']} ${src['s_tag']}
919 ... AND Run Keyword If ${has_dataplane}
920 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
921 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
922 ... ${src['ip']} ${src['user']} ${src['pass']}
923 ... ${src['container_type']} ${src['container_name']}
924 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
925 ... ${dst['container_type']} ${dst['container_name']}
926 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 2s
927 ... Validate Subscriber DHCP Allocation ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port}
928 ... AND Run Keyword and Ignore Error Get Device Output from Voltha ${onu_device_id}
929 ... ELSE
930 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
931 ... Wait Until Keyword Succeeds 60s 2s
932 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
933 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
934 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530935 END
936
Hardik Windlass41701e82021-01-12 17:44:44 +0000937Disable Enable PON Port Per OLT DT
938 [Arguments] ${olt_serial_number}
939 [Documentation] This keyword disables and then enables OLT PON port and
940 ... also validate ONUs for each corresponding case
941 ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}
942 ${olt_pon_port_list}= Retrieve OLT PON Ports ${olt_device_id}
943 ${olt_pon_port_list_len}= Get Length ${olt_pon_port_list}
944 FOR ${INDEX0} IN RANGE 0 ${olt_pon_port_list_len}
945 ${olt_pon_port}= Get From List ${olt_pon_port_list} ${INDEX0}
946 ${olt_peer_list}= Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port}
TorstenThieme17d6fd22021-09-23 10:00:08 +0000947 ${olt_peer_list_len}= Get Length ${olt_peer_list}
Hardik Windlass41701e82021-01-12 17:44:44 +0000948 # Disable the OLT PON Port and Validate OLT Device
949 DisableOrEnable OLT PON Port disable ${olt_device_id} ${olt_pon_port}
950 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
951 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
952 ... DISABLED DISCOVERED
953 Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
954 ... Validate OLT Device ENABLED ACTIVE REACHABLE
955 ... ${olt_serial_number}
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000956 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +0000957 ... Validate ONUs for PON OLT Disable DT ${olt_serial_number} ${olt_peer_list}
Hardik Windlass41701e82021-01-12 17:44:44 +0000958 # Enable the OLT PON Port back, and check ONU status are back to "ACTIVE"
959 DisableOrEnable OLT PON Port enable ${olt_device_id} ${olt_pon_port}
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000960 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +0000961 ... Validate OLT PON Port Status ${olt_device_id} ${olt_pon_port}
962 ... ENABLED ACTIVE
TorstenThieme17d6fd22021-09-23 10:00:08 +0000963 ${olt_peer_list_new}= Wait Until Keyword Succeeds ${timeout} 5s
964 ... Retrieve Peer List From OLT PON Port ${olt_device_id} ${olt_pon_port} ${olt_peer_list_len}
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000965 Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass41701e82021-01-12 17:44:44 +0000966 ... Validate ONUs for PON OLT Enable DT ${olt_serial_number} ${olt_peer_list_new}
967 END
968
Hardik Windlass16cdf962020-04-29 15:26:50 +0530969Validate ONUs for PON OLT Disable DT
Hardik Windlass41701e82021-01-12 17:44:44 +0000970 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530971 [Documentation] This keyword validates that Ping fails for ONUs connected to Disabled OLT PON port
972 ... And Pings succeed for other Active OLT PON port ONUs
973 ... Also it removes subscriber and deletes ONUs for Disabled OLT PON port to replicate DT workflow
Suchitra Vemuria6879aa2020-11-03 11:03:11 -0800974 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530975 ${src}= Set Variable ${hosts.src[${I}]}
976 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +0000977 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +0530978 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +0000979 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530980 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
981 ... ${of_id}
982 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
Girish Gowdra3f0fadb2021-11-08 16:49:28 -0800983 ${valid_onu_states}= Create List stopping-openomci omci-flows-deleted
Hardik Windlass16cdf962020-04-29 15:26:50 +0530984 Run Keyword If ${matched}
985 ... Run Keywords
986 ... Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
987 ... Validate Device ENABLED DISCOVERED
Girish Gowdra3f0fadb2021-11-08 16:49:28 -0800988 ... UNREACHABLE ${src['onu']} onu=True onu_reason=${valid_onu_states}
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000989 ... AND Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass39015672021-07-05 05:48:08 +0000990 ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530991 ... AND Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass5d537ad2021-11-16 06:01:54 +0000992 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +0530993 ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
994 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
995 ... ${src['container_name']}
996 # Remove Subscriber Access (To replicate DT workflow)
TorstenThieme4e2168e2021-06-22 14:01:47 +0000997 ... AND Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection
998 ... ${ONOS_SSH_IP} ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port}
Hardik Windlass16cdf962020-04-29 15:26:50 +0530999 # Delete ONU Device (To replicate DT workflow)
1000 ... AND Delete Device ${onu_device_id}
Hardik Windlass223a1732021-07-09 05:21:40 +00001001 # Additional Sleep to let subscriber and ONU delete process
1002 ... AND Sleep 10s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301003 ... ELSE
1004 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001005 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301006 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1007 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
1008 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301009 END
1010
1011Validate ONUs for PON OLT Enable DT
Hardik Windlass41701e82021-01-12 17:44:44 +00001012 [Arguments] ${olt_sn} ${olt_peer_list}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301013 [Documentation] This keyword validates Ping succeeds for all Enabled/Acitve OLT PON ports
1014 ... Also performs subscriberAdd/DHCP/Ping for the ONUs on Re-Enabled OLT PON port
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001015 FOR ${I} IN RANGE 0 ${num_all_onus}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301016 ${src}= Set Variable ${hosts.src[${I}]}
1017 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass41701e82021-01-12 17:44:44 +00001018 Continue For Loop If "${olt_sn}"!="${src['olt']}"
Hardik Windlass16cdf962020-04-29 15:26:50 +05301019 ${onu_device_id}= Get Device ID From SN ${src['onu']}
Hardik Windlass41701e82021-01-12 17:44:44 +00001020 ${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS ${src['olt']}
TorstenThiemedda37652021-11-11 16:22:05 +00001021 ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301022 ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}
1023 ... ${of_id}
1024 ${matched}= Match ONU in PON OLT Peer List ${olt_peer_list} ${onu_device_id}
1025 Run Keyword If ${matched}
1026 ... Run Keywords
1027 # Perform Cleanup
1028 ... Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id}
1029 # Verify ONU port status
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001030 ... AND Wait Until Keyword Succeeds 120s 2s
Hardik Windlass39015672021-07-05 05:48:08 +00001031 ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']}
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001032 ... AND Wait Until Keyword Succeeds ${timeout} 2
TorstenThieme4e2168e2021-06-22 14:01:47 +00001033 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301034 ... volt-add-subscriber-access ${of_id} ${onu_port}
1035 # Verify ONU state in voltha
1036 ... AND Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s
1037 ... Validate Device ENABLED ACTIVE REACHABLE
1038 ... ${src['onu']} onu=True onu_reason=omci-flows-pushed
1039 # Verify subscriber access flows are added for the ONU port
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001040 ... AND Wait Until Keyword Succeeds ${timeout} 5s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301041 ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}
1042 ... ${onu_port} ${nni_port} ${src['s_tag']}
1043 ... AND Run Keyword If ${has_dataplane}
1044 ... Run Keyword And Continue On Failure Validate DHCP and Ping True
1045 ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']}
1046 ... ${src['ip']} ${src['user']} ${src['pass']}
1047 ... ${src['container_type']} ${src['container_name']}
1048 ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1049 ... ${dst['container_type']} ${dst['container_name']}
1050 ... ELSE
1051 ... Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
Hardik Windlass5d537ad2021-11-16 06:01:54 +00001052 ... Wait Until Keyword Succeeds ${timeout} 2s
Hardik Windlass16cdf962020-04-29 15:26:50 +05301053 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1054 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']}
1055 ... ${src['container_name']}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301056 END
1057
1058Match ONU in PON OLT Peer List
1059 [Arguments] ${olt_peer_list} ${onu_device_id}
1060 [Documentation] This keyword matches if ONU device is present in OLT PON port peer list
1061 ${matched}= Set Variable False
1062 FOR ${olt_peer} IN @{olt_peer_list}
1063 ${matched}= Set Variable If '${onu_device_id}' == '${olt_peer}' True False
1064 Exit For Loop If ${matched}
1065 END
1066 [Return] ${matched}
1067
Gayathri.Selvanb6a2b542020-01-24 07:24:23 +00001068Collect Logs
1069 [Documentation] Collect Logs from voltha and onos cli for various commands
1070 Run Keyword and Ignore Error Get Device List from Voltha
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001071 FOR ${I} IN RANGE 0 ${num_olts}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001072 Run Keyword and Ignore Error Get Device Output from Voltha ${olt_ids}[${I}][device_id]
1073 Run Keyword and Ignore Error Get Logical Device Output from Voltha ${olt_ids}[${I}][logical_id]
1074 END
1075 #Run Keyword and Ignore Error Get Device Output from Voltha ${olt_device_id}
1076 #Run Keyword and Ignore Error Get Logical Device Output from Voltha ${logical_id}
ubuntu6b6e7d42020-03-02 12:35:42 -08001077 Get ONOS Status ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001078
Hardik Windlassb75cf1b2021-01-18 06:59:09 +00001079Verify ping is successful except for given device
1080 [Arguments] ${num_onus} ${exceptional_onu}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001081 [Documentation] Checks that ping for all the devices are successful except the given ONU.
1082 ${pingStatus} Set Variable True
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001083 FOR ${I} IN RANGE 0 ${num_all_onus}
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001084 ${src}= Set Variable ${hosts.src[${I}]}
1085 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlassb75cf1b2021-01-18 06:59:09 +00001086 ${pingStatus} Run Keyword If '${src['onu']}' == '${exceptional_onu}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001087 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1088 ... Wait Until Keyword Succeeds 60s 2s
Gayathri.Selvanf68ea4b2020-02-03 07:36:39 +00001089 ... Check Ping ${pingStatus} ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1090 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1091 END
Andy Bavier4a8450e2020-02-04 08:58:37 -07001092
Suchitra Vemurife309412020-12-01 19:19:52 -08001093Verify ping is successful for ONUs not on this OLT
1094 [Arguments] ${num_all_onus} ${exceptional_olt_id}
1095 [Documentation] Checks that pings work for all the ONUs except for the ONUs on the given OLT.
1096 #${pingStatus} Set Variable True
1097 FOR ${I} IN RANGE 0 ${num_all_onus}
1098 ${src}= Set Variable ${hosts.src[${I}]}
1099 ${dst}= Set Variable ${hosts.dst[${I}]}
1100 ${olt_device_id}= Get Device ID From SN ${src['olt']}
1101 Continue For Loop If "${olt_device_id}"=="${exceptional_olt_id}"
1102 #${pingStatus} Run Keyword If '${olt_device_id}' == '${exceptional_olt_id}' Set Variable False
Suchitra Vemuri69bcad22020-12-09 11:11:14 -08001103 Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure
1104 ... Wait Until Keyword Succeeds 60s 2s
Suchitra Vemurife309412020-12-01 19:19:52 -08001105 ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']}
1106 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1107 END
1108
Andy Bavier1923ecc2020-06-18 14:06:40 -07001109Echo Message to OLT Logs
1110 [Arguments] ${message}
1111 [Documentation] Echoes ${message} into the OLT logs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001112 FOR ${I} IN RANGE 0 ${num_olts}
1113 ${olt_user} Evaluate ${olts}[${I}].get("user")
1114 ${olt_pass} Evaluate ${olts}[${I}].get("pass")
1115 ${olt_ssh_ip} Evaluate ${olts}[${I}].get("sship")
Andrea Campanellaebf6f0d2021-01-12 13:10:29 +01001116 Continue For Loop If "${olt_user}" == "${None}"
1117 Continue For Loop If "${olt_pass}" == "${None}"
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001118 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1119 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt.log
1120 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1121 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1122 ... printf '%s\n' '' '' '${message}' '' >> /var/log/dev_mgmt_daemon.log
1123 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1124 Wait Until Keyword Succeeds 180s 10s Execute Remote Command
1125 ... printf '%s\n' '' '' '${message}' '' >> /var/log/openolt_process_watchdog.log
1126 ... ${olt_ssh_ip} ${olt_user} ${olt_pass}
1127 END
Andy Bavier1923ecc2020-06-18 14:06:40 -07001128
Andy Bavierabeba262020-02-07 16:22:16 -07001129Start Logging
1130 [Arguments] ${label}
1131 [Documentation] Start logging for test ${label}
Hardik Windlass9e3db232021-10-14 07:10:47 +00001132 ${kail_process}= Run Keyword If "${container_log_dir}" != "${None}" Start Process kail -n ${NAMESPACE}
Hardik Windlassa9a896a2021-11-23 04:31:51 +00001133 ... -n ${INFRA_NAMESPACE} cwd=${container_log_dir} stdout=${label}-combined.log
Andy Bavierabeba262020-02-07 16:22:16 -07001134 Set Test Variable ${kail_process}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001135 Run Keyword If ${has_dataplane} Echo Message to OLT Logs START ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001136
Andrea Campanella82add372021-11-05 12:01:15 +01001137Start Logging Setup or Teardown
1138 [Arguments] ${label}
1139 [Documentation] Start logging for suite ${label}
Matteo Scandolo6a90bda2021-11-30 11:31:38 -08001140 ${file}= Replace String ${label} ${SPACE} -
Andrea Campanella82add372021-11-05 12:01:15 +01001141 ${kail_process}= Run Keyword If "${container_log_dir}" != "${None}" Start Process kail -n ${NAMESPACE}
Matteo Scandolo6a90bda2021-11-30 11:31:38 -08001142 ... -n ${INFRA_NAMESPACE} cwd=${container_log_dir} stdout=${file}-combined.log
Andrea Campanella82add372021-11-05 12:01:15 +01001143 Set Suite Variable ${kail_process}
1144 Run Keyword If ${has_dataplane} Echo Message to OLT Logs START ${label}
1145
1146Stop Logging Setup or Teardown
1147 [Arguments] ${label}
1148 [Documentation] End logging for suite;
1149 Run sync
1150 Run Keyword If ${kail_process} Terminate Process ${kail_process}
1151 ${test_logfile}= Run Keyword If "${container_log_dir}" != "${None}"
1152 ... Join Path ${container_log_dir} ${label}-combined.log
1153 Run Keyword If ${has_dataplane} Echo Message to OLT Logs END ${label}
1154
Andy Bavierabeba262020-02-07 16:22:16 -07001155Stop Logging
1156 [Arguments] ${label}
Matteo Scandoloda1c64b2021-07-20 10:14:49 -07001157 [Documentation] End logging for test; remove logfile if test passed and ${logging} is set to False
Andy Bavierabeba262020-02-07 16:22:16 -07001158 Run sync
1159 Run Keyword If ${kail_process} Terminate Process ${kail_process}
1160 ${test_logfile}= Run Keyword If "${container_log_dir}" != "${None}"
1161 ... Join Path ${container_log_dir} ${label}-combined.log
Matteo Scandoloda1c64b2021-07-20 10:14:49 -07001162 Run Keyword If Test Passed
1163 ... Run Keyword If "${logging}" == "False"
1164 ... Run Keyword If "${test_logfile}" != "${None}"
1165 ... Remove File ${test_logfile}
Andy Bavier1923ecc2020-06-18 14:06:40 -07001166 Run Keyword If ${has_dataplane} Echo Message to OLT Logs END ${label}
Andy Bavierabeba262020-02-07 16:22:16 -07001167
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001168Clean Up Linux
1169 [Documentation] Kill processes and clean up interfaces on src+dst servers
Hardik Windlass16cdf962020-04-29 15:26:50 +05301170 [Arguments] ${onu_id}=${EMPTY}
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001171 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001172 ${src}= Set Variable ${hosts.src[${I}]}
1173 ${dst}= Set Variable ${hosts.dst[${I}]}
Hardik Windlass16cdf962020-04-29 15:26:50 +05301174 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1175 Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
Andy Bavier84b83282020-06-30 05:47:49 -07001176 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001177 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001178 Execute Remote Command sudo pkill dhclient ${src['ip']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001179 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Baviereff938d2020-06-29 18:27:49 -07001180 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1181 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1182 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1183 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001184 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1185 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1186 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1187 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1188 ... ${dst['container_type']} ${dst['container_name']}
Andy Bavier84b83282020-06-30 05:47:49 -07001189 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1190 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1191 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
Andy Bavierf4b7d1d2020-06-30 11:14:04 -07001192 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1193 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
Andy Baviereff938d2020-06-29 18:27:49 -07001194 ... ${dst['container_type']} ${dst['container_name']}
Suchitra Vemuria5fa3dd2020-02-04 14:38:49 -08001195 END
Scott Baker60e570d2020-02-02 22:10:13 -08001196
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001197Clean Up Linux Per OLT
1198 [Documentation] Kill processes and clean up interfaces on src+dst servers
1199 [Arguments] ${olt_serial_number}
1200 FOR ${I} IN RANGE 0 ${num_all_onus}
1201 ${src}= Set Variable ${hosts.src[${I}]}
1202 ${dst}= Set Variable ${hosts.dst[${I}]}
1203 ${onu_device_id}= Get Device ID From SN ${src['onu']}
1204 ${sn}= Get Device ID From SN ${src['olt']}
1205 #Continue For Loop If '${onu_id}' != '${EMPTY}' and '${onu_id}' != '${onu_device_id}'
1206 Continue For Loop If '${olt_serial_number}' == '${sn}'
1207 Execute Remote Command sudo pkill wpa_supplicant ${src['ip']}
1208 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1209 Execute Remote Command sudo pkill dhclient ${src['ip']}
1210 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1211 Execute Remote Command sudo pkill mausezahn ${src['ip']}
1212 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1213 Run Keyword If '${dst['ip']}' != '${None}' Execute Remote Command pkill dhcpd
1214 ... ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} ${dst['container_name']}
1215 Delete IP Addresses from Interface on Remote Host ${src['dp_iface_name']} ${src['ip']}
1216 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1217 Run Keyword If '${dst['ip']}' != '${None}' Delete Interface on Remote Host
1218 ... ${dst['dp_iface_name']}.${src['s_tag']} ${dst['ip']} ${dst['user']} ${dst['pass']}
1219 ... ${dst['container_type']} ${dst['container_name']}
1220 ${bng_ip}= Get Variable Value ${dst['noroot_ip']}
1221 ${bng_user}= Get Variable Value ${dst['noroot_user']}
1222 ${bng_pass}= Get Variable Value ${dst['noroot_pass']}
1223 Run Keyword If "${bng_ip}" != "${NONE}" and "${bng_user}" != "${NONE}" and "${bng_pass}" != "${NONE}"
1224 ... Execute Remote Command sudo pkill mausezahn ${bng_ip} ${bng_user} ${bng_pass}
1225 ... ${dst['container_type']} ${dst['container_name']}
1226 END
1227
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001228Clean dhclient
1229 [Documentation] Kills dhclient processes only for all RGs
Hardik Windlass41701e82021-01-12 17:44:44 +00001230 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemuri8d3b0032020-09-11 17:49:08 -07001231 ${src}= Set Variable ${hosts.src[${I}]}
1232 ${dst}= Set Variable ${hosts.dst[${I}]}
1233 Execute Remote Command sudo pkill dhclient ${src['ip']}
1234 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1235 END
1236
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001237Clean WPA Process
1238 [Documentation] Kills wpa_supplicant processes only for all RGs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001239 FOR ${I} IN RANGE 0 ${num_all_onus}
Suchitra Vemurif7a033c2020-02-26 17:22:41 -08001240 ${src}= Set Variable ${hosts.src[${I}]}
1241 ${dst}= Set Variable ${hosts.dst[${I}]}
1242 Run Keyword And Ignore Error Kill Linux Process [w]pa_supplicant ${src['ip']}
1243 ... ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1244 END
1245
Scott Baker60e570d2020-02-02 22:10:13 -08001246Should Be Larger Than
1247 [Documentation] Verify that value_1 is > value_2
1248 [Arguments] ${value_1} ${value_2}
1249 Run Keyword If ${value_1} <= ${value_2}
1250 ... Fail The value ${value_1} is not larger than ${value_2}
1251
Scott Bakeree675552020-02-11 10:43:34 -08001252Should Be Larger Than Or Equal To
1253 [Documentation] Verify that value_1 is >= value_2
1254 [Arguments] ${value_1} ${value_2}
1255 Run Keyword If ${value_1} < ${value_2}
1256 ... Fail The value ${value_1} is not larger than or equal to ${value_2}
1257
Huseyin Ahmet AYDIN175d1582021-11-23 14:51:41 +00001258Should Be Lower Than
1259 [Documentation] Verify that value_1 is < value_2
1260 [Arguments] ${value_1} ${value_2}
1261 Run Keyword If ${value_1} >= ${value_2}
1262 ... Fail The value ${value_1} is not lower than ${value_2}
1263
Scott Baker60e570d2020-02-02 22:10:13 -08001264Should Be Float
1265 [Documentation] Verify that value is a floating point number type
1266 [Arguments] ${value}
1267 ${type} Evaluate type(${value}).__name__
1268 Should Be Equal ${type} float
1269
Scott Bakeree675552020-02-11 10:43:34 -08001270Should Be Newer Than Or Equal To
1271 [Documentation] Compare two RFC3339 dates
1272 [Arguments] ${value_1} ${value_2}
1273 ${unix_v1} Parse RFC3339 ${value_1}
1274 ${unix_v2} Parse RFC3339 ${value_2}
1275 Run Keyword If ${unix_v1} < ${unix_v2}
1276 ... Fail The value ${value_1} is not newer than or equal to ${value_2}
1277
Scott Baker60e570d2020-02-02 22:10:13 -08001278Get Current Time
1279 [Documentation] Return the current time in RFC3339 format
1280 ${output}= Run date -u +"%FT%T%:z"
1281 [return] ${output}
Scott Bakeree675552020-02-11 10:43:34 -08001282
1283Parse RFC3339
1284 [Documentation] Parse an RFC3339 timestamp
1285 [Arguments] ${dateStr}
1286 ${rc} ${output}= Run and Return Rc and Output date --date="${dateStr}" "+%s"
1287 Should Be Equal As Numbers ${rc} 0
1288 [return] ${output}
Matteo Scandolo142e6272020-04-29 17:36:59 -07001289
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001290Get Bandwidth Profile Name For Given Subscriber
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001291 [Arguments] ${subscriber_id} ${stream_type}=upstreamBandwidthProfile ${service_type}=${EMPTY}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001292 [Documentation] Keyword to get the bandwidth details of the given subscriber
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001293 ${service_type_upper}= Run Keyword If '${service_type}' != '${EMPTY}'
1294 ... Convert To Upper Case ${service_type}
1295 ${bandwidth_profile_output}= Run Keyword If '${service_type}' != '${EMPTY}'
TorstenThieme4e2168e2021-06-22 14:01:47 +00001296 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Hardik Windlass1189a642021-06-04 03:25:23 +00001297 ... volt-programmed-subscribers | grep ${subscriber_id} | grep '${service_type_upper}' --color=never
Hardik Windlass35db2aa2021-06-03 12:41:26 +00001298 ... ELSE
TorstenThieme4e2168e2021-06-22 14:01:47 +00001299 ... Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001300 ... volt-programmed-subscribers | grep ${subscriber_id}
1301 @{bandwidth_profile_array}= Split String ${bandwidth_profile_output} ,
1302 Log ${bandwidth_profile_array}
1303 FOR ${value} IN @{bandwidth_profile_array}
1304 @{row_value}= Split String ${value} =
1305 ${bandwidth_profile_name}= Set Variable If '${row_value[0]}' == ' ${stream_type}'
1306 ... ${row_value[1]}
1307 ${bandwidth_profile_name}= Convert To String ${bandwidth_profile_name}
1308 Run Keyword If "${bandwidth_profile_name}" != "None" Exit For Loop
1309 END
1310 Log ${bandwidth_profile_name}
1311 [Return] ${bandwidth_profile_name}
1312
1313Execute Remote Command
1314 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1315 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1316 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
Andy Baviereff938d2020-06-29 18:27:49 -07001317 ... ${container_type}=${None} ${container_name}=${None} ${timeout}=${None}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001318 ${conn_id}= SSHLibrary.Open Connection ${ip}
1319 Run Keyword If '${pass}' != '${None}'
1320 ... SSHLibrary.Login ${user} ${pass}
1321 ... ELSE
1322 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1323 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1324 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001325 ${stdout} ${stderr} ${rc}= Run Keyword If '${container_type}' == 'LXC'
1326 ... SSHLibrary.Execute Command lxc exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001327 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001328 ... ELSE IF '${container_type}' == 'K8S'
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001329 ... SSHLibrary.Execute Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
Andy Baviereff938d2020-06-29 18:27:49 -07001330 ... return_stderr=True return_rc=True timeout=${timeout}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001331 ... ELSE
Andy Baviereff938d2020-06-29 18:27:49 -07001332 ... SSHLibrary.Execute Command ${cmd} return_stderr=True return_rc=True timeout=${timeout}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001333
1334 Log ${stdout}
1335 Log ${stderr}
1336 Log ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001337 SSHLibrary.Close Connection
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001338 [Return] ${stdout} ${stderr} ${rc}
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001339
Suraj Gour33651272020-05-04 10:10:16 +05301340Start Remote Command
1341 [Documentation] SSH into a remote host and execute a command on the bare host or in a container.
1342 ... This replaces and simplifies the Login And Run Command On Remote System keyword in CORDRobot.
1343 [Arguments] ${cmd} ${ip} ${user} ${pass}=${None}
1344 ... ${container_type}=${None} ${container_name}=${None}
1345 ${conn_id}= SSHLibrary.Open Connection ${ip}
1346 Run Keyword If '${pass}' != '${None}'
1347 ... SSHLibrary.Login ${user} ${pass}
1348 ... ELSE
1349 ... SSHLibrary.Login With Public Key ${user} %{HOME}/.ssh/id_rsa
1350 ${namespace}= Run Keyword If '${container_type}' == 'K8S' SSHLibrary.Execute Command
1351 ... kubectl get pods --all-namespaces | grep ${container_name} | awk '{print $1}'
1352 Run Keyword If '${container_type}' == 'LXC'
1353 ... SSHLibrary.Start Command lxc exec ${container_name} -- ${cmd}
1354 ... ELSE IF '${container_type}' == 'K8S'
1355 ... SSHLibrary.Start Command kubectl -n ${namespace} exec ${container_name} -- ${cmd}
1356 ... ELSE
1357 ... SSHLibrary.Start Command ${cmd}
Andy Bavier9fb23232020-06-30 15:12:20 -07001358 # It seems that closing the connection immediately will sometimes kill the command
1359 Sleep 1s
Suraj Gour33651272020-05-04 10:10:16 +05301360 SSHLibrary.Close Connection
1361
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001362Run Iperf3 Test Client
1363 [Arguments] ${src} ${server} ${args}
1364 [Documentation] Login to ${src} and run the iperf3 client against ${server} using ${args}.
1365 ... Return a Dictionary containing the results of the test.
Girish Gowdrad769b412021-05-16 11:09:46 -07001366 ${output} ${stderr} ${rc}= Execute Remote Command iperf3 -J -c ${server} ${args} -l 1024 -M 1350 | jq -M -c '.'
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001367 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Andy Bavierf6ab19c2020-05-14 10:34:47 -07001368 Should Be Equal As Integers ${rc} 0
Gayathri.Selvan92d16862020-03-19 14:47:58 +00001369 ${object}= Evaluate json.loads(r'''${output}''') json
1370 [Return] ${object}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001371
Suchitra Vemuri85cb7d62020-07-16 23:46:16 -07001372Run Iperf Test Client for MCAST
1373 [Arguments] ${src} ${server} ${args}
1374 [Documentation] Login to ${src} and run the iperf client against ${server} using ${args}.
1375 ... Return a Dictionary containing the results of the test.
1376 ${output} ${stderr} ${rc}= Execute Remote Command sudo iperf -c ${server} ${args} | jq -M -c '.'
1377 ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
1378 Should Be Equal As Integers ${rc} 0
1379 ${object}= Evaluate json.loads(r'''${output}''') json
1380 [Return] ${object}
1381
Hardik Windlassd19af862021-08-12 11:40:20 +00001382Run Ping In Background
1383 [Arguments] ${output_file} ${dst_ip} ${iface} ${ip} ${user} ${pass}=${None}
1384 ... ${container_type}=${None} ${container_name}=${None}
1385 [Documentation] Runs the 'ping' on remote system in background and stores the result in a file
1386 ${result}= Login And Run Command On Remote System
Hardik Windlass4e0e7c12021-08-26 08:07:35 +00001387 ... echo "ping -I ${iface} ${dst_ip} > ${output_file} &" > ping.sh; chmod +x ping.sh; ./ping.sh
Hardik Windlassd19af862021-08-12 11:40:20 +00001388 ... ${ip} ${user} ${pass} ${container_type} ${container_name}
1389 Log ${result}
1390
1391Stop Ping Running In Background
1392 [Arguments] ${ip} ${user} ${pass}=${None}
1393 ... ${container_type}=${None} ${container_name}=${None}
1394 [Documentation] Stops the 'ping' running in background on remote system
Hardik Windlassa04efa52021-08-13 08:17:24 +00001395 ${cmd}= Run Keyword If '${container_type}' == 'LXC' or '${container_type}' == 'K8S'
1396 ... Set Variable kill -SIGINT `pgrep ping`
1397 ... ELSE
1398 ... Set Variable sudo kill -SIGINT `pgrep ping`
Hardik Windlassd19af862021-08-12 11:40:20 +00001399 ${result}= Login And Run Command On Remote System
Hardik Windlassa04efa52021-08-13 08:17:24 +00001400 ... ${cmd} ${ip} ${user} ${pass} ${container_type} ${container_name}
Hardik Windlassd19af862021-08-12 11:40:20 +00001401 Log ${result}
1402
1403Retrieve Remote File Contents
1404 [Documentation] Retrieves the contents of the file on remote system
1405 [Arguments] ${file} ${ip} ${user} ${pass}=${None}
1406 ... ${container_type}=${None} ${container_name}=${None} ${prompt}=~$
1407 ${output}= Login And Run Command On Remote System
1408 ... cat ${file}
1409 ... ${ip} ${user} ${pass} ${container_type} ${container_name} ${prompt}
1410 [Return] ${output}
1411
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001412RestoreONUs
1413 [Documentation] Restore all connected ONUs
Suchitra Vemuria6879aa2020-11-03 11:03:11 -08001414 [Arguments] ${num_all_onus}
1415 FOR ${I} IN RANGE 0 ${num_all_onus}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001416 ${src}= Set Variable ${hosts.src[${I}]}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001417 ${container_type}= Get Variable Value ${src['container_type']} "null"
1418 ${container_name}= Get Variable Value ${src['container_name']} "null"
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001419 ${onu_type}= Get Variable Value ${src['onu_type']} "null"
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001420 #Get ens6f0 from ens6f0.22
1421 ${if_name}= Replace String Using Regexp ${src['dp_iface_name']} \\..* \
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001422 Run Keyword IF '${onu_type}' == 'alpha' AlphaONURestoreDefault ${src['ip']} ${src['user']}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001423 ... ${src['pass']} ${if_name} admin admin ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001424 END
1425
1426AlphaONURestoreDefault
1427 [Documentation] Restore the Alpha ONU to factory setting
1428 [Arguments] ${rg_ip} ${rg_user} ${rg_pass} ${onu_ifname}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001429 ... ${onu_user} ${onu_pass} ${container_type}=${None} ${container_name}=${None}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001430 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 192.168.1.3/24
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001431 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
TorstenThieme70bc5262021-01-19 12:12:55 +00001432 ${cmd} Catenate
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001433 ... (echo open "192.168.1.1"; sleep 1;
1434 ... echo "${onu_user}"; sleep 1;
1435 ... echo "${onu_pass}"; sleep 1;
1436 ... echo "restoredefault"; sleep 1) | telnet
1437 ${output}= Login And Run Command On Remote System ${cmd}
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001438 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Hung-Wei Chiue0bec7c2020-05-29 22:16:56 +00001439 Log To Console ${output}
1440 ${output}= Login And Run Command On Remote System sudo ifconfig ${onu_ifname} 0
Hung-Wei Chiucc6e6552020-06-04 12:57:38 -07001441 ... ${rg_ip} ${rg_user} ${rg_pass} ${container_type} ${container_name}
Suraj Gour33651272020-05-04 10:10:16 +05301442
1443Create traffic with each pbit and capture at other end
1444 [Documentation] Generates upstream traffic using Mausezahn tool
1445 ... with each pbit and validates reception at other end using tcpdump
1446 [Arguments] ${target_ip} ${target_iface} ${src_iface}
Girish Gowdra66cd95d2021-07-08 10:31:54 -07001447 ... ${packet_count} ${packet_type} ${c_vlan} ${s_vlan} ${direction} ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301448 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
1449 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
1450 FOR ${pbit} IN RANGE 8
Andy Baviereff938d2020-06-29 18:27:49 -07001451 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301452 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001453 ${var1}= Set Variable sudo mausezahn ${src_iface} -B ${target_ip} -c ${packet_count}
Girish Gowdra66cd95d2021-07-08 10:31:54 -07001454 ${var2}= Run Keyword If "${direction}"=="downstream"
1455 ... Set Variable -t ${packet_type} "dp=80, flags=rst, p=aa:aa:aa" -Q ${pbit}:${s_vlan},${pbit}:${c_vlan}
1456 ... ELSE
1457 ... Set Variable -t ${packet_type} "dp=80, flags=rst, p=aa:aa:aa" -Q ${pbit}:${c_vlan}
Suraj Gour33651272020-05-04 10:10:16 +05301458 ${cmd}= Set Variable ${var1} ${var2}
1459 Start Remote Command ${cmd} ${src_ip} ${src_user} ${src_pass}
1460 ... ${src_container_type} ${src_container_name}
1461 ${output} ${stderr} ${rc}= Execute Remote Command
Andy Baviereff938d2020-06-29 18:27:49 -07001462 ... sudo tcpdump -l -U -c 30 -i ${target_iface} -e ${tcpdump_filter}
Suraj Gour33651272020-05-04 10:10:16 +05301463 ... ${dst_ip} ${dst_user} ${dst_pass} ${dst_container_type} ${dst_container_name}
Andy Baviereff938d2020-06-29 18:27:49 -07001464 ... timeout=30 seconds
1465 Execute Remote Command sudo pkill mausezahn
Suraj Gour33651272020-05-04 10:10:16 +05301466 ... ${src_ip} ${src_user} ${src_pass} ${src_container_type} ${src_container_name}
Girish Gowdrabbfbbc32021-05-17 14:36:58 -07001467 Run Keyword If "${tcpdump_filter}"=="tcp"
Girish Gowdraebeca682021-05-18 14:44:41 -07001468 ... Should Match Regexp ${output} , p ${pbit},
Suraj Gour33651272020-05-04 10:10:16 +05301469 END
TorstenThieme70bc5262021-01-19 12:12:55 +00001470
1471Determine Number Of ONU
1472 [Arguments] ${olt_serial_number}=${EMPTY} ${num_onus}=${num_all_onus}
1473 [Documentation] Determine the number of different ONUs for the given OLT taken from host.src
1474 ${onu_list} Create List
1475 FOR ${INDEX} IN RANGE 0 ${num_onus}
1476 Continue For Loop If "${olt_serial_number}"!="${hosts.src[${INDEX}].olt}" and "${olt_serial_number}"!="${EMPTY}"
1477 ${onu_id}= Get Index From List ${onu_list} ${hosts.src[${INDEX}].onu}
1478 Run Keyword If -1 == ${onu_id} Append To List ${onu_list} ${hosts.src[${INDEX}].onu}
1479 END
1480 ${real_num_onus}= Get Length ${onu_list}
1481 [Return] ${real_num_onus}
Hardik Windlass44abec12021-09-27 07:52:33 +00001482
1483Validate Cleanup In ETCD
1484 [Documentation] The keyword verifies that device, ports, flows, meters are all cleared in ETCD
1485 [Arguments] ${namespace}=default ${defaultkvstoreprefix}=voltha_voltha
1486 ${podname}= Set Variable etcd
1487 ${kvstoreprefix}= Get Kv Store Prefix ${defaultkvstoreprefix}
1488 # Log Devices Output and Verify Output Should be Empty
1489 ${commandget}= Catenate
1490 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/devices --keys-only'
1491 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1492 Log ${result}
1493 Should Be Empty ${result} Stale Devices Data in Etcd!
1494 # Log Flows Output and Verify Output Should be Empty
1495 ${commandget}= Catenate
1496 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/flows --keys-only'
1497 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1498 Log ${result}
1499 Should Be Empty ${result} Stale Flows Data in Etcd!
1500 # Log LogicalDevices Output and Verify Output Should be Empty
1501 ${commandget}= Catenate
1502 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/logical_devices --keys-only'
1503 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1504 Log ${result}
1505 Should Be Empty ${result} Stale Logical Devices Data in Etcd!
1506 # Log LogicalFlows Output and Verify Output Should be Empty
1507 ${commandget}= Catenate
1508 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/logical_flows --keys-only'
1509 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1510 Log ${result}
1511 Should Be Empty ${result} Stale Logical Flows Data in Etcd!
1512 # Log LogicalMeters Output and Verify Output Should be Empty
1513 ${commandget}= Catenate
1514 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/logical_meters --keys-only'
1515 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1516 Log ${result}
1517 Should Be Empty ${result} Stale Logical Meters Data in Etcd!
1518 # Log LogicalPorts Output and Verify Output Should be Empty
1519 ${commandget}= Catenate
1520 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/logical_ports --keys-only'
1521 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1522 Log ${result}
1523 Should Be Empty ${result} Stale Logical Ports Data in Etcd!
1524 # Log Openolt Output and Verify Output Should be Empty
1525 ${commandget}= Catenate
1526 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/openolt --keys-only'
1527 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1528 Log ${result}
1529 Should Be Empty ${result} Stale Openolt Data in Etcd!
1530 # Log Openonu Output and Verify Output Should be Empty
1531 ${commandget}= Catenate
1532 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/openonu --keys-only'
1533 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1534 Log ${result}
1535 Should Be Empty ${result} Stale Openonu Data in Etcd!
1536 # Log Ports Output and Verify Output Should be Empty
1537 ${commandget}= Catenate
1538 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/ports --keys-only'
1539 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1540 Log ${result}
1541 Should Be Empty ${result} Stale Ports Data in Etcd!
1542 # Log ResourceInstances Output and Verify Output Should be Empty
1543 ${commandget}= Catenate
1544 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/resource_instances --keys-only'
1545 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1546 Log ${result}
1547 Should Be Empty ${result} Stale Resource Instances Data in Etcd!
1548 # Log ResourceManager Output and Verify Output Should be Empty
1549 ${commandget}= Catenate
1550 ... /bin/sh -c 'ETCDCTL_API=3 etcdctl get --prefix service/${kvstoreprefix}/resource_manager --keys-only'
1551 ${result}= Exec Pod In Kube ${namespace} ${podname} ${commandget}
1552 Log ${result}
1553 Should Be Empty ${result} Stale Resource Manager Data in Etcd!
Hardik Windlass81375222021-12-02 10:48:01 +00001554
Hardik Windlass81375222021-12-02 10:48:01 +00001555Clean Up All Nodes
1556 [Documentation] Login to each node and kill all stale lxc prcoesses
1557 ${num_nodes}= Get Length ${nodes}
1558 FOR ${I} IN RANGE 0 ${num_nodes}
1559 ${node_ip}= Evaluate ${nodes}[${I}].get("ip")
1560 ${node_user}= Evaluate ${nodes}[${I}].get("user")
1561 ${node_pass}= Evaluate ${nodes}[${I}].get("pass")
1562 Run Keyword And Continue On Failure Start Remote Command kill -9 `pidof lxc`
1563 ... ${node_ip} ${node_user} ${node_pass}
1564 END
Girish Gowdrafc0bdf22021-12-06 16:57:50 +05301565
1566Reboot XGSPON ONU
1567 [Documentation] Reboots the XGSPON ONU and verifies the ONU state after the reboot
1568 [Arguments] ${olt_sn} ${onu_sn} ${reason}
1569 FOR ${I} IN RANGE 0 ${num_olts}
1570 ${serial_number} Evaluate ${olts}[${I}].get("serial")
1571 Continue For Loop If "${serial_number}"!="${olt_sn}"
1572 ${board_tech} Evaluate ${olts}[${I}].get("board_technology")
1573 ${onu_device_id}= Get Device ID From SN ${onu_sn}
1574 Run Keyword If "${board_tech}"=="XGS-PON" Run Keywords
1575 ... Reboot Device ${onu_device_id}
1576 ... AND Wait Until Keyword Succeeds 120s 5s
1577 ... Validate Device ENABLED ACTIVE
1578 ... REACHABLE ${onu_sn} onu=True onu_reason=${reason}
1579 END
Girish Gowdra8fd96962021-12-14 16:20:04 +05301580
1581Set Non-Critical Tag for XGSPON Tech
1582 [Documentation] Dynamically sets the test tag for xgs-pon based to non-critical
1583 FOR ${I} IN RANGE 0 ${num_olts}
1584 ${board_tech} Evaluate ${olts}[${I}].get("board_technology")
1585 Run Keyword If "${board_tech}"=="XGS-PON" Run Keywords
1586 ... Set Tags non-critical
1587 ... AND Exit For Loop
1588 END