Blame - tests/software-upgrades/Voltha_ComponentsUpgrade.robot - voltha-system-tests

2021-02-23 15:34:50 +0000

[diff] [blame]

1

2

#

3

# Licensed under the Apache License, Version 2.0 (the "License");

4

# you may not use this file except in compliance with the License.

5

# You may obtain a copy of the License at

6

#

7

# http://www.apache.org/licenses/LICENSE-2.0

8

#

9

# Unless required by applicable law or agreed to in writing, software

10

# distributed under the License is distributed on an "AS IS" BASIS,

11

# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

12

# See the License for the specific language governing permissions and

13

# limitations under the License.

14

# FIXME Can we use the same test against BBSim and Hardware?

15

16

*** Settings ***

17

Documentation Test Voltha Components Software Upgrade

18

Suite Setup Setup Suite

19

Test Setup Setup

20

Test Teardown Teardown

21

Suite Teardown Teardown Suite

22

Library Collections

23

Library String

24

Library OperatingSystem

25

Library XML

26

Library RequestsLibrary

27

Library ../../libraries/DependencyLibrary.py

28

Resource ../../libraries/onos.robot

29

Resource ../../libraries/voltctl.robot

30

Resource ../../libraries/voltha.robot

31

Resource ../../libraries/utils.robot

32

Resource ../../libraries/k8s.robot

33

Resource ../../variables/variables.robot

34

Resource ../../libraries/power_switch.robot

35

36

*** Variables ***

37

${POD_NAME} flex-ocp-cord

38

${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf

39

${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs

40

#${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf

41

${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml

42

${HELM_CHARTS_DIR} ~/helm-charts

43

${VOLTHA_POD_NUM} 8

44

${NAMESPACE} voltha

Hardik Windlass

4288c6a

2021-09-28 07:22:06 +0000

[diff] [blame]

45

${INFRA_NAMESPACE} default

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

46

# For below variable value, using deployment name as using grep for

47

# parsing radius pod name, we can also use full radius pod name

48

${RESTART_POD_NAME} radius

${timeout} 60s

${of_id} 0

${logical_id} 0

${has_dataplane} True

53

${teardown_device} False

54

${scripts} ../../scripts

55

56

# Per-test logging on failure is turned off by default; set this variable to enable

57

${container_log_dir} ${None}

58

Matteo Scandolo

da1c64b

2021-07-20 10:14:49 -0700

[diff] [blame]

59

# logging flag to enable Collect Logs, can be passed via the command line too

60

# example: -v logging:False

61

${logging} True

62

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

63

${suppressaddsubscriber} True

64

65

# Voltha Components to Test for Software Upgrade need to be passed in the following variable in format:

Hardik Windlass

2021-03-09 07:33:51 +0000

[diff] [blame]

66

# <comp-label>,<comp-container>,<comp-image>*<comp-label>,<comp-container>,<comp-image>*

67

# Example: adapter-open-olt,adapter-open-olt,voltha/voltha-openolt-adapter:3.1.3*

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

68

${voltha_comps_under_test} ${EMPTY}

69

70

*** Test Cases ***

71

Test Voltha Components Minor Version Upgrade

72

[Documentation] Validates the Voltha Components Minor Version Upgrade doesn't affect the system functionality

73

... Performs the sanity and verifies all the ONUs are authenticated/DHCP/pingable

74

... Requirement: Components to test needs to be passed in robot command variable 'voltha_comps_under_test' in the format:

Hardik Windlass

2021-03-09 07:33:51 +0000

[diff] [blame]

75

... <comp-label>,<comp-container>,<comp-image>*<comp-label>,<comp-container>,<comp-image>*

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

76

... Check [VOL-3843] for more details

77

[Tags] functional VolthaCompMinorVerUpgrade

78

[Setup] Start Logging VolthaCompMinorVerUpgrade

79

[Teardown] Run Keywords Collect Logs

80

... AND Stop Logging VolthaCompMinorVerUpgrade

81

... AND Delete All Devices and Verify

82

# Add OLT device

83

Setup

84

# Performing Sanity Test to make sure subscribers are all DHCP and pingable

85

Run Keyword If ${has_dataplane} Clean Up Linux

86

Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test

87

${podStatusOutput}= Run kubectl get pods -n ${NAMESPACE}

88

Log ${podStatusOutput}

89

${countBeforeUpgrade}= Run kubectl get pods -n ${NAMESPACE} | grep Running | wc -l

90

${num_comps_under_test}= Get Length ${list_voltha_comps_under_test}

91

FOR ${I} IN RANGE 0 ${num_comps_under_test}

92

${label}= Set Variable ${list_voltha_comps_under_test}[${I}][label]

93

${container}= Set Variable ${list_voltha_comps_under_test}[${I}][container]

94

${image}= Set Variable ${list_voltha_comps_under_test}[${I}][image]

Hardik Windlass

2021-03-09 07:33:51 +0000

[diff] [blame]

95

${pod_image} ${app_ver} ${helm_chart} Get Pod Image And App Version And Helm Chart By Label

96

... ${NAMESPACE} app ${label}

97

Log ${label}: image, app ver & helm chart before upgrade: ${pod_image}, ${app_ver} & ${helm_chart}

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

98

${deployment}= Wait Until Keyword Succeeds ${timeout} 15s

99

... Get K8s Deployment by Pod Label ${NAMESPACE} app ${label}

100

Wait Until Keyword Succeeds ${timeout} 15s Deploy Pod New Image ${NAMESPACE} ${deployment}

101

... ${container} ${image}

102

Wait Until Keyword Succeeds ${timeout} 3s Validate Pods Status By Label ${NAMESPACE}

103

... app ${label} Running

104

Wait Until Keyword Succeeds ${timeout} 3s Pods Are Ready By Label ${NAMESPACE} app ${label}

105

Wait Until Keyword Succeeds ${timeout} 3s Verify Pod Image ${NAMESPACE} app ${label} ${image}

Hardik Windlass

2021-03-09 07:33:51 +0000

[diff] [blame]

106

${pod_image_1} ${app_ver_1} ${helm_chart_1} Get Pod Image And App Version And Helm Chart By Label

107

... ${NAMESPACE} app ${label}

108

Log ${label}: image, app ver & helm chart after upgrade: ${pod_image_1}, ${app_ver_1} & ${helm_chart_1}

Matteo Scandolo

2769d2b

2021-04-14 10:29:24 -0700

[diff] [blame]

109

Restart VOLTHA Port Forward voltha-api

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

110

Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test ${suppressaddsubscriber}

111

END

112

${podStatusOutput}= Run kubectl get pods -n ${NAMESPACE}

113

Log ${podStatusOutput}

114

${countAfterUpgrade}= Run kubectl get pods -n ${NAMESPACE} | grep Running | wc -l

115

Should Be Equal As Strings ${countAfterUpgrade} ${countBeforeUpgrade}

116

# Additional Verification

117

Wait Until Keyword Succeeds ${timeout} 2s Delete All Devices and Verify

118

Setup

119

Run Keyword If ${has_dataplane} Clean Up Linux

120

Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test

121

Hardik Windlass

2022-01-17 07:35:53 +0000

[diff] [blame]

122

123

Test Voltha Components Minor Version Rolling Upgrade

124

[Documentation] Validates that the system can handle operations during software upgrade for minor versions.

125

... Requirement: Components to test needs to be passed in robot command variable 'voltha_comps_under_test' in the format:

126

... <comp-label>,<comp-container>,<comp-image>*<comp-label>,<comp-container>,<comp-image>*

127

... Check [VOL-4534] for more details

Hardik Windlass

76f6821

2022-01-19 08:16:14 +0000

[diff] [blame]

128

[Tags] functional VolthaCompMinorVerRollingUpgrade

Hardik Windlass

2022-01-17 07:35:53 +0000

[diff] [blame]

129

[Setup] Start Logging VolthaCompMinorVerRollingUpgrade

130

[Teardown] Run Keywords Collect Logs

131

... AND Stop Logging VolthaCompMinorVerRollingUpgrade

132

... AND Delete All Devices and Verify

133

# Add OLT device

134

Setup

135

Run Keyword If ${has_dataplane} Clean Up Linux

136

FOR ${I} IN RANGE 0 ${olt_count}

137

${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn

138

${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number}

139

${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS

140

... ${olt_serial_number}

141

Wait Until Keyword Succeeds ${timeout} 2s Device Is Available In ONOS

142

... http://karaf:karaf@${ONOS_REST_IP}:${ONOS_REST_PORT} ${of_id}

143

END

144

FOR ${I} IN RANGE 0 ${num_all_onus}

145

${src}= Set Variable ${hosts.src[${I}]}

146

${dst}= Set Variable ${hosts.dst[${I}]}

147

${of_id}= Get ofID From OLT List ${src['olt']}

148

${onu_device_id}= Get Device ID From SN ${src['onu']}

149

${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']}

150

... ${of_id} ${src['uni_id']}

151

# Check ONU port is Enabled in ONOS

152

Wait Until Keyword Succeeds 120s 2s

153

... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']}

154

Wait Until Keyword Succeeds ${timeout} 5s

155

... Verify Default Meter Present in ONOS ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id}

156

Wait Until Keyword Succeeds ${timeout} 2s Verify Eapol Flows Added For ONU ${ONOS_SSH_IP}

157

... ${ONOS_SSH_PORT} ${of_id} ${onu_port}

158

# Bring up the device and verify it authenticates

159

Wait Until Keyword Succeeds ${timeout} 5s Validate Device ENABLED ACTIVE REACHABLE

160

... ${onu_device_id} onu=True onu_reason=omci-flows-pushed by_dev_id=True

161

${wpa_log}= Run Keyword If ${has_dataplane} Catenate SEPARATOR=.

162

... /tmp/wpa ${src['dp_iface_name']} log

163

Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate Authentication True

164

... ${src['dp_iface_name']} wpa_supplicant.conf ${src['ip']} ${src['user']} ${src['pass']}

165

... ${src['container_type']} ${src['container_name']} ${wpa_log}

166

Wait Until Keyword Succeeds ${timeout} 2s Verify ONU in AAA-Users ${ONOS_SSH_IP}

167

... ${ONOS_SSH_PORT} ${onu_port}

168

END

169

${podStatusOutput}= Run kubectl get pods -n ${NAMESPACE}

170

Log ${podStatusOutput}

171

${countBeforeUpgrade}= Run kubectl get pods -n ${NAMESPACE} | grep Running | wc -l

172

${num_comps_under_test}= Get Length ${list_voltha_comps_under_test}

173

FOR ${I} IN RANGE 0 ${num_comps_under_test}

174

${label}= Set Variable ${list_voltha_comps_under_test}[${I}][label]

175

${container}= Set Variable ${list_voltha_comps_under_test}[${I}][container]

176

${image}= Set Variable ${list_voltha_comps_under_test}[${I}][image]

177

${pod_image} ${app_ver} ${helm_chart} Get Pod Image And App Version And Helm Chart By Label

178

... ${NAMESPACE} app ${label}

179

Log ${label}: image, app ver & helm chart before upgrade: ${pod_image}, ${app_ver} & ${helm_chart}

180

${deployment}= Wait Until Keyword Succeeds ${timeout} 15s

181

... Get K8s Deployment by Pod Label ${NAMESPACE} app ${label}

182

Wait Until Keyword Succeeds ${timeout} 15s Deploy Pod New Image ${NAMESPACE} ${deployment}

183

... ${container} ${image}

184

# Static sleep to let image-update progress before initiating subscriber-add system-operation

185

Sleep 2s

186

Provision Subscribers

187

Wait Until Keyword Succeeds ${timeout} 3s Validate Pods Status By Label ${NAMESPACE}

188

... app ${label} Running

189

Wait Until Keyword Succeeds ${timeout} 3s Pods Are Ready By Label ${NAMESPACE} app ${label}

190

Wait Until Keyword Succeeds ${timeout} 3s Verify Pod Image ${NAMESPACE} app ${label} ${image}

191

${pod_image_1} ${app_ver_1} ${helm_chart_1} Get Pod Image And App Version And Helm Chart By Label

192

... ${NAMESPACE} app ${label}

193

Log ${label}: image, app ver & helm chart after upgrade: ${pod_image_1}, ${app_ver_1} & ${helm_chart_1}

194

Restart VOLTHA Port Forward voltha-api

Hardik Windlass

515e9ee

2022-02-24 11:52:31 +0000

[diff] [blame]

195

# Static sleep to let voltctl tcp connection establish

196

Sleep 5s

Hardik Windlass

2022-01-17 07:35:53 +0000

[diff] [blame]

197

Verify Provisioned Subscribers

198

Unprovision Subscribers

199

END

200

${podStatusOutput}= Run kubectl get pods -n ${NAMESPACE}

201

Log ${podStatusOutput}

202

${countAfterUpgrade}= Run kubectl get pods -n ${NAMESPACE} | grep Running | wc -l

203

Should Be Equal As Strings ${countAfterUpgrade} ${countBeforeUpgrade}

204

# Additional Verification

205

Wait Until Keyword Succeeds ${timeout} 2s Delete All Devices and Verify

206

Setup

207

Run Keyword If ${has_dataplane} Clean Up Linux

208

Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test

209

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

210

*** Keywords ***

211

Setup Suite

212

[Documentation] Set up the test suite

213

Common Test Suite Setup

214

Create Voltha Comp Under Test List

215

216

Teardown Suite

217

[Documentation] Tear down steps for the suite

218

Run Keyword If ${has_dataplane} Clean Up Linux

TorstenThieme

4e2168e

2021-06-22 14:01:47 +0000

[diff] [blame]

219

Close All ONOS SSH Connections

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

220

221

Create Voltha Comp Under Test List

222

[Documentation] Creates a list of Voltha Components to Test from the input variable string

223

... The input string is expected to be in format:

Hardik Windlass

2021-03-09 07:33:51 +0000

[diff] [blame]

224

... <comp-label>,<comp-container>,<comp-image>*<comp-label>,<comp-container>,<comp-image>*

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

225

${list_voltha_comps_under_test} Create List

226

@{comps_under_test_arr}= Split String ${voltha_comps_under_test} *

227

${num_comps_under_test}= Get Length ${comps_under_test_arr}

Hardik Windlass

2021-03-09 07:33:51 +0000

[diff] [blame]

228

FOR ${I} IN RANGE 0 ${num_comps_under_test}-1

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

229

@{comp_under_test_arr}= Split String ${comps_under_test_arr[${I}]} ,

230

${label}= Set Variable ${comp_under_test_arr[0]}

231

${container}= Set Variable ${comp_under_test_arr[1]}

232

${image}= Set Variable ${comp_under_test_arr[2]}

233

${comp_under_test} Create Dictionary label ${label} container ${container} image ${image}

234

Append To List ${list_voltha_comps_under_test} ${comp_under_test}

235

END

Hardik Windlass

2021-03-09 07:33:51 +0000

[diff] [blame]

236

Log ${list_voltha_comps_under_test}

Hardik Windlass

2021-02-23 15:34:50 +0000

[diff] [blame]

237

Set Suite Variable ${list_voltha_comps_under_test}

Hardik Windlass