blob: 009bc6509666af8418bb7deeefc53b43a98dfdf9 [file] [log] [blame]
# Copyright 2021 - present Open Networking Foundation
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# FIXME Can we use the same test against BBSim and Hardware?
*** Settings ***
Documentation Test various functional end-to-end scenarios for TT workflow
Suite Setup Setup Suite
Test Setup Setup
Test Teardown Teardown
Suite Teardown Teardown Suite
Library Collections
Library String
Library OperatingSystem
Library XML
Library RequestsLibrary
Library ../../libraries/DependencyLibrary.py
Resource ../../libraries/onos.robot
Resource ../../libraries/voltctl.robot
Resource ../../libraries/voltha.robot
Resource ../../libraries/utils.robot
Resource ../../libraries/k8s.robot
Resource ../../variables/variables.robot
Resource ../../libraries/power_switch.robot
*** Variables ***
${POD_NAME} flex-ocp-cord
${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs
#${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf
${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml
${HELM_CHARTS_DIR} ~/helm-charts
${VOLTHA_POD_NUM} 8
${NAMESPACE} voltha
# For below variable value, using deployment name as using grep for
# parsing radius pod name, we can also use full radius pod name
${RESTART_POD_NAME} radius
${timeout} 60s
${of_id} 0
${logical_id} 0
${has_dataplane} True
${teardown_device} True
${scripts} ../../scripts
# Per-test logging on failure is turned off by default; set this variable to enable
${container_log_dir} ${None}
# For dataplane bandwidth testing
${lower_margin_pct} 90 # Allow 10% under the limit
*** Test Cases ***
Test that the BW is limited to Limiting Bandwidth
[Documentation] Verify support for Tcont type 1.
... Verify that traffic is limited to Limiting Bandwidth (eir+cir+air) configured for the service/onu.
... Pump 500Mbps in the upstream from RG and verify that the received traffic is only 200Mbps at the BNG.
... Note: Currently, only Flex Pod supports the deployment configuration required to test this scenario.
[Tags] functionalTT VOL-4093
[Setup] Run Keywords Start Logging TcontType1Onu1
... AND Setup
[Teardown] Run Keywords Collect Logs
... AND Stop Logging TcontType1Onu1
... AND Delete All Devices and Verify
Run Keyword If ${has_dataplane} Clean Up Linux
Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Tests TT
# Find the ONU as required for this test
${test_onu}= Set Variable ${multi_tcont_tests.tcont1[0]}
${test_onu_sn}= Set Variable ${test_onu['onu']}
${test_service_type}= Set Variable ${test_onu['service_type']}
${test_us_bw_profile}= Set Variable ${test_onu['us_bw_profile']}
${matched} ${src} ${dst}= Get ONU details with Given Sn and Service ${test_onu_sn} ${test_service_type}
... ${test_us_bw_profile}
Pass Execution If '${matched}' != 'True'
... Skipping test: No ONU found with sn '${test_onu_sn}', service '${test_service_type}' and us_bw '${test_us_bw_profile}'
# Check for iperf3 and jq tools
${stdout} ${stderr} ${rc}= Execute Remote Command which iperf3 jq
... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Pass Execution If ${rc} != 0 Skipping test: iperf3 / jq not found on the RG
${limiting_bw_value_upstream}= Get Limiting Bandwidth Details ${test_us_bw_profile}
# Stream UDP packets from RG to server
${updict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']}
... args=-u -b 500M -t 30 -p 5201
# With UDP test, bits per second is the sending rate. Multiply by the loss rate to get the throughput.
${actual_upstream_bw_used}= Evaluate
... (100 - ${updict['end']['sum']['lost_percent']})*${updict['end']['sum']['bits_per_second']}/100000
${pct_limit_up}= Evaluate 100*${actual_upstream_bw_used}/${limiting_bw_value_upstream}
Should Be True ${pct_limit_up} >= ${lower_margin_pct}
... The upstream bandwidth guarantee was not met (${pct_limit_up}% of resv)
Test that assured BW is allocated as needed on the PON
[Documentation] Verify support for Tcont type 2 and 4.
... Verify that the BW from tcont type 4 is bequeathed to type2 as needed.
... 1) Pump 1Gbps in the upstream from the RG for HSIA service and verify that no more than 1Gbps is received at the BNG.
... 2) Pump 500Mbps from the RG for the VoD service and verify that close to 500Mbps is received at the BNG.
... Also, verify that the HSI rate is now truncated to 500Mbps at BNG.
... Note: Currently, only Flex Pod supports the deployment configuration required to test this scenario.
[Tags] functionalTT VOL-4095
[Setup] Run Keywords Start Logging TcontType2Type4Onu1
... AND Setup
[Teardown] Run Keywords Collect Logs
... AND Stop Logging TcontType2Type4Onu1
... AND Delete All Devices and Verify
Run Keyword If ${has_dataplane} Clean Up Linux
Wait Until Keyword Succeeds ${timeout} 2s Perform Sanity Test TT
# The test expects the first entry in multi_tcont_tests.tcont2tcont4 input will be for service: vod and tcont: 2
# The test expects the second entry in multi_tcont_tests.tcont2tcont4 input will be for service: hsia and tcont: 4
${list_onus_ut}= Create List
${num_multi_tcont_input}= Get Length ${multi_tcont_tests.tcont2tcont4}
FOR ${I} IN RANGE 0 ${num_multi_tcont_input}
${onu}= Set Variable ${multi_tcont_tests.tcont2tcont4[${I}]}
${onu_sn}= Set Variable ${onu['onu']}
${service}= Set Variable ${onu['service_type']}
${us_bw}= Set Variable ${onu['us_bw_profile']}
${matched} ${src} ${dst}= Get ONU details with Given Sn and Service ${onu_sn}
... ${service} ${us_bw}
Pass Execution If '${matched}' != 'True'
... Skipping test: No ONU found with sn '${onu_sn}', service '${service}' and us_bw '${us_bw}'
# Check for iperf3 and jq tools
${stdout} ${stderr} ${rc}= Execute Remote Command which iperf3 jq
... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Pass Execution If ${rc} != 0 Skipping test: iperf3 / jq not found on the RG
# Get Upstream BW Profile details
${limiting_bw_us}= Get Limiting Bandwidth Details ${us_bw}
${onu_ut} Create Dictionary src ${src} dst ${dst} limiting_bw_us ${limiting_bw_us}
Append To List ${list_onus_ut} ${onu_ut}
END
# Case 1: Verify only for HSIA service
${dst}= Set Variable ${list_onus_ut}[1][dst]
${updict}= Run Iperf3 Test Client ${list_onus_ut}[1][src] server=${dst['dp_iface_ip_qinq']}
... args=-t 30 -p 5202
${actual_upstream_bw_used}= Evaluate ${updict['end']['sum_received']['bits_per_second']}/1000
${pct_limit_up}= Evaluate 100*${actual_upstream_bw_used}/${list_onus_ut}[1][limiting_bw_us]
Should Be True ${pct_limit_up} >= ${lower_margin_pct}
... The upstream bandwidth guarantee was not met (${pct_limit_up}% of resv)
# Case 2: Verify for VOD (with index [0]) and HSIA (with index [1]) service combined
${out_file_0}= Set Variable ${CURDIR}/../../tests/data/out_tcont2
${dst_0}= Set Variable ${list_onus_ut}[0][dst]
Run Iperf3 Test Client in Background ${list_onus_ut}[0][src] server=${dst_0['dp_iface_ip_qinq']}
... args=-t 30 -p 5201 out_file=${out_file_0}
${out_file_1}= Set Variable ${CURDIR}/../../tests/data/out_tcont4
${dst_1}= Set Variable ${list_onus_ut}[1][dst]
Run Iperf3 Test Client in Background ${list_onus_ut}[1][src] server=${dst_1['dp_iface_ip_qinq']}
... args=-t 30 -p 5202 out_file=${out_file_1}
# Wait for the above iperf commands to finish (sleep time depends on -t arg value passed in iperf command)
Sleep 35s
${out_0}= Read Output File on System ${out_file_0}
${out_1}= Read Output File on System ${out_file_1}
${actual_upstream_bw_used_0}= Evaluate ${out_0['end']['sum_received']['bits_per_second']}/1000
${pct_limit_up_0}= Evaluate 100*${actual_upstream_bw_used_0}/${list_onus_ut}[0][limiting_bw_us]
Should Be True ${pct_limit_up_0} >= ${lower_margin_pct}
... The upstream bandwidth guarantee was not met (${pct_limit_up_0}% of resv)
${actual_upstream_bw_used_1}= Evaluate ${out_1['end']['sum_received']['bits_per_second']}/1000
${pct_limit_up_1}= Evaluate
... 100*${actual_upstream_bw_used_1}/(${list_onus_ut}[1][limiting_bw_us]-${list_onus_ut}[0][limiting_bw_us])
Should Be True ${pct_limit_up_1} >= ${lower_margin_pct}
... The upstream bandwidth guarantee was not met (${pct_limit_up_1}% of resv)
*** Keywords ***
Read Output File on System
[Arguments] ${file}
[Documentation] Reads the content of ${file}.
${output}= OperatingSystem.Get File ${file}
Log ${output}
${object}= Evaluate json.loads(r'''${output}''') json
[Return] ${object}
Run Iperf3 Test Client in Background
[Arguments] ${src} ${server} ${args} ${out_file}
[Documentation] Login to ${src} and run the iperf3 client against ${server} using ${args} in background.
... Stores the results of the test in ${out_file}.
${output} ${stderr} ${rc}= Execute Remote Command iperf3 -J -c ${server} ${args} > ${out_file} &
... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']}
Should Be Equal As Integers ${rc} 0
Get ONU details with Given Sn and Service
[Documentation] This keyword finds the ONU details (as required for multi-tcont test)
... with given serial number and service type
... The keyword, additionally, also verifies the associated upstream bandwidth profile
[Arguments] ${onu_sn} ${service_type} ${us_bw_profile}
${matched}= Set Variable False
FOR ${I} IN RANGE 0 ${num_all_onus}
${src}= Set Variable ${hosts.src[${I}]}
${dst}= Set Variable ${hosts.dst[${I}]}
${service}= Get Variable Value ${src['service_type']} "null"
${onu}= Get Variable Value ${src['onu']} "null"
Continue For Loop If '${onu}' != '${onu_sn}' or '${service}' != '${service_type}'
# Additional verification to check upstream bandwidth profile
${of_id}= Get ofID From OLT List ${src['olt']}
${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} ${of_id}
${subscriber_id}= Set Variable ${of_id}/${onu_port}
${us_bw} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} upstreamBandwidthProfile
... ${service_type}
${matched}= Set Variable If
... '${onu}' == '${onu_sn}' and '${service}' == '${service_type}' and ${us_bw} == '${us_bw_profile}'
... True False
Exit For Loop If ${matched}
END
[Return] ${matched} ${src} ${dst}
Setup Suite
[Documentation] Set up the test suite
Common Test Suite Setup
${switch_type}= Get Variable Value ${web_power_switch.type}
Run Keyword If "${switch_type}"!="" Set Global Variable ${powerswitch_type} ${switch_type}
Clear All Devices Then Create New Device
[Documentation] Remove any devices from VOLTHA and ONOS
# Remove all devices from voltha and nos
Delete All Devices and Verify
# Execute normal test Setup Keyword
Setup
Teardown Suite
[Documentation] Tear down steps for the suite
Run Keyword If ${has_dataplane} Clean Up Linux
Run Keyword If ${teardown_device} Delete All Devices And Verify
Close All ONOS SSH Connections