| # Copyright 2017 - present Open Networking Foundation |
| # |
| # Licensed under the Apache License, Version 2.0 (the "License"); |
| # you may not use this file except in compliance with the License. |
| # You may obtain a copy of the License at |
| # |
| # http://www.apache.org/licenses/LICENSE-2.0 |
| # |
| # Unless required by applicable law or agreed to in writing, software |
| # distributed under the License is distributed on an "AS IS" BASIS, |
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| # See the License for the specific language governing permissions and |
| # limitations under the License. |
| # FIXME Can we use the same test against BBSim and Hardware? |
| |
| *** Settings *** |
| Documentation Test various end-to-end scenarios |
| Suite Setup Setup Suite |
| Test Setup Setup |
| Test Teardown Teardown |
| Suite Teardown Teardown Suite |
| Library Collections |
| Library String |
| Library OperatingSystem |
| Library XML |
| Library RequestsLibrary |
| Library ../../libraries/DependencyLibrary.py |
| Resource ../../libraries/onos.robot |
| Resource ../../libraries/voltctl.robot |
| Resource ../../libraries/voltha.robot |
| Resource ../../libraries/utils.robot |
| Resource ../../libraries/k8s.robot |
| Resource ../../variables/variables.robot |
| Resource ../../libraries/power_switch.robot |
| |
| *** Variables *** |
| ${POD_NAME} flex-ocp-cord |
| ${KUBERNETES_CONF} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf |
| ${KUBERNETES_CONFIGS_DIR} ~/pod-configs/kubernetes-configs |
| #${KUBERNETES_CONFIGS_DIR} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.conf |
| ${KUBERNETES_YAML} ${KUBERNETES_CONFIGS_DIR}/${POD_NAME}.yml |
| ${HELM_CHARTS_DIR} ~/helm-charts |
| ${VOLTHA_POD_NUM} 8 |
| ${NAMESPACE} voltha |
| ${INFRA_NAMESPACE} default |
| # For below variable value, using deployment name as using grep for |
| # parsing radius pod name, we can also use full radius pod name |
| ${RESTART_POD_NAME} radius |
| ${timeout} 60s |
| ${of_id} 0 |
| ${logical_id} 0 |
| ${uprate} 0 |
| ${dnrate} 0 |
| ${has_dataplane} True |
| ${teardown_device} True |
| ${scripts} ../../scripts |
| # flag to reboot OLT through Power Switch |
| ${power_cycle_olt} False |
| |
| # For dataplane bandwidth testing |
| ${upper_margin_pct} 105 # Allow 5% over the limit |
| ${lower_margin_pct} 90 # Allow 8% under the limit |
| ${udp_rate_multiplier} 1.10 # Send UDP at bw profile limit * rate_multiplier |
| ${udp_packet_bytes} 1470 # UDP payload in bytes |
| |
| # Per-test logging on failure is turned off by default; set this variable to enable |
| ${container_log_dir} ${None} |
| |
| # logging flag to enable Collect Logs, can be passed via the command line too |
| # example: -v logging:False |
| ${logging} True |
| |
| # Flag specific to Soak Jobs |
| ${SOAK_TEST} False |
| ${bbsim_port} 50060 |
| |
| *** Test Cases *** |
| Reboot DT ONUs and OLTs Physically |
| [Documentation] This test reboots ONUs and OLTs physically before execution all the tests |
| ... Test case runs only on the PODs that are configured with PowerSwitch that |
| ... controls the power off/on ONUs/OLT remotely (simulating a physical reboot) |
| [Tags] functionalDt PowerSwitch RebootAllDTONUsOLTs soak |
| [Setup] Start Logging RebootAllDTONUsOLTs |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging RebootAllDTONUsOLTs |
| Perform Reboot ONUs and OLTs Physically ${power_cycle_olt} |
| |
| Create Soak BBSim Device |
| [Documentation] This creates and enables the BBSim device as required by the soak testing |
| ... The BBSim OLT and ONUs created as part of this test are not part of active testing |
| ... but only to mock the load on Soak POD. |
| [Tags] soak |
| [Setup] Start Logging soakPodCreateBBSimLoad |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging soakPodCreateBBSimLoad |
| ${num_bbsim} Get Length ${bbsim} |
| @{bbsim_olt_of_id_list}= Create List |
| FOR ${I} IN RANGE 0 ${num_bbsim} |
| ${ip} Evaluate ${bbsim}[${I}].get("ip") |
| ${serial_number} Evaluate ${bbsim}[${I}].get("serial") |
| ${bbsim_olt_device_id}= Create Device ${ip} ${bbsim_port} |
| Log ${bbsim_olt_device_id} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate OLT Device PREPROVISIONED UNKNOWN UNKNOWN ${bbsim_olt_device_id} by_dev_id=True |
| Enable Device ${bbsim_olt_device_id} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate OLT Device ENABLED ACTIVE REACHABLE ${serial_number} |
| ${bbsim_olt_of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS |
| ... ${serial_number} |
| Log ${bbsim_olt_of_id} |
| Append To List ${bbsim_olt_of_id_list} ${bbsim_olt_of_id} |
| END |
| # Extra sleep time for ONUs to come up Active |
| Sleep 60s |
| FOR ${bbsim_olt_of_id} IN @{bbsim_olt_of_id_list} |
| Provision all subscribers on device ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${ONOS_SSH_IP} ${ONOS_REST_PORT} |
| ... ${bbsim_olt_of_id} |
| ${total_onus_per_bbsim_olt}= Count Enabled UNI Ports ${ONOS_SSH_IP} ${ONOS_SSH_PORT} |
| ... ${bbsim_olt_of_id} |
| Wait for all flows to in ADDED state ${ONOS_SSH_IP} ${ONOS_SSH_PORT} |
| ... ${bbsim_olt_of_id} dt ${total_onus_per_bbsim_olt} 1 true |
| ... false false false true |
| END |
| |
| Sanity E2E Test for OLT/ONU on POD for DT |
| [Documentation] Validates E2E Ping Connectivity and object states for the given scenario: |
| ... Validate successful DHCP/E2E ping (no EAPOL and DHCP flows) for the tech profile that is used |
| ... Traffic sent with same vlan from different RGs, |
| ... should reach the NNI port on the OLT with the expected double tagged vlan ids |
| ... Inner vlans from the RG should not change |
| [Tags] sanityDt soak |
| [Setup] Start Logging SanityTestDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging SanityTestDt |
| Setup ${SOAK_TEST} |
| Run Keyword If ${has_dataplane} Clean Up Linux |
| Perform Sanity Test DT |
| |
| Test Subscriber Delete and Add for DT |
| [Documentation] Validates E2E Ping Connectivity and object states for the given scenario: |
| ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed) |
| ... Delete a subscriber and validate that the pings do not succeed and state is purged |
| ... Disable and Enable the ONU (This is to replicate the existing DT behaviour) |
| ... Re-add the subscriber, and validate that the flows are present and pings are successful |
| [Tags] functionalDt SubAddDeleteDt soak |
| [Setup] Run Keywords Start Logging SubAddDeleteDt |
| ... AND Run Keyword If ${has_dataplane} Set Non-Critical Tag for XGSPON Tech |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging SubAddDeleteDt |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| ${olt_device_id}= Get OLTDeviceID From OLT List ${src['olt']} |
| ${num_of_olt_onus}= Get Num of Onus From OLT SN ${src['olt']} |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} |
| ... ${of_id} ${src['uni_id']} |
| # Remove Subscriber Access |
| Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} |
| ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port} |
| Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure |
| ... Wait Until Keyword Succeeds ${timeout} 2s |
| ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']} |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| |
| # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream) |
| ${onos_flows_count}= Evaluate 4 * ( ${num_of_olt_onus} - 1 ) |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} |
| ... ${of_id} ${onos_flows_count} |
| # Verify VOLTHA flows for OLT equals twice the number of ONUS (minus ONU under test) + 1 for LLDP |
| ${olt_flows}= Evaluate 2 * ( ${num_of_olt_onus} - 1 ) + 1 |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows |
| ... ${olt_flows} ${olt_device_id} |
| # Verify VOLTHA flows for ONU under test is Zero |
| Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate Device Flows |
| ... ${onu_device_id} 0 |
| # Disable and Re-Enable the ONU (To replicate DT current workflow) |
| # TODO: Delete and Auto-Discovery Add of ONU (not yet supported) |
| Disable Device ${onu_device_id} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device DISABLED UNKNOWN |
| ... REACHABLE ${src['onu']} |
| Enable Device ${onu_device_id} |
| Wait Until Keyword Succeeds 360s 5s |
| ... Validate Device ENABLED ACTIVE |
| ... REACHABLE ${src['onu']} |
| # Add Subscriber Access |
| Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} |
| ... ${ONOS_SSH_PORT} volt-add-subscriber-access ${of_id} ${onu_port} |
| # Verify subscriber access flows are added for the ONU port |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} |
| ... ${onu_port} ${nni_port} ${src['s_tag']} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device ENABLED ACTIVE |
| ... REACHABLE ${src['onu']} onu=True onu_reason=omci-flows-pushed |
| # Workaround for issue seen in VOL-4489. Keep this workaround until VOL-4489 is fixed. |
| Run Keyword If ${has_dataplane} Reboot XGSPON ONU ${src['olt']} ${src['onu']} omci-flows-pushed |
| # Workaround ends here for issue seen in VOL-4489. |
| Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure |
| ... Wait Until Keyword Succeeds ${timeout} 2s |
| ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']} |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| END |
| # Verify flows for all OLTs |
| Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate All OLT Flows |
| |
| Test Disable and Enable ONU for DT |
| [Documentation] Validates E2E Ping Connectivity and object states for the given scenario: |
| ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed) |
| ... Perform disable on the ONUs and validate that the pings do not succeed |
| ... Perform enable on the ONUs and validate that the pings are successful |
| [Tags] functionalDt DisableEnableONUDt soak |
| [Setup] Run Keywords Start Logging DisableEnableONUDt |
| ... AND Run Keyword If ${has_dataplane} Set Non-Critical Tag for XGSPON Tech |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging DisableEnableONUDt |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} |
| ... ${of_id} ${src['uni_id']} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| Disable Device ${onu_device_id} |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device DISABLED UNKNOWN |
| ... REACHABLE ${src['onu']} onu=True onu_reason=omci-admin-lock |
| Wait Until Keyword Succeeds ${timeout} 2s |
| ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']} |
| # TODO: Yet to Verify on the GPON based Physical POD (VOL-2652) |
| Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure |
| ... Wait Until Keyword Succeeds ${timeout} 2s |
| ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']} |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| Sleep 5s |
| Enable Device ${onu_device_id} |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds 360s 5s |
| ... Validate Device ENABLED ACTIVE |
| ... REACHABLE ${src['onu']} onu=True onu_reason=onu-reenabled |
| Wait Until Keyword Succeeds ${timeout} 2s |
| ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']} |
| # Workaround for issue seen in VOL-4489. Keep this workaround until VOL-4489 is fixed. |
| Run Keyword If ${has_dataplane} Reboot XGSPON ONU ${src['olt']} ${src['onu']} omci-flows-pushed |
| # Workaround ends here for issue seen in VOL-4489. |
| Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure |
| ... Wait Until Keyword Succeeds ${timeout} 2s |
| ... Check Ping True ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']} |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| END |
| |
| Test Disable and Delete OLT for DT |
| [Documentation] Validates E2E Ping Connectivity and object states for the given scenario: |
| ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed) |
| ... Perform disable on the OLT and validate ONUs state and that the pings do not succeed |
| ... Perform delete on the OLT, Re-do Setup (Recreate the OLT) and Perform Sanity Test DT |
| [Tags] functionalDt DisableDeleteOLTDt soak |
| [Setup] Start Logging DisableDeleteOLTDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging DisableDeleteOLTDt |
| # Disable and Validate OLT Device |
| FOR ${I} IN RANGE 0 ${olt_count} |
| ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn |
| ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number} |
| Disable Device ${olt_device_id} |
| ${of_id}= Get ofID From OLT List ${olt_serial_number} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate OLT Device DISABLED UNKNOWN REACHABLE |
| ... ${olt_serial_number} |
| ${num_onus}= Set Variable ${list_olts}[${I}][onucount] |
| # Validate ONUs |
| Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONUs After OLT Disable |
| ... ${num_onus} ${olt_serial_number} |
| # Verify ONOS Flows |
| # Number of Access Flows on ONOS equals 4 * the Number of Active ONUs (2 for each downstream and upstream) |
| ${onos_flows_count}= Evaluate 4 * ${num_onus} |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Subscriber Access Flows Added Count DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} |
| ... ${of_id} ${onos_flows_count} |
| # Verify VOLTHA Flows |
| # Number of per OLT Flows equals Twice the Number of Active ONUs (each for downstream and upstream) + 1 for LLDP |
| ${olt_flows}= Evaluate 2 * ${num_onus} + 1 |
| # Number of per ONU Flows equals 2 (one each for downstream and upstream) |
| ${onu_flows}= Set Variable 2 |
| Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Flows |
| ... ${olt_flows} ${olt_device_id} |
| ${List_ONU_Serial} Create List |
| Set Suite Variable ${List_ONU_Serial} |
| Build ONU SN List ${List_ONU_Serial} ${olt_serial_number} ${num_onus} |
| Log ${List_ONU_Serial} |
| Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate ONU Flows |
| ... ${List_ONU_Serial} ${onu_flows} |
| # Delete OLT and Validate Empty Device List |
| Delete Device ${olt_device_id} |
| # Check that the OLT and the ONUs are actually removed from the system |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device Removed |
| ... ${olt_serial_number} |
| Run Keyword and Continue On Failure Validate all ONUS for OLT Removed ${num_all_onus} ${hosts} |
| ... ${olt_serial_number} ${timeout} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Device Flows Removed ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} |
| END |
| # Re-do Setup (Recreate the OLT) and Perform Sanity Test DT |
| Run Keyword Setup ${SOAK_TEST} |
| Run Keyword If ${has_dataplane} Clean Up Linux |
| Perform Sanity Test DT |
| |
| Test Disable and Enable OLT for DT |
| [Documentation] Validates E2E Ping Connectivity and object states for the given scenario: |
| ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed) |
| ... Perform disable on the OLT and validate that the pings do not succeed |
| ... Perform enable on the OLT and validate that the pings are successful |
| [Tags] functionalDt DisableEnableOLTDt soak |
| [Setup] Start Logging DisableEnableOLTDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging DisableEnableOLTDt |
| # Disable and Validate OLT Device |
| FOR ${I} IN RANGE 0 ${olt_count} |
| ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn |
| ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number} |
| ${rc} ${output}= Run and Return Rc and Output |
| ... voltctl -c ${VOLTCTL_CONFIG} device disable ${olt_device_id} |
| Should Be Equal As Integers ${rc} 0 |
| Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Device DISABLED UNKNOWN REACHABLE |
| ... ${olt_serial_number} |
| END |
| # Validate ONUs |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s |
| ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| Wait Until Keyword Succeeds ${timeout} 2s |
| ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']} |
| Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure |
| ... Wait Until Keyword Succeeds ${timeout} 2s |
| ... Check Ping False ${dst['dp_iface_ip_qinq']} ${src['dp_iface_name']} |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| # Remove Subscriber Access (To replicate DT workflow) |
| Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} |
| ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port} |
| # Delete ONU Device (To replicate DT workflow) |
| Delete Device ${onu_device_id} |
| END |
| Sleep 5s |
| # Enable the OLT back and check ONU, OLT status are back to "ACTIVE" |
| FOR ${I} IN RANGE 0 ${olt_count} |
| ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn |
| ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number} |
| Enable Device ${olt_device_id} |
| Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Device ENABLED ACTIVE REACHABLE |
| ... ${olt_serial_number} |
| #TODO: Update for PON_OLT ETHERNET_NNI |
| #Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Port Types |
| #... PON_OLT ETHERNET_NNI |
| END |
| # Waiting extra time for the ONUs to come up |
| Sleep 60s |
| Run Keyword If ${has_dataplane} Clean Up Linux |
| Perform Sanity Test DT |
| |
| Test Delete and ReAdd OLT for DT |
| [Documentation] Validates E2E Ping Connectivity and object states for the given scenario: |
| ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed) |
| ... Disable and Delete the OLT |
| ... Create/Enable the same OLT again |
| ... Validate DHCP/E2E pings succeed for all the ONUs connected to the OLT |
| [Tags] functionalDt DeleteReAddOLTDt soak |
| [Setup] Start Logging DeleteReAddOLTDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging DeleteReAddOLTDt |
| FOR ${I} IN RANGE 0 ${olt_count} |
| ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn |
| ${of_id}= Get ofID From OLT List ${olt_serial_number} |
| Delete Device and Verify ${olt_serial_number} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Device Flows Removed ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} |
| END |
| # Recreate the OLTs |
| Setup ${SOAK_TEST} |
| Run Keyword If ${has_dataplane} Clean Up Linux |
| Perform Sanity Test DT |
| |
| Test Disable ONUs and OLT Then Delete ONUs and OLT for DT |
| [Documentation] On deployed POD, disable the ONU, disable the OLT and then delete ONU and OLT. |
| ... This TC is to confirm that ONU removal is not impacting OLT |
| ... Devices will be removed during the execution of this TC |
| ... so calling setup at the end to add the devices back to avoid the confusion. |
| [Tags] functionalDt DisableDeleteONUOLTDt |
| [Setup] Run Keywords Start Logging DisableDeleteONUOLTDt |
| ... AND Run Keyword If ${has_dataplane} Set Non-Critical Tag for XGSPON Tech |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging DisableDeleteONUOLTDt |
| @{onu_reason}= Create List initial-mib-downloaded omci-flows-pushed |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device ENABLED ACTIVE |
| ... REACHABLE ${src['onu']} onu=True onu_reason=${onu_reason} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate OLT Device ENABLED ACTIVE |
| ... REACHABLE ${src['olt']} |
| Disable Device ${onu_device_id} |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device DISABLED UNKNOWN |
| ... REACHABLE ${src['onu']} onu=false |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate OLT Device ENABLED ACTIVE |
| ... REACHABLE ${src['olt']} |
| END |
| # Disable all OLTs |
| FOR ${I} IN RANGE 0 ${olt_count} |
| ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn |
| ${olt_device_id}= Get OLTDeviceID From OLT List ${olt_serial_number} |
| ${rc} ${output}= Run and Return Rc and Output |
| ... voltctl -c ${VOLTCTL_CONFIG} device disable ${olt_device_id} |
| Should Be Equal As Integers ${rc} 0 |
| Wait Until Keyword Succeeds ${timeout} 5s Validate OLT Device DISABLED UNKNOWN REACHABLE |
| ... ${olt_serial_number} |
| END |
| # Validate ONUs after OLT disable |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device DISABLED DISCOVERED |
| ... UNREACHABLE ${src['onu']} onu=false |
| Delete Device ${onu_device_id} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate OLT Device DISABLED UNKNOWN |
| ... REACHABLE ${src['olt']} |
| END |
| # Delete all OLTs |
| Delete All Devices and Verify |
| |
| #Delete Device ${olt_device_id} |
| #TODO: Fix the following assertion |
| #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Test Empty Device List |
| #Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| #... Verify Device Flows Removed ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} |
| |
| # Re-do Setup (Recreate the OLT) and Perform Sanity Test DT |
| Run Keyword Setup |
| Run Keyword If ${has_dataplane} Clean Up Linux |
| Perform Sanity Test DT |
| |
| Data plane verification using TCP for DT |
| [Documentation] Test bandwidth profile is met and not exceeded for each subscriber. |
| ... Assumes iperf3 and jq installed on client and iperf -s running on DHCP server |
| [Tags] non-critical dataplaneDt BandwidthProfileTCPDt VOL-3061 soakDataplane |
| [Setup] Start Logging BandwidthProfileTCPDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging BandwidthProfileTCPDt |
| Pass Execution If '${has_dataplane}'=='False' Bandwidth profile validation can be done only in |
| ... physical pod. Skipping this test in BBSIM. |
| Run Keyword If '${SOAK_TEST}'=='False' Clear All Devices Then Create New Device |
| ... ELSE Setup Soak |
| Run Keyword If ${has_dataplane} Clean Up Linux |
| Perform Sanity Test DT |
| |
| #${of_id}= Wait Until Keyword Succeeds ${timeout} 15s Validate OLT Device in ONOS |
| #... ${olt_serial_number} |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| # Check for iperf3 and jq tools |
| ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf3 jq |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| Pass Execution If ${rc} != 0 Skipping test: iperf3 / jq not found on the RG |
| |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} |
| ... ${of_id} ${src['uni_id']} |
| ${subscriber_id}= Set Variable ${of_id}/${onu_port} |
| ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} |
| ... upstreamBandwidthProfile |
| ${us_cir} ${us_cbs} ${us_pir} ${us_pbs} ${us_gir}= Get Bandwidth Profile Details Ietf Rest |
| ... ${bandwidth_profile_name} |
| ${limiting_bw_value_upstream}= Set Variable If ${us_pir} != 0 ${us_pir} ${us_gir} |
| ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} |
| ... downstreamBandwidthProfile |
| ${ds_cir} ${ds_cbs} ${ds_pir} ${ds_pbs} ${ds_gir}= Get Bandwidth Profile Details Ietf Rest |
| ... ${bandwidth_profile_name} |
| ${limiting_bw_value_dnstream}= Set Variable If ${ds_pir} != 0 ${ds_pir} ${ds_gir} |
| |
| # Stream TCP packets from RG to server |
| ${updict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']} |
| ... args=-t 30 |
| ${actual_upstream_bw_used}= Evaluate ${updict['end']['sum_received']['bits_per_second']}/1000 |
| |
| # Stream TCP packets from server to RG |
| ${dndict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']} |
| ... args=-R -t 30 |
| ${actual_dnstream_bw_used}= Evaluate ${dndict['end']['sum_received']['bits_per_second']}/1000 |
| |
| ${pct_limit_up}= Evaluate 100*${actual_upstream_bw_used}/${limiting_bw_value_upstream} |
| ${pct_limit_dn}= Evaluate 100*${actual_dnstream_bw_used}/${limiting_bw_value_dnstream} |
| Log Up: bwprof ${limiting_bw_value_upstream}Kbps, got ${actual_upstream_bw_used}Kbps (${pct_limit_up}%) |
| Log Down: bwprof ${limiting_bw_value_dnstream}Kbps, got ${actual_dnstream_bw_used}Kbps (${pct_limit_dn}%) |
| |
| Should Be True ${pct_limit_up} <= ${upper_margin_pct} |
| ... The upstream bandwidth exceeded the limit (${pct_limit_up}% of limit) |
| # VOL-3125: downstream bw limit not enforced. Uncomment when fixed. |
| #Should Be True ${pct_limit_dn} <= ${upper_margin_pct} |
| #... The downstream bandwidth exceeded the limit (${pct_limit_dn}% of limit) |
| Should Be True ${pct_limit_up} >= ${lower_margin_pct} |
| ... The upstream bandwidth guarantee was not met (${pct_limit_up}% of resv) |
| Should Be True ${pct_limit_dn} >= ${lower_margin_pct} |
| ... The downstream bandwidth guarantee was not met (${pct_limit_dn}% of resv) |
| END |
| |
| Data plane verification using UDP for DT |
| [Documentation] Test bandwidth profile is met and not exceeded for each subscriber. |
| ... Assumes iperf3 and jq installed on client and iperf -s running on DHCP server |
| [Tags] non-critical dataplaneDt BandwidthProfileUDPDt VOL-3061 soakDataplane |
| [Setup] Start Logging BandwidthProfileUDPDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging BandwidthProfileUDPDt |
| Pass Execution If '${has_dataplane}'=='False' Bandwidth profile validation can be done only in |
| ... physical pod. Skipping this test in BBSIM. |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| |
| # Check for iperf3 and jq tools |
| ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf3 jq |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| Pass Execution If ${rc} != 0 Skipping test: iperf3 / jq not found on the RG |
| |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} |
| ... ${of_id} ${src['uni_id']} |
| ${subscriber_id}= Set Variable ${of_id}/${onu_port} |
| ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} |
| ... upstreamBandwidthProfile |
| ${us_cir} ${us_cbs} ${us_pir} ${us_pbs} ${us_gir}= Get Bandwidth Profile Details Ietf Rest |
| ... ${bandwidth_profile_name} |
| ${limiting_bw_value_upstream}= Set Variable If ${us_pir} != 0 ${us_pir} ${us_gir} |
| ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} |
| ... downstreamBandwidthProfile |
| ${ds_cir} ${ds_cbs} ${ds_pir} ${ds_pbs} ${ds_gir}= Get Bandwidth Profile Details Ietf Rest |
| ... ${bandwidth_profile_name} |
| ${limiting_bw_value_dnstream}= Set Variable If ${ds_pir} != 0 ${ds_pir} ${ds_gir} |
| |
| # Stream UDP packets from RG to server |
| ${uprate}= Run Keyword If ${limiting_bw_value_upstream} != 1000000 |
| ... Evaluate ${limiting_bw_value_upstream}*${udp_rate_multiplier} |
| ... ELSE |
| ... Set Variable ${limiting_bw_value_upstream} |
| |
| ${updict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']} |
| ... args=-u -b ${uprate}K -t 30 -l ${udp_packet_bytes} --pacing-timer 0 |
| # With UDP test, bits per second is the sending rate. Multiply by the loss rate to get the throughput. |
| ${actual_upstream_bw_used}= Evaluate |
| ... (100 - ${updict['end']['sum']['lost_percent']})*${updict['end']['sum']['bits_per_second']}/100000 |
| |
| # Stream UDP packets from server to RG |
| ${dnrate}= Run Keyword If ${limiting_bw_value_dnstream} != 1000000 |
| ... Evaluate ${limiting_bw_value_dnstream}*${udp_rate_multiplier} |
| ... ELSE |
| ... Set Variable ${limiting_bw_value_dnstream} |
| ${dndict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']} |
| ... args=-u -b ${dnrate}K -R -t 30 -l ${udp_packet_bytes} --pacing-timer 0 |
| # With UDP test, bits per second is the sending rate. Multiply by the loss rate to get the throughput. |
| ${actual_dnstream_bw_used}= Evaluate |
| ... (100 - ${dndict['end']['sum']['lost_percent']})*${dndict['end']['sum']['bits_per_second']}/100000 |
| |
| ${pct_limit_up}= Evaluate 100*${actual_upstream_bw_used}/${limiting_bw_value_upstream} |
| ${pct_limit_dn}= Evaluate 100*${actual_dnstream_bw_used}/${limiting_bw_value_dnstream} |
| Log Up: bwprof ${limiting_bw_value_upstream}Kbps, got ${actual_upstream_bw_used}Kbps (${pct_limit_up}%) |
| Log Down: bwprof ${limiting_bw_value_dnstream}Kbps, got ${actual_dnstream_bw_used}Kbps (${pct_limit_dn}%) |
| |
| Should Be True ${pct_limit_up} <= ${upper_margin_pct} |
| ... The upstream bandwidth exceeded the limit (${pct_limit_up}% of limit) |
| # VOL-3125: downstream bw limit not enforced. Uncomment when fixed. |
| #Should Be True ${pct_limit_dn} <= ${upper_margin_pct} |
| #... The downstream bandwidth exceeded the limit (${pct_limit_dn}% of limit) |
| Should Be True ${pct_limit_up} >= ${lower_margin_pct} |
| ... The upstream bandwidth guarantee was not met (${pct_limit_up}% of resv) |
| Should Be True ${pct_limit_dn} >= ${lower_margin_pct} |
| ... The downstream bandwidth guarantee was not met (${pct_limit_dn}% of resv) |
| END |
| |
| Reconcile with data plane verification using TCP for DT |
| [Documentation] Test bandwidth profile is met and not exceeded for each subscriber while reconciling openonu-adapter. |
| ... Assumes iperf3 and jq installed on client and iperf -s running on DHCP server |
| ... VOL-4829 |
| [Tags] non-critical dataplaneDt ReconcileBandwidthProfileTCPPDt VOL-4829 soakDataplane |
| [Setup] Start Logging ReconcileBandwidthProfileTCPPDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging ReconcileBandwidthProfileTCPPDt |
| ${podStatusOutput}= Run kubectl get pods -n ${NAMESPACE} |
| Log ${podStatusOutput} |
| ${countBeforeRestart}= Run kubectl get pods -n ${NAMESPACE} | grep Running | wc -l |
| ${cmdname}= Set Variable kubectl -n ${NAMESPACE} get pods -l app=adapter-open-onu -o name |
| ${cmddelete}= Set Variable sleep 10; kubectl -n ${NAMESPACE} delete pods -l app=adapter-open-onu |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| # Check for iperf3 and jq tools |
| ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf3 jq |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| Run Keyword If ${rc} != 0 Log iperf3 / jq not found on the RG |
| Continue For Loop If ${rc} != 0 |
| |
| # Read bandwidth profile per subscriber |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} |
| ... ${of_id} ${src['uni_id']} |
| ${subscriber_id}= Set Variable ${of_id}/${onu_port} |
| ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} |
| ... upstreamBandwidthProfile |
| ${us_cir} ${us_cbs} ${us_pir} ${us_pbs} ${us_gir}= Get Bandwidth Profile Details Ietf Rest |
| ... ${bandwidth_profile_name} |
| ${limiting_bw_value_upstream}= Set Variable If ${us_pir} != 0 ${us_pir} ${us_gir} |
| ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} |
| ... downstreamBandwidthProfile |
| ${ds_cir} ${ds_cbs} ${ds_pir} ${ds_pbs} ${ds_gir}= Get Bandwidth Profile Details Ietf Rest |
| ... ${bandwidth_profile_name} |
| ${limiting_bw_value_dnstream}= Set Variable If ${ds_pir} != 0 ${ds_pir} ${ds_gir} |
| |
| ${rc} ${namebefore}= Run and Return Rc and Output ${cmdname} |
| ${deleteOpenOnuAdapterHdl}= Start Process ${cmddelete} shell=true |
| Set Suite Variable ${deleteOpenOnuAdapterHdl} |
| |
| # Stream TCP packets bidirectional |
| ${bidirdict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']} args=--bidir -t 30 |
| # read and log up and down stream datarate just for info |
| ${actual_dnstream_bw_used}= Evaluate ${bidirdict['end']['sum_received']['bits_per_second']}/1000 |
| ${actual_upstream_bw_used}= Evaluate ${bidirdict['end']['sum_sent']['bits_per_second']}/1000 |
| ${pct_limit_up}= Evaluate 100*${actual_upstream_bw_used}/${limiting_bw_value_upstream} |
| ${pct_limit_dn}= Evaluate 100*${actual_dnstream_bw_used}/${limiting_bw_value_dnstream} |
| Log Up: bwprof ${limiting_bw_value_upstream}Kbps, got ${actual_upstream_bw_used}Kbps (${pct_limit_up}%) |
| Log Down: bwprof ${limiting_bw_value_dnstream}Kbps, got ${actual_dnstream_bw_used}Kbps (${pct_limit_dn}%) |
| # validate datarate per interval |
| ${result_interval}= Validate Performance Intervals ${bidirdict} |
| Should Be True ${result_interval} At least one transmission interval data rate was too less. |
| # end reconcile process and validate reconcilation by checking pod name |
| ${result}= Terminate Process ${deleteOpenOnuAdapterHdl} |
| LOG ${result} |
| ${rc} ${nameafter}= Run and Return Rc and Output ${cmdname} |
| Should Not Be Equal As Strings ${namebefore} ${nameafter} openonu adpater did not reconciled! |
| ${podStatusOutput}= Run kubectl get pods -n ${NAMESPACE} |
| Log ${podStatusOutput} |
| ${countAfterRestart}= Run kubectl get pods -n ${NAMESPACE} | grep Running | wc -l |
| Should Be Equal As Strings ${countAfterRestart} ${countBeforeRestart} |
| # Disable and enable ONU to verify accessibility via openonu-adapter |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} |
| ... ${of_id} ${src['uni_id']} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| Disable Device ${onu_device_id} |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device DISABLED UNKNOWN |
| ... REACHABLE ${src['onu']} onu=True onu_reason=omci-admin-lock |
| Wait Until Keyword Succeeds ${timeout} 2s |
| ... Verify UNI Port Is Disabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']} |
| Sleep 5s |
| Enable Device ${onu_device_id} |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds 360s 5s |
| ... Validate Device ENABLED ACTIVE |
| ... REACHABLE ${src['onu']} onu=True onu_reason=onu-reenabled |
| Wait Until Keyword Succeeds ${timeout} 2s |
| ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']} |
| # Workaround for issue seen in VOL-4489. Keep this workaround until VOL-4489 is fixed. |
| Run Keyword If ${has_dataplane} Reboot XGSPON ONU ${src['olt']} ${src['onu']} omci-flows-pushed |
| # Workaround ends here for issue seen in VOL-4489. |
| END |
| Run Keyword If '${SOAK_TEST}'=='False' Delete All Devices and Verify |
| |
| Validate parsing of data traffic through voltha using tech profile |
| [Documentation] Assuming that test1 was executed where all the ONUs are authenticated/DHCP/pingable |
| ... Prerequisite tools : Tcpdump and Mausezahn traffic generator on both RG and DHCP/BNG VMs |
| ... Install jq tool to read json file, where test suite is being running |
| ... This test sends TCP packets with pbits between 0 and 7 and validates that |
| ... the pbits are preserved by the PON. |
| [Tags] dataplaneDt TechProfileDt VOL-3291 soakDataplane |
| [Setup] Start Logging TechProfileDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging TechProfileDt |
| Pass Execution If '${has_dataplane}'=='False' |
| ... Skipping test: Technology profile validation can be done only in physical pod |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| |
| ${src_iface_name}= Fetch From Left ${src['dp_iface_name']} . |
| |
| ${bng_ip}= Get Variable Value ${dst['noroot_ip']} |
| ${bng_user}= Get Variable Value ${dst['noroot_user']} |
| ${bng_pass}= Get Variable Value ${dst['noroot_pass']} |
| Pass Execution If "${bng_ip}" == "${NONE}" or "${bng_user}" == "${NONE}" or "${bng_pass}" == "${NONE}" |
| ... Skipping test: credentials for BNG login required in deployment config |
| |
| ${stdout} ${stderr} ${rc}= Execute Remote Command which mausezahn tcpdump |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| Pass Execution If ${rc} != 0 Skipping test: mausezahn / tcpdump not found on the RG |
| ${stdout} ${stderr} ${rc}= Execute Remote Command which mausezahn tcpdump |
| ... ${bng_ip} ${bng_user} ${bng_pass} ${dst['container_type']} ${dst['container_name']} |
| Pass Execution If ${rc} != 0 Skipping test: mausezahn / tcpdump not found on the BNG |
| Log Upstream test |
| Run Keyword If ${has_dataplane} Create traffic with each pbit and capture at other end |
| ... ${dst['dp_iface_ip_qinq']} ${dst['dp_iface_name']} ${src_iface_name} |
| ... 0 tcp ${src['c_tag']} ${src['s_tag']} upstream vlan |
| ... ${bng_ip} ${bng_user} ${bng_pass} ${dst['container_type']} ${dst['container_name']} |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| Log Downstream test |
| ${rg_ip} ${stderr} ${rc}= Execute Remote Command |
| ... ifconfig ${src['dp_iface_name']} | grep 'inet addr:' | cut -d: -f2 | awk '{ print $1 }' |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| Should Be Equal As Integers ${rc} 0 Could not get RG's IP address |
| Run Keyword If ${has_dataplane} Create traffic with each pbit and capture at other end |
| ... ${rg_ip} ${src_iface_name} ${dst['dp_iface_name']} |
| ... 0 tcp ${src['c_tag']} ${src['s_tag']} downstream tcp |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| ... ${bng_ip} ${bng_user} ${bng_pass} ${dst['container_type']} ${dst['container_name']} |
| END |
| |
| Test Disable and Enable OLT PON Port for DT |
| [Documentation] Validates E2E Ping Connectivity and object states for the given scenario: |
| ... Assuming that all the ONUs are DHCP/pingable (i.e. assuming sanityDt test was executed) |
| ... Perform disable on the OLT PON Port and validate that the pings do not succeed |
| ... Perform enable on the OLT PON Port and validate that the pings are successful |
| [Tags] functionalDt DisableEnableOltPonPortDt VOL-2577 soak |
| [Setup] Run Keywords Start Logging DisableEnableOltPonPortDt |
| ... AND Run Keyword If ${has_dataplane} Set Non-Critical Tag for XGSPON Tech |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging DisableEnableOltPonPortDt |
| FOR ${I} IN RANGE 0 ${olt_count} |
| ${olt_serial_number}= Get From Dictionary ${olt_ids}[${I}] sn |
| Disable Enable PON Port Per OLT DT ${olt_serial_number} |
| END |
| |
| Data plane Bandwidth profile update verification for DT |
| [Documentation] Test bandwidth profile is updated for one subscriber and not changed for other subscribers. |
| ... Assumes iperf3 and jq installed on client and iperf -s running on DHCP server |
| ... Assumes Default and User_Bandwidth2 profiles are configured as bandwidth profiles |
| [Tags] non-critical dataplaneDt BandwidthProfileUpdateTCPDt VOL-2549 |
| [Setup] Start Logging BandwidthProfileUpdateTCPDt |
| [Teardown] Run Keywords Collect Logs |
| ... AND Stop Logging BandwidthProfileUpdateTCPDt |
| ... AND Send File To Onos ${CURDIR}/../../tests/data/${POD_NAME}-sadis-DT.json |
| Pass Execution If '${has_dataplane}'=='False' |
| ... Bandwidth profile validation can be done only in physical pod. Skipping this test in BBSIM. |
| Delete All Devices And Verify |
| Run Keyword If ${has_dataplane} Clean Up Linux |
| Setup |
| Perform Sanity Test DT |
| # Update the Bandwidth Profile for the First Subscriber under test |
| ${src}= Set Variable ${hosts.src[${0}]} |
| ${dst}= Set Variable ${hosts.dst[${0}]} |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id} |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} |
| ... ${of_id} ${src['uni_id']} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| ${subscriber_id}= Set Variable ${of_id}/${onu_port} |
| ${oldBwName} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} upstreamBandwidthProfile |
| # Delete the existing subscriber |
| Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} |
| ... ${ONOS_SSH_PORT} volt-remove-subscriber-access ${of_id} ${onu_port} |
| # Verify VOLTHA flows for ONU under test is Zero |
| Run Keyword Wait Until Keyword Succeeds ${timeout} 5s Validate Device Flows |
| ... ${onu_device_id} 0 |
| # Disable and Re-Enable the ONU (To replicate DT current workflow) |
| # TODO: Delete and Auto-Discovery Add of ONU (not yet supported) |
| Disable Device ${onu_device_id} |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device DISABLED UNKNOWN |
| ... REACHABLE ${src['onu']} |
| Enable Device ${onu_device_id} |
| Wait Until Keyword Succeeds 360s 5s |
| ... Validate Device ENABLED ACTIVE |
| ... REACHABLE ${src['onu']} |
| # Change the bandwidth profile and load the configuration |
| ${newBwName} Set Variable If ${oldBwName} == 'Default' 'User_Bandwidth2' 'Default' |
| ${cmd} Catenate |
| ... sed 's/upstreamBandwidthProfile": "${oldBwName}"/upstreamBandwidthProfile": "${newBwName}"/g' |
| ... ${CURDIR}/../../tests/data/${POD_NAME}-sadis-DT.json > ${CURDIR}/../../tests/data/${POD_NAME}-sadis-new.json |
| ${rc} Run and Return RC ${cmd} |
| Send File To Onos ${CURDIR}/../../tests/data/${POD_NAME}-sadis-new.json |
| # Re-add the subscriber with new bandwidth profile |
| Wait Until Keyword Succeeds ${timeout} 2s Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} |
| ... ${ONOS_SSH_PORT} volt-add-subscriber-access ${of_id} ${onu_port} |
| # Verify subscriber access flows are added for the ONU port |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} |
| ... ${onu_port} ${nni_port} ${src['s_tag']} |
| # Verify ONU state in voltha |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s Validate Device |
| ... ENABLED ACTIVE REACHABLE |
| ... ${src['onu']} onu=True onu_reason=omci-flows-pushed |
| # Verify Meters in ONOS |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Meters in ONOS Ietf ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port} |
| # Workaround for issue seen in VOL-4489. Keep this workaround until VOL-4489 is fixed. |
| Run Keyword If ${has_dataplane} Reboot XGSPON ONU ${src['olt']} ${src['onu']} omci-flows-pushed |
| # Workaround ends here for issue seen in VOL-4489. |
| Run Keyword If ${has_dataplane} Run Keyword And Continue On Failure Validate DHCP and Ping True |
| ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']} |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} |
| ... ${dst['container_name']} |
| # Verify new bandwidth profile is applied and other subscribers are working fine |
| ${checkBwName} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} upstreamBandwidthProfile |
| Should Be Equal ${checkBwName} ${newBwName} The bandwidth profile is not updated properly |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| # Check for iperf3 and jq tools |
| ${stdout} ${stderr} ${rc}= Execute Remote Command which iperf3 jq |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| Pass Execution If ${rc} != 0 Skipping test: iperf3 / jq not found on the RG |
| |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s Get ONU Port in ONOS ${src['onu']} |
| ... ${of_id} ${src['uni_id']} |
| ${subscriber_id}= Set Variable ${of_id}/${onu_port} |
| ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} |
| ... upstreamBandwidthProfile |
| ${us_cir} ${us_cbs} ${us_pir} ${us_pbs} ${us_gir}= Get Bandwidth Profile Details Ietf Rest |
| ... ${bandwidth_profile_name} |
| ${limiting_bw_value_upstream}= Set Variable If ${us_pir} != 0 ${us_pir} ${us_gir} |
| ${bandwidth_profile_name} Get Bandwidth Profile Name For Given Subscriber ${subscriber_id} |
| ... downstreamBandwidthProfile |
| ${ds_cir} ${ds_cbs} ${ds_pir} ${ds_pbs} ${ds_gir}= Get Bandwidth Profile Details Ietf Rest |
| ... ${bandwidth_profile_name} |
| ${limiting_bw_value_dnstream}= Set Variable If ${ds_pir} != 0 ${ds_pir} ${ds_gir} |
| |
| # Stream TCP packets from RG to server |
| ${updict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']} |
| ... args=-t 30 |
| ${actual_upstream_bw_used}= Evaluate ${updict['end']['sum_received']['bits_per_second']}/1000 |
| |
| # Stream TCP packets from server to RG |
| ${dndict}= Run Iperf3 Test Client ${src} server=${dst['dp_iface_ip_qinq']} |
| ... args=-R -t 30 |
| ${actual_dnstream_bw_used}= Evaluate ${dndict['end']['sum_received']['bits_per_second']}/1000 |
| |
| ${pct_limit_up}= Evaluate 100*${actual_upstream_bw_used}/${limiting_bw_value_upstream} |
| ${pct_limit_dn}= Evaluate 100*${actual_dnstream_bw_used}/${limiting_bw_value_dnstream} |
| Log Up: bwprof ${limiting_bw_value_upstream}Kbps, got ${actual_upstream_bw_used}Kbps (${pct_limit_up}%) |
| Log Down: bwprof ${limiting_bw_value_dnstream}Kbps, got ${actual_dnstream_bw_used}Kbps (${pct_limit_dn}%) |
| |
| Should Be True ${pct_limit_up} <= ${upper_margin_pct} |
| ... The upstream bandwidth exceeded the limit (${pct_limit_up}% of limit) |
| # VOL-3125: downstream bw limit not enforced. Uncomment when fixed. |
| #Should Be True ${pct_limit_dn} <= ${upper_margin_pct} |
| #... The downstream bandwidth exceeded the limit (${pct_limit_dn}% of limit) |
| Should Be True ${pct_limit_up} >= ${lower_margin_pct} |
| ... The upstream bandwidth guarantee was not met (${pct_limit_up}% of resv) |
| Should Be True ${pct_limit_dn} >= ${lower_margin_pct} |
| ... The downstream bandwidth guarantee was not met (${pct_limit_dn}% of resv) |
| END |
| |
| |
| Test ONU Delete and Auto-Discovery for DT |
| [Documentation] Tests the voltctl delete and Auto-Discovery of the ONU |
| [Tags] functionalDt VOL-3098 ONUAutoDiscoveryDt |
| [Setup] Start Logging ONUAutoDiscoveryDt |
| [Teardown] Run Keywords Run Keyword If ${logging} Collect Logs |
| ... AND Stop Logging ONUAutoDiscoveryDt |
| Clear All Devices Then Create New Device |
| # Performing Sanity Test to make sure subscribers are all AUTH+DHCP and pingable |
| Run Keyword If ${has_dataplane} Clean Up Linux |
| Perform Sanity Test DT |
| FOR ${I} IN RANGE 0 ${num_all_onus} |
| ${src}= Set Variable ${hosts.src[${I}]} |
| ${dst}= Set Variable ${hosts.dst[${I}]} |
| ${of_id}= Get ofID From OLT List ${src['olt']} |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s |
| ... Get ONU Port in ONOS ${src['onu']} ${of_id} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| ${nni_port}= Wait Until Keyword Succeeds ${timeout} 2s Get NNI Port in ONOS ${of_id} |
| # Remove Subscriber |
| Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT} |
| ... volt-remove-subscriber-access ${of_id} ${onu_port} |
| # Additional sleep to let subscriber delete process |
| Sleep 10s |
| # Delete ONU and Verify Ping Fails |
| Delete Device ${onu_device_id} |
| Run Keyword If ${has_dataplane} Verify ping is successful except for given device |
| ... ${num_all_onus} ${src['onu']} |
| # Verify that no pending flows exist for the ONU port |
| Wait Until Keyword Succeeds ${timeout} 2s |
| ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port} |
| # ONU Auto-Discovery |
| ${onu_port}= Wait Until Keyword Succeeds ${timeout} 2s |
| ... Get ONU Port in ONOS ${src['onu']} ${of_id} ${src['uni_id']} |
| # Check ONU port is Enabled in ONOS |
| Wait Until Keyword Succeeds ${timeout} 2s |
| ... Verify UNI Port Is Enabled ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${src['onu']} ${src['uni_id']} |
| ${onu_device_id}= Get Device ID From SN ${src['onu']} |
| Run Keyword If ${has_dataplane} Clean Up Linux ${onu_device_id} |
| # Re-Add Subscriber |
| Execute ONOS CLI Command use single connection ${ONOS_SSH_IP} ${ONOS_SSH_PORT} |
| ... volt-add-subscriber-access ${of_id} ${onu_port} |
| # Verify ONU state in voltha |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Validate Device ENABLED ACTIVE REACHABLE |
| ... ${src['onu']} onu=True onu_reason=omci-flows-pushed |
| # Verify that no pending flows exist for the ONU port |
| Wait Until Keyword Succeeds ${timeout} 2s |
| ... Verify No Pending Flows For ONU ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${onu_port} |
| # Verify subscriber access flows are added for the ONU port |
| Run Keyword And Continue On Failure Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Subscriber Access Flows Added For ONU DT ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} |
| ... ${onu_port} ${nni_port} ${src['s_tag']} |
| # Verify Meters in ONOS |
| Wait Until Keyword Succeeds ${timeout} 5s |
| ... Verify Meters in ONOS Ietf ${ONOS_SSH_IP} ${ONOS_SSH_PORT} ${of_id} ${onu_port} |
| Run Keyword If ${has_dataplane} Validate DHCP and Ping True |
| ... True ${src['dp_iface_name']} ${src['s_tag']} ${src['c_tag']} ${dst['dp_iface_ip_qinq']} |
| ... ${src['ip']} ${src['user']} ${src['pass']} ${src['container_type']} ${src['container_name']} |
| ... ${dst['dp_iface_name']} ${dst['ip']} ${dst['user']} ${dst['pass']} ${dst['container_type']} |
| ... ${dst['container_name']} |
| END |
| # Verify flows for all OLTs |
| Wait Until Keyword Succeeds ${timeout} 5s Validate All OLT Flows |
| |
| |
| *** Keywords *** |
| Setup Suite |
| [Documentation] Set up the test suite |
| Common Test Suite Setup |
| #Restore all ONUs |
| #Run Keyword If ${has_dataplane} RestoreONUs ${num_all_onus} |
| #power_switch.robot needs it to support different vendor's power switch |
| ${switch_type}= Get Variable Value ${web_power_switch.type} |
| Run Keyword If "${switch_type}"!="" Set Global Variable ${powerswitch_type} ${switch_type} |
| |
| Clear All Devices Then Create New Device |
| [Documentation] Remove any devices from VOLTHA and ONOS |
| # Remove all devices from voltha and nos |
| Delete All Devices and Verify |
| # Execute normal test Setup Keyword |
| Setup |
| |
| Validate Performance Intervals |
| [Documentation] Validates all intervals (one per second) of iPerf3 result |
| [Arguments] ${bidirdict} |
| ${actual_intervals}= Get From Dictionary ${bidirdict} intervals |
| ${number_intervals}= Get Length ${actual_intervals} |
| ${result_interval}= Set Variable True |
| FOR ${INDEX} IN RANGE 0 ${number_intervals} |
| ${interval}= Get From List ${actual_intervals} ${INDEX} |
| ${streams}= Get From Dictionary ${interval} streams |
| ${interval_upstream}= Get From List ${streams} 0 |
| ${interval_dnstream}= Get From List ${streams} 1 |
| ${interval_upstream_bw_used}= Evaluate ${interval_upstream['bits_per_second']}/1000 |
| ${interval_dnstream_bw_used}= Evaluate ${interval_dnstream['bits_per_second']}/1000 |
| Run Keyword If ${interval_upstream_bw_used} < 5000 |
| ... LOG The upstream bandwidth in interval ${INDEX} was too less (${interval_upstream_bw_used} of resv) |
| Run Keyword If ${interval_dnstream_bw_used} < 5000 |
| ... LOG: The upstream bandwidth in interval ${INDEX} was too less (${interval_upstream_bw_used} of resv) |
| ${result_interval}= Set Variable If (${interval_upstream_bw_used} < 5000 or ${interval_upstream_bw_used} < 5000) |
| ... False ${result_interval} |
| END |
| [Return] ${result_interval} |