SEBA-779 updating cord-tester docs
Change-Id: I20eb30d308024fbd0c58549c5698a1a5f3ba8e3a
diff --git a/Jenkinsfile-mcord-license-check b/Jenkinsfile-mcord-license-check
new file mode 100644
index 0000000..3dcfff1
--- /dev/null
+++ b/Jenkinsfile-mcord-license-check
@@ -0,0 +1,49 @@
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+repos = params.repos.split(",")
+
+node ("${TestNodeName}") {
+ timeout (100) {
+ try {
+ stage ("Cleanup") {
+ sh returnStdout: true, script: "rm -rf *"
+ }
+ stage ("Add private keys") {
+ withCredentials([sshUserPrivateKey(credentialsId: '315e1f56-7193-464e-8af1-97bf7b1ee541', keyFileVariable: 'KEY')]) {
+ sh returnStdout: true, script: """
+ chmod 600 $KEY && eval `ssh-agent -s` && ssh-add $KEY &&
+ ssh-keyscan github.com >> ~/.ssh/known_hosts
+ """
+ }
+ }
+ for(int i=0; i < repos.size(); i++) {
+ stage ("Check repos ${repos[i]}") {
+ checkRepo(repos[i])
+ }
+ }
+ currentBuild.result = 'SUCCESS'
+ } catch (err) {
+ currentBuild.result = 'FAILURE'
+ step([$class: 'Mailer', notifyEveryUnstableBuild: true, recipients: "${notificationEmail}", sendToIndividuals: false])
+ }
+ echo "RESULT: ${currentBuild.result}"
+ }
+}
+
+def checkRepo(repo) {
+ sh returnStdout: true, script: """
+ git clone -b ${branch} git@github.com:omec-project/${repo}.git
+ """
+ hub_detect("--detect.source.path=${repo} --detect.project.name=${prefix}-${repo} --detect.project.version.name=${branch} --snippet-matching --full-snippet-scan")
+}
+
diff --git a/README.md b/README.md
index ec1125f..21e3f91 100644
--- a/README.md
+++ b/README.md
@@ -1,4 +1,4 @@
-# cord-tester
+# Cord-Tester
CORD Automated Tester Suite
The CORD Automated Tester Suite (CATS) is an extensible end-to-end system test suite
diff --git a/docs/README.md b/docs/README.md
index b80ad20..0c44da4 100644
--- a/docs/README.md
+++ b/docs/README.md
@@ -14,13 +14,10 @@
and Test Results.
* [System Test Guide](https://wiki.opencord.org/display/CORD/System+Test+Guide)
-* [System Test Plans](https://wiki.opencord.org/display/CORD/SEBA+1.0+Release)
-* [System Test
- Results](https://wiki.opencord.org/display/CORD/CORD+6.1)
+* [System Test Plans](https://wiki.opencord.org/display/CORD/SEBA+2.0+Release)
+* [System Test Results](https://wiki.opencord.org/pages/viewpage.action?pageId=24150020)
Additional information about the CORD Tester framework can be found on the
GitHub:
-* [Prerequisites](https://github.com/opencord/cord-tester/blob/master/src/test/setup/prerequisites.sh)
-
* [Source Code](https://github.com/opencord/cord-tester)
diff --git a/docs/cord-tester-for-ciab-setup.md b/docs/cord-tester-for-ciab-setup.md
deleted file mode 100644
index 63dfb5b..0000000
--- a/docs/cord-tester-for-ciab-setup.md
+++ /dev/null
@@ -1,102 +0,0 @@
-# Testing CiaB (CORD-IN-A-BOX) Using CORD TESTER
-
-The CORD Automated Tester Suite is an extensible end-to-end system test suite
-now targeting CORD in a BOX also.
-
-## Prerequisites
-
-* Python 2.7 or later
-* Docker
-
-## How to install
-
-```shell
-git clone https://github.com/opencord/cord-tester.git
-cd cord-tester
-cd src/test/setup/
-```
-
-Run `prerequisites.sh --cord` (It gets you needed dependencies and tools to start)
-
-* Build all required test container images
-
-```shell
-sudo ./cord-test.py build all
-```
-
-* If you want , you can also pull latest onos from docker hub for test setup.
-
-```shell
-sudo docker pull onosproject/onos:latest
-```
-
-* Else setup for test with onos instances (onos-cord and onos-fabric) running
- in CiaB.
-
-* For Onos cord (Access side onos)
-
-```shell
-sudo ./cord-test.py setup -m manifest-cord.json
-```
-
-* For Fabric onos
-
-```shell
-sudo ./cord-test.py setup -m manifest-fabric.json
-```
-
-* For running tests using specific test container.
-
-```shell
-sudo ./cord-test.py run -t tls:eap_auth_exchange.test_eap_tls -c cord-tester1
-```
-
-## How to use
-
-Help:
-
-```shell
-sudo ./cord-test.py -h
-```
-
-List test cases for individual modules or list all tests.
-
-```shell
-sudo ./cord-test.py list -t <module name>/ all
-```
-
-Cleanup:
-
-```shell
-sudo ./cord-test.py cleanup -m manifest-cord.json
-```
-
-## Individual tests
-
-Running test case of indivdual modules, some examples:
-
-### TLS
-
-```shell
-sudo ./cord-test.py run -t tls:eap_auth_exchange.test_eap_tls
-```
-
-### IGMP
-
-```shell
-sudo ./cord-test.py run -t igmp:igmp_exchange.test_igmp_join_verify_traffic
-```
-
-### VROUTER
-
-```shell
-sudo ./cord-test.py run -t vrouter:vrouter_exchange.test_vrouter_with_5_routes
-```
-
-### DHCP
-
-```shell
-sudo ./cord-test.py run -t dhcp:dhcp_exchange.test_dhcp_1request
-```
-
-
diff --git a/docs/cord-tester-for-voltha.md b/docs/cord-tester-for-voltha.md
deleted file mode 100644
index 570406b..0000000
--- a/docs/cord-tester-for-voltha.md
+++ /dev/null
@@ -1,75 +0,0 @@
-# Steps to test VOLTHA using CORD-TESTER with PONSIM ONU & OLT
-
-## Install CORD-TESTER
-
-```shell
-~$ git clone https://github.com/opencord/cord-tester.git
-~$ cd cord-tester
-~$ cd /cord-tester/src/test/setup/
-~$ sudo bash prerequisites.sh
-~$ sudo ./cord-test.py build all
-```
-
-## Install VOLTHA, following this link
-
-```shell
-https://github.com/opencord/voltha/blob/master/BUILD.md
-```
-
-## Get into setup directory of cord tester
-
-```shell
-$cord-tester/src/test/setup/
-```
-
-## Please make sure of VOLTHA location in manifest-ponsim.json
-
-```shell
-For e.g "voltha_loc" : "/home/ubuntu/cord/incubator/voltha"
-```
-
-## Run following command to clean up previous installs
-
-```shell
-sudo ./cord-test.py cleanup -m manifest-ponsim.json
-```
-
-## Run following command to setup the testing stage with ponsim OLT & ONU
-
-This makes a setup of cord-test container (cord-tester1) and hooks up pon
-interface to UNI port of PONSIM ONU.***
-
-```shell
-sudo ./cord-test.py setup -m manifest-ponsim.json
-```
-
-## Now run following command to provision the OLT & ONU and run cord subscriber test
-
-```shell
-sudo ./cord-test.py run -m manifest-ponsim.json -t cordSubscriber:subscriber_exchange.test_cord_subscriber_voltha
-```
-
-* This will start the cord tester to run cord subscriber test
- * CORD Subcriber emulation with AAA TLS & IGMP subscriber channel surfing
- test for you. Have a look for steps followed to test in output log of
- test run.
- * AAA TLS test will validate exchange of multiple messages of eap, hello,
- certificates, verify data between cord tester TLS client and Radius
- Server with a validation of flows installed in OLT & ONU
- * IGMP test will surf channels joining a group and validating the multicast
- traffic received on it with the flows installed
-
-## Now you can manually also validate on voltha cli for confirmation
-
-```shell
- ~$(voltha)devices
- ~$(voltha)device <OLT deviceid>
- ~$(device OLT deviceid)flows <--- for ONU
- ~$(device OLT deviceid)ports <--- For NNI & PON Ports
-
- ~$(voltha)device <ONU deviceid>
- ~$(device ONU deviceid)flows <--- for ONU
- ~$(device ONU deviceid)ports <--- for UNI & PON Ports
-```
-
-
diff --git a/docs/qa_testsetup.md b/docs/qa_testsetup.md
index d5a044a..ca39e3a 100644
--- a/docs/qa_testsetup.md
+++ b/docs/qa_testsetup.md
@@ -4,7 +4,11 @@
* Tests can be run directly from your local machine or from a different VM by exporting the
configuration file for the target CORD servers.
-
+
+## Prerequisites
+
+* Python Virtual-Env
+
* Download the `cord-tester` repo using the following command:
```bash
@@ -14,10 +18,14 @@
* Before executing any tests, proper modules need to be installed which can be
done using the following command:
- ```bash
- cd cord-tester/src/test/setup
- sudo ./prerequisites.sh --cord
- ```
+## How to install
+
+```shell
+git clone https://github.com/opencord/cord-tester.git
+cd cord-tester
+cd src/test/cord-api/
+source setup.venv.sh
+```
## Executing Tests
@@ -31,12 +39,6 @@
```
Assuming that `cord-pod1.conf` file is present in `/home/cord` directory
-* Executing a sample test
-
- ```bash
- cd cord-tester/src/test/robot/
- robot SanityK8POD.robot
- ```
### Executing Control Plane Tests
diff --git a/docs/running.md b/docs/running.md
deleted file mode 100644
index c7d8d6a..0000000
--- a/docs/running.md
+++ /dev/null
@@ -1,189 +0,0 @@
-# CORD Tester
-
-The CORD Automated Tester Suite is an extensible end-to-end system
-test suite targeting CORD PODs. Prerequisites include:
-
-* Python 2.7 or later
-* Docker
-* vagrant(Optional)
-
-## How to Install cord-tester
-
-To install `cord-tester`, execute the following:
-
-```bash
-$ git clone https://github.com/opencord/cord-tester.git
-$ cd cord-tester
-$ vagrant up
-$ vagrant ssh cordtest
-$ cd /cord-tester/src/test/setup/
-$ Run prerequisites.sh which would setup the runtime for cord-tester
-$ sudo ./prerequisites.sh
-$ sudo ./cord-test.py -h
-
-usage: cord-test.py [-h] {run,setup,xos,list,build,metrics,start,cleanup} ...
-
-Cord Tester
-
-positional arguments:
- {run,setup,xos,list,build,metrics,start,cleanup}
- run Run cord tester
- setup Setup cord tester environment
- xos Building xos into cord tester environment
- list List test cases
- build Build cord test container images
- metrics Info of container
- start Start cord tester containers
- cleanup Cleanup test containers
-
-optional arguments:
- -h, --help show this help message and exit
-
-$ sudo ./cord-test.py run -h
-usage: cord-test.py run [-h] [-t TEST_TYPE] [-o ONOS] [-q] [-a APP] [-l]
- [-e TEST_CONTROLLER] [-r SERVER] [-k] [-s]
- [-u {test,quagga,radius,all}] [-n NUM_CONTAINERS]
- [-c CONTAINER] [-m MANIFEST] [-p PREFIX] [-d]
- [-i IDENTITY_FILE]
-
-optional arguments:
- -h, --help show this help message and exit
- -t TEST_TYPE, --test-type TEST_TYPE
- Specify test type or test case to run
- -o ONOS, --onos ONOS ONOS container image
- -q, --quagga Provision quagga container for vrouter
- -a APP, --app APP Cord ONOS app filename
- -l, --olt Use OLT config
- -e TEST_CONTROLLER, --test-controller TEST_CONTROLLER
- External test controller ip for Onos and/or radius
- server. Eg: 10.0.0.2/10.0.0.3 to specify ONOS and
- Radius ip to connect
- -r SERVER, --server SERVER
- ip:port address to connect for cord test server for
- container requests
- -k, --keep Keep test container after tests
- -s, --start-switch Start OVS when running under OLT config
- -u {test,quagga,radius,all}, --update {test,quagga,radius,all}
- Update cord tester container images. Eg:
- --update=quagga to rebuild quagga image.
- --update=radius to rebuild radius server image.
- --update=test to rebuild cord test image.(Default)
- --update=all to rebuild all cord tester images.
- -n NUM_CONTAINERS, --num-containers NUM_CONTAINERS
- Specify number of test containers to spawn for tests
- -c CONTAINER, --container CONTAINER
- Test container name for running tests
- -m MANIFEST, --manifest MANIFEST
- Provide test configuration manifest
- -p PREFIX, --prefix PREFIX
- Provide container image prefix
- -d, --no-switch Dont start test switch.
- -i IDENTITY_FILE, --identity-file IDENTITY_FILE
- ssh identity file to access compute nodes from test
- container
-$sudo ./cord-test.py list -h
-usage: cord-test.py list [-h] [-t TEST]
-
-optional arguments:
- -h, --help show this help message and exit
- -t TEST, --test TEST Specify test type to list test cases. Eg: -t tls to
- list tls test cases. -t tls-dhcp-vrouter to list
- tls,dhcp and vrouter test cases. -t all to list all
- test cases.
-```
-
-If you want to run `cord-tester` without Vagrant and already have an ubuntu
-14.04 or 16.04 server installed, do the following:
-
-```shell
-git clone https://github.com/opencord/cord-tester.git
-cd cord-tester/src/test/setup/
-sudo ./prerequisites.sh
-```
-
-Then follow the same instructions as described above.
-
-## How to Use cord-tester
-
-`eval.sh` runs all the test cases for you.
-
-```shell
-sudo ./eval.sh
-```
-
-To run all test cases in a module (e.g., for DHCP):
-
-```shell
-sudo ./cord-test.py run -t dhcp
-```
-
-To run a single test case in a module:
-
-```shell
-sudo ./cord-test.py run -t dhcp:dhcp_exchange.test_dhcp_1request
-```
-
-To run all test cases:
-
-```shell
-sudo ./cord-test.py run -t all
-```
-
-To check the list of test cases:
-
-```shell
-sudo ./cord-test.py list -t all/<Module name>
-```
-
-To check the list of a specific module:
-
-```shell
-sudo ./cord-test.py list -t dhcp
-```
-
-To cleanup all test containers:
-
-```shell
-sudo ./cord-test.py cleanup
-```
-
-For other options, run with `-h` option.
-
-## CORD API Tests
-
-This module contains tests using XOS APIs.
-Test cases are written in *RobotFramework* utilizing some
-automated python library framework.
-
-## Install Robot Framework
-
-To install `robotframework` do the following:
-
-```bash
-sudo pip install robotframework
-sudo pip install pygments
-sudo apt-get install python-wxgtk2.8
-sudo pip install robotframework-ride
-```
-
-To bring up IDE for the robot framework, do the following:
-
-```bash
-ride.py
-```
-
-### Execute testcases
-
-Testcases can be run using the `ride.py` IDE, or from the command
-line:
-
-```bash
-cd cord-tester/src/test/cord-api/Tests
-pybot <testcase.txt>
-```
-
-### Input Files for testcases
-
-Input files for the testcases are present in the `tests/data`
-directory.
-
diff --git a/docs/testcases-listings.md b/docs/testcases-listings.md
deleted file mode 100644
index 8d0be95..0000000
--- a/docs/testcases-listings.md
+++ /dev/null
@@ -1,1144 +0,0 @@
-# LIST OF TESTCASES
-
-Information of the all testcases listed here can be found at [CORD System Test wiki](https://wiki.opencord.org/display/CORD/Functional)
-
-## XOS Based Tests
-
-1. Ch_defaultImagesCheck.txt
-2. Ch_DefaultServiceCheck.txt
-3. Ch_DeploymentTest.txt
-4. Ch_MultiInstanceTest.txt
-5. Ch_NodeTest.txt
-6. Ch_SanityFlavors.txt
-7. Ch_SanityInstance.txt
-8. Ch_ServiceTest.txt
-9. Ch_SingleInstanceTest.txt
-10. Ch_SiteTest.txt
-11. Ch_SliceTest.txt
-12. Ch_SubscriberTest.txt
-13. Ch_SubscriberVolt_Delete.txt
-14. Ch_UsersTest.txt
-15. Ch_VoltTenant.txt
-16. CordVTN.txt
-
-## MODULE BASED TESTS
-
-### IPERF
-
-1. test_tcp_using_iperf
-2. test_udp_using_iperf
-3. test_tcp_window_of_40k_using_iperf
-4. test_tcp_window_of_120k_using_iperf
-5. test_tcp_window_of_520k_using_iperf
-6. test_multiple_tcp_sessions_using_iperf
-7. test_multiple_udp_sessions_using_iperf
-8. test_tcp_mss_with_90Bytes_using_iperf
-9. test_tcp_mss_with_1490Bytes_using_iperf
-10. test_tcp_mss_with_9000Bytes_for_max_throughput_using_iperf
-
-### DHCP
-
-11. test_dhcp_1request
-12. test_dhcp_1request_with_invalid_source_mac_broadcast
-13. test_dhcp_1request_with_invalid_source_mac_multicast
-14. test_dhcp_1request_with_invalid_source_mac_zero
-15. test_dhcp_Nrequest
-16. test_dhcp_1release
-17. test_dhcp_Nrelease
-18. test_dhcp_starvation_positive_scenario
-19. test_dhcp_starvation_negative_scenario
-20. test_dhcp_same_client_multiple_discover
-21. test_dhcp_same_client_multiple_request
-22. test_dhcp_client_desired_address
-23. test_dhcp_client_desired_address_out_of_pool
-24. test_dhcp_server_nak_packet
-25. test_dhcp_client_requests_specific_lease_time_in_discover
-26. test_dhcp_client_request_after_reboot
-27. test_dhcp_server_after_reboot
-28. test_dhcp_specific_lease_time_only_in_discover_but_not_in_request_packet
-29. test_dhcp_specific_lease_time_only_in_request_but_not_in_discover_packet
-30. test_dhcp_client_renew_time
-31. test_dhcp_client_rebind_time
-32. test_dhcp_client_expected_subnet_mask
-33. test_dhcp_client_sends_dhcp_request_with_wrong_subnet_mask
-34. test_dhcp_client_expected_router_address
-35. test_dhcp_client_sends_dhcp_request_with_wrong_router_address
-36. test_dhcp_client_expected_broadcast_address
-37. test_dhcp_client_sends_dhcp_request_with_wrong_broadcast_address
-38. test_dhcp_client_expected_dns_address
-39. test_dhcp_client_sends_request_with_wrong_dns_address
-40. test_dhcp_server_transactions_per_second
-41. test_dhcp_server_consecutive_successes_per_second
-42. test_dhcp_server_client_transactions_per_second
-43. test_dhcp_server_consecutive_successful_clients_per_second
-
-### FABRIC
-
-44. test_fabric
-
-### XOS-CONTAINERS-APIS
-
-45. test_xos_base_container_status
-46. test_xos_base_container_ping
-47. test_xos_base_container_listening_ports
-48. test_xos_sync_openstack_container_status
-49. test_xos_sync_openstack_container_ping
-50. test_xos_sync_openstack_container_listening_ports
-51. test_xos_postgresql_container_status
-52. test_xos_postgresql_container_ping
-53. test_xos_postgresql_container_listening_ports
-54. test_xos_syndicate_ms_container_status
-55. test_xos_syndicate_ms_container_ping
-56. test_xos_syndicate_ms_container_listening_ports
-57. test_xos_sync_vtr_container_status
-58. test_xos_sync_vtr_container_ping
-59. test_xos_sync_vsg_container_status
-60. test_xos_sync_vsg_container_ping
-61. test_xos_sync_vsg_container_listening_ports
-62. test_xos_sync_onos_container_status
-63. test_xos_sync_onos_container_ping
-64. test_xos_sync_onos_container_listening_ports
-65. test_xos_sync_fabric_container_status
-66. test_xos_sync_fabric_container_ping
-67. test_xos_sync_fabric_container_listening_ports
-68. test_xos_sync_vtn_container_status
-69. test_xos_sync_vtn_container_ping
-70. test_xos_sync_vtn_container_listening_ports
-71. test_xos_sync_onboarding_container_status
-72. test_xos_sync_onboarding_container_ping
-73. test_xos_sync_onboarding_container_listening_ports
-74. test_xos_api_post_login
-75. test_xos_api_get_utils_port_forwarding
-76. test_xos_api_get_utils_slices_plus
-77. test_xos_api_get_utils_synchronizer
-78. test_xos_api_get_utils_onboarding_status
-79. test_xos_api_post_utils_tosca_recipe
-80. test_xos_api_get_utils_ssh_keys
-81. test_xos_api_get_tenant_all_subscribers
-82. test_xos_api_get_tenant_subscribers_details
-83. test_xos_api_get_tenant_subscriber_delete
-84. test_xos_api_get_tenant_subscribers_feature_details
-85. test_xos_api_get_tenant_read_subscribers_feature_uplink_speed
-86. test_xos_api_tenant_put_update_subscribers_feature_uplink_speed
-87. test_xos_api_get_tenant_read_subscribers_feature_downlink_speed
-88. test_xos_api_tenant_put_update_subscribers_feature_downlink_speed
-89. test_xos_api_get_tenant_read_subscribers_feature_cdn
-90. test_xos_api_tenant_put_update_subscribers_feature_cdn
-91. test_xos_api_get_tenant_read_subscribers_feature_uverse
-92. test_xos_api_tenant_put_update_subscribers_feature_uverse
-93. test_xos_api_get_tenant_read_subscribers_feature_status
-94. test_xos_api_tenant_put_update_subscribers_feature_status
-95. test_xos_api_tenant_get_all_truckroll
-96. test_xos_api_tenant_post_create_truckroll
-97. test_xos_api_tenant_get_truckroll_details
-98. test_xos_api_tenant_delete_trucroll
-99. test_xos_api_tenant_get_all_volt
-100. test_xos_api_tenant_post_create_vOLT
-101. test_xos_api_tenant_get_volt_details
-102. test_xos_api_tenant_get_all_onos_apps
-103. test_xos_api_service_get_all_example_service
-104. test_xos_api_service_get_all_onos_service
-105. test_xos_api_service_get_all_vsg
-106. test_xos_api_core_get_all_deployments
-107. test_xos_api_core_post_create_deployments
-108. test_xos_api_core_get_deployment_details
-109. test_xos_api_core_delete_deployment
-110. test_xos_api_core_get_all_flavors
-111. test_xos_api_core_post_create_flavors
-112. test_xos_api_core_get_flavor_details
-113. test_xos_api_core_delete_flavors
-114. test_xos_api_core_get_all_instances
-115. test_xos_api_core_post_create_instances
-116. test_xos_api_core_get_instance_details
-117. test_xos_api_core_delete_instance
-118. test_xos_api_core_get_all_nodes
-119. test_xos_api_core_get_all_services
-120. test_xos_api_core_post_create_service
-121. test_xos_api_core_get_service_details
-122. test_xos_api_core_delete_service
-123. test_xos_api_core_get_all_sites
-124. test_xos_api_core_get_site_details
-125. test_xos_api_core_get_all_slices
-126. test_xos_api_core_get_all_users
-
-## VSG
-
-127. test_vsg_health
-128. test_vsg_health_check
-129. test_vsg_for_vcpe
-130. test_vsg_for_login
-131. test_vsg_for_default_route_through_testclient
-132. test_vsg_for_external_connectivity_through_testclient
-133. test_vsg_for_external_connectivity
-134. test_vsg_for_external_connectivity_to_google
-135. test_vsg_to_retrieve_content_from_google_to_validate_path_mtu
-136. test_vsg_to_retrieve_content_from_rediff_to_validate_path_mtu
-137. test_vsg_to_retrieve_content_from_yahoo_to_validate_path_mtu
-138. test_vsg_to_retrieve_content_from_facebook_to_validate_path_mtu
-139. test_vsg_for_external_connectivity_to_invalid_host
-140. test_vsg_for_external_connectivity_with_ttl_1
-141. test_vsg_for_external_connectivity_with_wan_interface_toggle_in_vcpe
-142. test_vsg_for_external_connectivity_with_lan_interface_toggle_in_vcpe
-143. test_vsg_multiple_subscribers_for_same_vcpe_instance
-144. test_vsg_for_multiple_subscribers_with_same_vcpe_instance_and_validate_external_connectivity
-145. test_vsg_vcpe_interface_and_validate_dhcp_ip_after_interface_toggle
-146. test_vsg_for_external_connectivity_after_restarting_vcpe_instance
-147. test_vsg_for_external_connectivity_after_restarting_vsg_vm
-148. test_vsg_for_external_connectivity_with_vcpe_container_paused
-149. test_vsg_firewall_with_deny_destination_ip_set
-150. test_vsg_firewall_with_rule_to_add_and_delete_dest_ip
-151. test_vsg_firewall_verifying_reachability_for_non_blocked_dest_ip
-152. test_vsg_firewall_appending_rules_with_deny_dest_ip
-153. test_vsg_firewall_removing_one_rule_denying_dest_ip
-154. test_vsg_firewall_changing_rule_id_deny_dest_ip
-155. test_vsg_firewall_changing_deny_rule_to_accept_dest_ip
-156. test_vsg_firewall_denying_destination_network
-157. test_vsg_firewall_denying_destination_network_subnet_modification
-158. test_vsg_firewall_with_deny_source_ip
-159. test_vsg_firewall_rule_with_add_and_delete_deny_source_ip
-160. test_vsg_firewall_rule_with_deny_icmp_protocol_echo_requests_type
-161. test_vsg_firewall_rule_with_deny_icmp_protocol_echo_reply_type
-162. test_vsg_firewall_changing_deny_rule_to_accept_rule_with_icmp_protocol_echo_requests_type
-163. test_vsg_firewall_changing_deny_rule_to_accept_rule_with_icmp_protocol_echo_reply_type
-164. test_vsg_firewall_for_deny_icmp_protocol
-165. test_vsg_firewall_rule_deny_icmp_protocol_and_destination_ip
-166. test_vsg_firewall_flushing_all_configured_rules
-167. test_vsg_firewall_deny_all_ipv4_traffic
-168. test_vsg_firewall_replacing_deny_rule_to_accept_rule_ipv4_traffic
-169. test_vsg_firewall_deny_all_traffic_coming_on_lan_interface_in_vcpe
-170. test_vsg_firewall_deny_all_traffic_going_out_of_wan_interface_in_vcpe
-171. test_vsg_firewall_deny_all_traffic_from_lan_to_wan_in_vcpe
-172. test_vsg_firewall_deny_all_dns_traffic
-173. test_vsg_firewall_deny_all_ipv4_traffic_vcpe_container_restart
-174. test_vsg_nat_dnat_modifying_destination_ip
-175. test_vsg_nat_dnat_modifying_destination_ip_and_delete
-176. test_vsg_dnat_change_modifying_destination_ip_address
-177. test_vsg_xos_subscriber_create_reserved
-178. test_vsg_xos_subscriber_create_all
-179. test_vsg_xos_subscriber_delete_all
-180. test_anil_vsg_xos_subscriber_create_and_delete
-181. test_vsg_xos_subscriber_create_and_delete
-182. test_vsg_xos_subscriber_2_create_and_delete
-183. test_vsg_xos_subscriber_3_create_and_delete
-184. test_vsg_xos_subscriber_4_create_and_delete
-185. test_vsg_xos_subscriber_5_create_and_delete
-186. test_vsg_xos_subscriber_external_connectivity_through_vcpe_instance
-187. test_vsg_xos_subscriber_external_connectivity_without_creating_vcpe_instance
-188. test_vsg_xos_subscriber_external_connectivity_after_removing_vcpe_instance_from_xos
-189. test_vsg_xos_subscriber_external_connectivity_after_restarting_vcpe_instance
-190. test_vsg_xos_subscriber_external_connectivity_toggling_vcpe_instance
-191. test_vsg_create_xos_subscribers_in_different_vsg_vm
-192. test_vsg_xos_multiple_subscribers_external_connectivity_if_one_vcpe_goes_down
-193. test_vsg_xos_subscriber_external_connectivity_after_vcpe_is_removed_and_added_again
-194. test_vsg_xos_multiple_subscribers_external_connectivity_if_one_vcpe_restarts
-195. test_vsg_xos_multiple_subscribers_external_connectivity_if_one_vcpe_is_paused
-196. test_vsg_xos_subscriber_external_connectivity_if_one_vcpe_stops
-197. test_vsg_xos_subscriber_external_connectivity_after_vsg_vm_is_stopped
-198. test_vsg_xos_subscriber_external_connectivity_after_vsg_vm_is_restarted
-199. test_vsg_xos_multiple_subscribers_external_connectivity_if_two_vsgs_stop_and_start
-200. test_vsg_xos_subscriber_external_connectivity_with_creating_firewall_rule
-201. test_vsg_for_packet_received_with_invalid_ip_fields
-202. test_vsg_for_packet_received_with_invalid_mac_fields
-203. test_vsg_for_vlan_id_mismatch_in_stag
-204. test_vsg_for_vlan_id_mismatch_in_ctag
-205. test_vsg_for_matching_and_mismatching_vlan_id_in_stag
-206. test_vsg_for_matching_and_mismatching_vlan_id_in_ctag
-207. test_vsg_for_out_of_range_vlanid_in_ctag
-208. test_vsg_for_out_of_range_vlanid_in_stag
-209. test_vsg_for_extracting_all_compute_stats_from_all_vcpe_containers
-210. test_vsg_for_extracting_dns_stats_from_all_vcpe_containers
-
-## VROUTER-IPV6
-
-211. test_vrouter_ipv6_with_5_routes
-212. test_vrouter_ipv6_with_5_routes_quagga_restart_without_config
-213. test_vrouter_ipv6_with_5_routes_quagga_restart_with_config
-214. test_vrouter_ipv6_with_5_routes_quagga_stop
-215. test_vrouter_ipv6_with_5_routes_quagga_stop_and_start
-216. test_vrouter_ipv6_with_5_routes_onos_restart_without_config
-217. test_vrouter_ipv6_with_5_routes_onos_restart_with_config
-218. test_vrouter_ipv6_with_5_routes_restart_quagga_and_onos_with_config
-219. test_vrouter_ipv6_with_5_routes_2_peers
-220. test_vrouter_ipv6_with_6_routes_3_peers
-221. test_vrouter_ipv6_with_50_routes
-222. test_vrouter_ipv6_with_50_routes_5_peers
-223. test_vrouter_ipv6_with_100_routes
-224. test_vrouter_ipv6_with_100_routes_10_peers
-225. test_vrouter_ipv6_with_300_routes
-226. -test_vrouter_ipv6_with_1k_routes
-227. test_vrouter_ipv6_with_9k_routes
-228. test_vrouter_ipv6_with_100000_routes
-229. test_vrouter_ipv6_with_1000000_routes
-230. test_vrouter_ipv6_with_route_update
-231. test_vrouter_ipv6_with_64bit_mask_route_update
-232. test_vrouter_ipv6_with_32bit_route_update
-233. test_vrouter_ipv6_with_16bit_route_update
-234. test_vrouter_ipv6_with_48bit_route_update
-235. test_vrouter_ipv6_with_classless_route_update
-236. test_vrouter_ipv6_with_classless_duplicate_route_update
-237. test_vrouter_ipv6_with_invalid_peers
-238. test_vrouter_with_traffic_sent_between_peers_connected_to_onos
-239. test_vrouter_with_routes_time_expire
-240. test_vrouter_ipv6_with_unreachable_route
-241. test_vrouter_ipv6_with_enabling_disabling_vrouter_app
-242. test_vrouter_ipv6_with_adding_new_routes_in_routing_table
-243. test_vrouter_ipv6_with_adding_new_routes_in_quagga_routing_table_and_restart
-244. test_vrouter_ipv6_with_removing_old_routes_in_routing_table
-245. test_vrouter_ipv6_modifying_nexthop_route_in_routing_table
-246. test_vrouter_ipv6_deleting_alternative_nexthop_in_routing_table
-247. test_vrouter_ipv6_deleting_some_routes_in_routing_table
-248. test_vrouter_ipv6_deleting_some_routes_in_quagga_routing_table_and_restart
-249. test_vrouter_ipv6_deleting_and_adding_routes_in_routing_table
-250. test_vrouter_ipv6_toggling_nexthop_interface
-251. test_cbench_igmp
-
-## COLLECTD
-
-252. test_stats_with_collectd_installation
-253. test_stats_with_collectd_plugin_and_onos_installation
-254. test_stats_with_collectd_get_cpu_stats
-255. test_stats_with_collectd_get_mem_stats
-256. test_stats_with_collectd_get_control_metrics_messages
-257. test_stats_with_collectd_get_network_metrics_stats
-258. test_stats_with_collectd_get_network_metrics_stats
-259. test_stats_with_collectd_for_installing_new_container
-260. test_stats_with_collectd_for_cpu_metrics_on_new_container
-261. test_stats_with_collectd_memory_metrics_on_new_container
-262. test_stats_with_collectd_get_messages_on_new_container
-263. test_stats_with_collectd_network_metrics_on_new_container
-264. test_stats_with_collectd_disk_metrics_on_new_container
-
-## CORDVTN
-
-265. test_cordvtn_neutron_network_creation_and_validation_on_head_node_with_neutron_service
-266. test_cordvtn_neutron_network_creation_and_validation_on_onos
-267. test_cordvtn_with_neutron_network_deletion_recreation_and_validation_on_head_node_with_neutron_service
-268. test_cordvtn_with_neutron_network_deletion_recreation_and_validation_on_onos
-269. test_cordvtn_with_neutron_management_network_creation_and_validation_on_head_node_with_neutron_service
-270. test_cordvtn_with_neutron_management_network_creation_and_validation_on_onos
-271. test_cordvtn_neutron_management_network_creation_and_post_network_type_management_local_to_onos
-272. test_cordvtn_with_management_network_creation_launching_nova_instance_and_validation_on_head_node_with_nova_service
-273. test_cordvtn_with_public_network_creation_and_validation_on_head_node_with_neutron_service
-274. test_cordvtn_with_public_network_creation_and_validation_on_onos
-275. test_cordvtn_with_public_network_creation_and_post_network_type_as_public_to_onos
-276. test_cordvtn_public_network_creation_with_launching_nova_instance_and_validation_on_head_node_with_nova_service
-277. test_cordvtn_with_private_network_creation_and_validation_on_head_node_with_neutron_service
-278. test_cordvtn_with_private_network_creation_and_validation_on_onos
-279. test_cordvtn_with_private_network_creation_and_post_network_type_as_private_to_onos
-280. test_cordvtn_with_private_network_creation_launching_nova_instance_and_validating_on_head_node_with_nova_service
-281. test_cordvtn_management_network_instance_and_validate_connectivity_from_host_machine_or_compute_node
-282. test_cordvtn_for_management_network_instance_and_validate_connectivity_to_external_network
-283. test_cordvtn_with_management_network_creating_two_instances_and_validate_connectivity_between_two
-284. test_cordvtn_creating_two_management_network_instances_and_validate_connectivity_between_two_networks_via_management_network
-285. test_cordvtn_creating_public_network_instance_and_validate_connectivity_from_host_machine_or_compute_node
-286. test_cordvtn_creating_public_network_instance_and_validate_connectivity_to_external_network
-287. test_cordvtn_creating_public_network_with_two_instances_and_validate_connectivity_between_two
-288. test_cordvtn_creating_two_public_network_instances_and_check_connectvity_between_two_networks_via_public_network
-289. test_cordvtn_creating_private_network_instance_and_validate_connectivity_from_host_machine_or_compute_node
-290. test_cordvtn_creating_private_network_instance_and_validate_connectivity_to_external_network
-291. test_cordvtn_creating_private_network_with_two_instances_and_check_connectvity_between_two_instances
-292. test_cordvtn_creating_two_private_network_instances_and_validate_connectivity_between_two_networks_via_private_network
-293. test_cordvtn_creating_management_and_public_network_instances_and_validate_connectivity_from_host_machine_or_compute_node_and_validate_connectivity_to_internet
-294. test_cordvtn_creating_management_and_public_network_instance_with_and_without_pause_and_validate_connectivity_from_host_machine_or_compute_node_and_validate_connectivity_to_internet
-295. test_cordvtn_creating_management_and_public_network_instance_doing_suspend_and_resume_validating_connectivity_from_host_machine_or_compute_node_and_validate_connectivity_to_internet
-296. test_cordvtn_creating_mgmt_and_public_network_instance_with_stopping_and_starting_instances_and_checking_connectvity_from_host_machine_or_compute_node_and_validate_connectivity_to_internet
-297. test_cordvtn_creating_mgmt_and_private_network_instance_and_validate_connectivity_from_host_machine_or_compute_node_and_validate_connectivity_to_internet
-298. test_cordvtn_creating_mgmt_and_private_network_with_two_instances_and_validate_connectivity_from_host_machine_or_compute_node_and_check_connectivity_to_other_instance
-299. test_cordvtn_creating_mgmt_and_private_network_with_two_instances_with_and_without_pause_validating_connectivity_from_host_machine_or_compute_node_and_validating_connectivity_to_other_instance
-300. test_cordvtn_creating_mgmt_and_private_network_with_two_instances_and_doing_suspend_and_resume_validating_connectivity_from_host_machine_or_compute_node_and_validating_connectivity_to_other_instance
-301. test_cordvtn_creating_mgmt_and_private_network_with_two_instances_applying_stop_and_start_validating_connectivity_from_host_machine_or_compute_node_and_validating_connectivity_to_other_instance
-302. test_cordvtn_creating_mgmt_and_two_private_network_with_each_instances_and_validate_connectivity_from_host_machine_or_compute_node_and_check_connectivity_to_other_instance
-303. test_cordvtn_service_dependency_without_xos_creating_mgmt_and_two_private_network_with_each_instances_and_validate_connectivity_from_host_machine_or_compute_node_and_check_connectivity_to_other_instance
-304. test_cordvtn_management_network_instance_and_validate_connectivity_from_host_machine_or_compute_node_after_br_int_bridge_is_down
-305. test_cordvtn_management_network_instance_and_validate_connectivity_from_host_machine_or_compute_node_toggling_br_int_bridge
-306. test_cordvtn_management_network_instance_and_validate_connectivity_from_host_machine_or_compute_node_checking_onos_flows
-307. test_cordvtn_creating_vtn_with_vlan_port_connectivity_and_validate_connectivity_from_host_machine_or_compute_node
-308. test_cordvtn_with_neutron_network_creation_and_validation_on_head_node_with_neutron_service
-309. test_cordvtn_neutron_network_creation_and_validation_on_onos
-310. test_cordvtn_neutron_network_deletion_and_validation_on_neutron_openstack
-311. test_cordvtn_neutron_network_sync
-312. test_cordvtn_neutron_port_sync
-313. test_cordvtn_creating_virtual_private_network
-314. test_cordvtn_creating_virtual_local_management_network
-315. test_cordvtn_creating_virtual_vlan_connectivity_network
-316. test_cordvtn_creating_virtual_floating_IP_with_vlan_connectivity_network
-317. test_cordvtn_creating_virtual_private_network_and_boot_image
-318. test_cordvtn_creating_virtual_public_network_and_boot_image
-319. test_cordvtn_creating_virtual_local_management_network_and_boot_image
-320. test_cordvtn_creating_virtual_vlan_connectivity_network_and_boot_image
-321. test_cordvtn_creating_virtual_floating_IP_with_vlan_connectivity_network_and_boot_image
-322. test_cordvtn_creating_virtual_private_network_and_boot_2_images_in_same_service
-323. test_cordvtn_creating_virtual_public_network_and_boot_2_images_in_same_service
-324. test_cordvtn_creating_virtual_local_management_network_and_boot_2_images_in_same_service
-325. test_cordvtn_creating_virtual_vlan_connectivity_network_and_boot_2_images_in_same_service
-326. test_cordvtn_creating_virtual_floating_IP_with_vlan_connectivity_network_and_boot_2_images_in_same_service
-327. test_cordvtn_creating_virtual_private_network_and_boot_2_images_in_same_service_connectivity
-328. test_cordvtn_creating_virtual_public_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-329. test_cordvtn_creating_virtual_local_management_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-330. test_cordvtn_creating_virtual_vlan_connectivity_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-331. test_cordvtn_creating_virtual_floating_IP_with_vlan_connectivity_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-332. test_cordvtn_creating_virtual_private_network_and_boot_image_connectivity_negative_scenario
-333. test_cordvtn_creating_virtual_public_network_and_boot_image_connectivity
-334. test_cordvtn_creating_virtual_local_management_network_and_boot_image_connectivity_negative_scenario
-335. test_cordvtn_creating_virtual_vlan_connectivity_network_and_boot_image_connectivity_negative_scenario
-336. test_cordvtn_creating_virtual_floating_IP_with_vlan_connectivity_network_and_boot_image_connectivity_negative_scenario
-337. test_cordvtn_creating_virtual_private_network_and_boot_image_connectivity_negative_scenario
-338. test_cordvtn_creating_virtual_public_network_and_boot_image_connectivity_negative_scenario
-339. test_cordvtn_creating_virtual_local_management_network_and_boot_image_connectivity
-340. test_cordvtn_creating_virtual_vlan_connectivity_network_and_boot_image_connectivity_negative_scenario
-341. test_cordvtn_creating_virtual_floating_IP_with_vlan_connectivity_network_and_boot_image_connectivity_negative_scenario
-342. test_cordvtn_creating_virtual_vlan_interface_private_network_and_boot_image_connectivity_negative_scenario
-343. test_cordvtn_creating_virtual_vlan_interface_public_network_and_boot_image_connectivity_negative_scenario
-344. test_cordvtn_creating_virtual_vlan_interface_local_management_network_and_boot_image_connectivity
-345. test_cordvtn_creating_virtual_vlan_interface_floating_private_network_and_boot_image_connectivity_negative_scenario
-346. test_cordvtn_creating_virtual_vlan_interface_floating_public_network_and_boot_image_connectivity_negative_scenario
-347. test_cordvtn_creating_virtual_vlan_interface_floating_local_management_network_and_boot_image_connectivity
-348. test_cordvtn_creating_one_virtual_public_and_a_private_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-349. test_cordvtn_creating_one_virtual_local_management_and_a_private_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-350. test_cordvtn_creating_one_virtual_vlan_connectivity_and_a_private_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-351. test_cordvtn_creating_one_virtual_floating_IP_with_vlan_connectivity_and_a_private_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-352. test_cordvtn_creating_one_virtual_local_management_other_public_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-353. test_cordvtn_creating_one_virtual_vlan_connectivity_and_a_private_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-354. test_cordvtn_creating_one_virtual_floating_IP_with_vlan_connectivity_and_a_private_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-355. test_cordvtn_creating_one_virtual_vlan_connectivity_other_local_management_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-356. test_cordvtn_creating_one_virtual_floating_IP_with_vlan_connectivity_other_local_management_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-357. test_cordvtn_creating_one_virtual_floating_IP_with_vlan_connectivity_other_virtual_vlan_network_and_boot_2_images_in_same_service_connectivity_negative_scenario
-358. test_cordvtn_creating_virtual_public_network_and_boot_2_images_with_invalid_public_field_of_onos_network_cfg_json_in_same_service
-359. test_cordvtn_creating_virtual_local_management_network_and_boot_image_with_invalid_localManagementIp_field_of_onos_network_cfg_json
-360. test_cordvtn_creating_virtual_private_network_and_boot_image_with_invalid_OVSDB_port_field_of_onos_network_cfg_json
-361. test_cordvtn_creating_virtual_private_network_and_boot_image_with_invalid_OpenStack_details_in_onos_network_cfg_json
-362. test_cordvtn_creating_virtual_private_network_and_boot_image_with_invalid_compute_node_details_in_onos_network_cfg_json
-363. test_cordvtn_creating_two_virtual_private_networks_and_boot_images_in_different_services_connectivity
-364. test_cordvtn_creating_two_virtual_public_networks_and_boot_images_in_different_service_connectivity
-365. test_cordvtn_creating_two_virtual_local_management_networks_and_boot_images_in_different_service_connectivity
-366. test_cordvtn_creating_two_virtual_vlan_connectivity_networks_and_boot_images_in_different_service_connectivity
-367. test_cordvtn_creating_two_virtual_floating_IP_with_vlan_connectivity_networks_and_boot_images_in_different_service_connectivity
-368. test_cordvtn_creating_two_virtual_private_networks_and_boot_images_for_services_dependency_with_out_xos_direct_access
-369. test_cordvtn_creating_two_virtual_private_networks_and_boot_images_for_services_dependency_with_out_xos_indirect_access
-370. test_cordvtn_creating_two_virtual_private_networks_and_boot_images_remove_services_dependency_with_out_xos_direct_access
-371. test_cordvtn_creating_two_virtual_private_networks_and_boot_images_remove_services_dependency_with_out_xos_indirect_access
-372. test_cordvtn_creating_two_virtual_private_networks_and_boot_images_for_services_dependency_with_xos_direct_access
-373. test_cordvtn_creating_two_virtual_private_networks_and_boot_images_for_services_dependency_with_xos_indirect_access
-374. test_cordvtn_with_access_agent_serviceType_and_vtn_location_field_network_cfg_connectivity_to_access_device
-375. test_cordvtn_with_access_agent_serviceType_and_vtn_location_field_in_network_cfg_connectivity_to_head_node
-376. test_cordvtn_with_access_agent_serviceType_and_invalid_vtn_location_field_network_cfg_connectivity_to_access_device
-377. test_cordvtn_with_access_agent_serviceType_and_invalid_vtn_location_field_in_network_cfg_connectivity_to_head_node
-378. test_cordvtn_creating_virtual_private_network_and_boot_2_images_in_same_service_connectivity_after_restarting_VMs
-379. test_cordvtn_creating_virtual_private_network_and_boot_2_images_in_same_service_connectivity_after_restarting_cord_onos
-380. test_cordvtn_creating_virtual_private_network_and_boot_2_images_in_same_service_connectivity_after_delete_any_VM_recreating_it
-381. test_cordvtn_creating_virtual_private_network_and_boot_2_images_in_same_service_connectivity_after_delete_and_add_br_int_bridge
-382. test_cordvtn_creating_virtual_public_network_and_boot_image_connectivity_after_restarting_VM
-383. test_cordvtn_creating_virtual_public_network_and_boot_image_connectivity_after_restarting_cord_onos
-384. test_cordvtn_creating_virtual_public_network_and_boot_image_connectivity_after_delete_and_recreate_VM
-385. test_cordvtn_creating_virtual_public_network_and_boot_image_connectivity_after_delete_and_add_br_int_bridge
-386. test_cordvtn_creating_virtual_local_management_network_and_boot_image_connectivity_after_restarting_VM
-387. test_cordvtn_creating_virtual_local_management_network_and_boot_image_connectivity_after_restarting_cord_onos
-388. test_cordvtn_creating_virtual_local_management_network_and_boot_image_connectivity_after_delete_and_recreate_VM
-389. test_cordvtn_creating_virtual_local_management_network_and_boot_image_connectivity_after_delete_and_add_br_int_bridge
-390. test_cordvtn_creating_virtual_vlan_interface_local_management_network_and_boot_image_connectivity_after_restarting_VM
-391. test_cordvtn_creating_virtual_vlan_interface_local_management_network_and_boot_image_connectivity_after_restarting_cord_onos
-392. test_cordvtn_creating_virtual_vlan_interface_local_management_network_and_boot_image_connectivity_after_delete_and_recreate_VM
-393. test_cordvtn_creating_virtual_vlan_interface_local_management_network_and_boot_image_connectivity_after_delete_and_add_br_int_bridge
-394. test_cordvtn_creating_virtual_vlan_interface_floating_local_management_network_and_boot_image_connectivity_after_restarting_VM
-395. test_cordvtn_creating_virtual_vlan_interface_floating_local_management_network_and_boot_image_connectivity_after_restarting_cord_onos
-396. test_cordvtn_creating_virtual_vlan_interface_floating_local_management_network_and_boot_image_connectivity_after_delete_and_recreate_VM
-397. test_cordvtn_creating_virtual_vlan_interface_floating_local_management_network_and_boot_image_connectivity_after_delete_and_add_br_int_bridge
-
-## EAP
-
-398. test_eap_md5
-399. test_eap_md5_wrg_password
-
-## EXAMPLESERVICE
-
-400. test_exampleservice_health
-401. test_exampleservice_for_login
-402. test_exampleservice_for_default_route_through_testclient
-403. test_exampleservice_for_service_access_through_testclient
-404. test_exampleservice_for_service_reachability_from_cord_tester
-405. test_exampleservice_operational_status_from_testclient
-406. test_exampleservice_operational_access_from_cord_tester
-407. test_exampleservice_for_service_message
-408. test_exampleservice_for_tenant_message
-409. test_exampleservice_access_after_subscriber_interface_toggle
-410. test_exampleservice_access_after_service_paused
-411. test_exampleservice_access_after_service_is_suspended
-412. test_exampleservice_access_after_service_restart
-413. test_exampleservice_access_after_vsg_vm_restart
-414. test_exampleservice_access_after_service_stop
-415. test_exampleservice_for_service_message_after_service_stop_and_start
-416. test_exampleservice_for_tenant_message_after_service_restart
-417. test_exampleservice_access_after_vcpe_instance_restart
-418. test_exampleservice_access_after_vcpe_instance_wan_interface_toggle
-419. test_exampleservice_access_after_firewall_rule_added_to_drop_service_running_server_in_vcpe_instance
-420. test_xos_subcriber_access_exampleservice
-421. test_exampleservice_multiple_subcribers_access_same_service
-
-## VROUTER
-
-422. test_vrouter_with_5_routes
-423. test_vrouter_with_5_routes_2_peers
-424. test_vrouter_with_6_routes_3_peers
-425. test_vrouter_with_50_routes
-426. test_vrouter_with_50_routes_5_peers
-427. test_vrouter_with_100_routes
-428. test_vrouter_with_100_routes_10_peers
-429. test_vrouter_with_300_routes
-430. test_vrouter_with_1000_routes
-431. test_vrouter_with_10000_routes
-432. test_vrouter_with_100000_routes
-433. test_vrouter_with_1000000_routes
-434. test_vrouter_with_5_routes_stopping_quagga
-435. test_vrouter_with_50_routes_stopping_quagga
-436. test_vrouter_with_route_update
-437. test_vrouter_with_classA_route_update
-438. test_vrouter_with_classB_route_update
-439. test_vrouter_with_classless_route_update
-440. test_vrouter_with_classA_duplicate_route_update
-441. test_vrouter_with_classB_duplicate_route_update
-442. test_vrouter_with_classless_duplicate_route_update
-443. test_vrouter_with_invalid_peers
-444. test_vrouter_with_traffic_sent_between_peers_connected_to_onos
-445. test_vrouter_with_routes_time_expire
-446. test_vrouter_with_unreachable_route
-447. test_vrouter_with_enabling_disabling_vrouter_app
-448. test_vrouter_with_adding_new_routes_in_routing_table
-449. test_vrouter_with_removing_old_routes_in_routing_table
-450. test_vrouter_modifying_nexthop_route_in_routing_table
-451. test_vrouter_deleting_alternative_nexthop_in_routing_table
-452. test_vrouter_deleting_some_routes_in_routing_table
-453. test_vrouter_deleting_and_adding_routes_in_routing_table
-454. test_vrouter_toggling_nexthop_interface
-
-## CORD-SUBSCRIBER
-
-455. test_cord_subscriber_join_recv
-456. test_cord_subscriber_join_jump
-457. test_cord_subscriber_join_next
-458. test_cord_subscriber_join_next_without_leave
-459. test_cord_subscriber_leave
-460. test_cord_subscriber_authentication_with_invalid_certificate_and_channel_surfing
-461. test_cord_subscriber_authentication_with_no_certificate_and_channel_surfing
-462. test_cord_subscriber_authentication_with_self_signed_certificate_and_channel_surfing
-463. test_2_cord_subscribers_authentication_with_valid_and_invalid_certificates_and_channel_surfing
-464. test_2_cord_subscribers_authentication_with_valid_and_no_certificates_and_channel_surfing
-465. test_2_cord_subscribers_authentication_with_valid_and_non_ca_authorized_certificates_and_channel_surfing
-466. test_cord_subscriber_authentication_with_dhcp_discover_and_channel_surfing
-467. test_cord_subscriber_authentication_with_dhcp_client_reboot_and_channel_surfing
-468. test_cord_subscriber_authentication_with_dhcp_server_reboot_and_channel_surfing
-469. test_cord_subscriber_authentication_with_dhcp_client_rebind_and_channel_surfing
-470. test_cord_subscriber_authentication_with_dhcp_starvation_and_channel_surfing
-471. test_cord_subscriber_authentication_with_multiple_dhcp_discover_for_same_subscriber_and_channel_surfing
-472. test_cord_subscriber_authentication_with_multiple_dhcp_request_for_same_subscriber_and_channel_surfing
-473. test_cord_subscriber_authentication_with_dhcp_client_requested_ip_and_channel_surfing
-474. test_cord_subscriber_authentication_with_dhcp_non_offered_ip_and_channel_surfing
-475. test_cord_subscriber_authentication_with_dhcp_request_out_of_pool_ip_by_client_and_channel_surfing
-476. test_cord_subscriber_authentication_with_dhcp_specified_lease_time_functionality_and_channel_surfing
-477. test_1k_subscribers_authentication_with_valid_and_invalid_certificates_and_channel_surfing
-478. test_1k_subscribers_authentication_with_valid_and_no_certificates_and_channel_surfing
-479. test_1k_subscribers_authentication_with_valid_and_non_ca_authorized_certificates_and_channel_surfing
-480. test_5k_subscribers_authentication_with_valid_and_invalid_certificates_and_channel_surfing
-481. test_5k_subscribers_authentication_with_valid_and_no_certificates_and_channel_surfing
-482. test_5k_subscribers_authentication_with_valid_and_non_ca_authorized_certificates_and_channel_surfing
-483. test_10k_subscribers_authentication_with_valid_and_invalid_certificates_and_channel_surfing
-484. test_10k_subscribers_authentication_with_valid_and_no_certificates_and_channel_surfing
-485. test_10k_subscribers_authentication_with_valid_and_non_ca_authorized_certificates_and_channel_surfing
-486. test_1k_cord_subscribers_authentication_with_dhcp_discovers_and_channel_surfing
-487. test_1k_cord_subscribers_authentication_with_dhcp_client_reboot_and_channel_surfing
-488. test_1k_cord_subscribers_authentication_with_dhcp_server_reboot_and_channel_surfing
-489. test_1k_cord_subscribers_authentication_with_dhcp_client_rebind_and_channel_surfing
-490. test_1k_cord_subscribers_authentication_with_dhcp_starvation_and_channel_surfing
-491. test_1k_cord_subscribers_authentication_with_dhcp_client_requested_ip_and_channel_surfing
-492. test_1k_cord_subscribers_authentication_with_dhcp_non_offered_ip_and_channel_surfing
-493. test_4_cord_subscribers_join_recv_5channel
-494. test_4_cord_subscribers_join_jump_5channel
-495. test_4_cord_subscribers_join_next_5channel
-496. test_10_cord_subscribers_join_recv_5channel
-497. test_10_cord_subscribers_join_jump_5channel
-498. test_10_cord_subscribers_join_next_5channel
-499. test_cord_subscriber_join_recv_100channels
-500. test_cord_subscriber_join_recv_400channels
-501. test_cord_subscriber_join_recv_800channels
-502. test_cord_subscriber_join_recv_1200channels
-503. test_cord_subscriber_join_recv_1500channels
-504. test_cord_subscriber_join_jump_100channels
-505. test_cord_subscriber_join_jump_400channels
-506. test_cord_subscriber_join_jump_800channels
-507. test_cord_subscriber_join_jump_1200channel
-508. test_cord_subscriber_join_jump_1500channels
-509. test_cord_subscriber_join_next_100channels
-510. test_cord_subscriber_join_next_400channels
-511. test_cord_subscriber_join_next_800channels
-512. test_cord_subscriber_join_next_1200channels
-513. test_cord_subscriber_join_next_1500channels
-514. test_1k_cord_subscribers_authentication_with_dhcp_request_out_of_pool_ip_by_client_and_channel_surfing
-515. test_1k_cord_subscribers_join_recv_100channel
-516. test_1k_cord_subscribers_join_jump_100channel
-517. test_1k_cord_subscribers_join_next_100channel
-518. test_1k_cord_subscribers_join_recv_400channel
-519. test_1k_cord_subscribers_join_jump_400channel
-520. test_1k_cord_subscribers_join_next_400channel
-521. test_1k_cord_subscribers_join_recv_800channel
-522. test_1k_cord_subscribers_join_jump_800channel
-523. test_1k_cord_subscribers_join_next_800channel
-524. test_1k_cord_subscribers_join_recv_1200channel
-525. test_1k_cord_subscribers_join_jump_1200channel
-526. test_1k_cord_subscribers_join_next_1200channel
-527. test_1k_cord_subscribers_join_recv_1500channel
-528. test_1k_cord_subscribers_join_jump_1500channel
-529. test_1k_cord_subscribers_join_next_1500channel
-530. test_5k_cord_subscribers_join_recv_100channel
-531. test_5k_cord_subscribers_join_jump_100channel
-532. test_5k_cord_subscribers_join_next_100channel
-533. test_5k_cord_subscribers_join_recv_400channel
-534. test_5k_cord_subscribers_join_jump_400channel
-535. test_5k_cord_subscribers_join_next_400channel
-536. test_5k_cord_subscribers_join_recv_800channel
-537. test_5k_cord_subscribers_join_jump_800channel
-538. test_5k_cord_subscribers_join_next_800channel
-539. test_5k_cord_subscribers_join_recv_1200channel
-540. test_5k_cord_subscribers_join_jump_1200channel
-541. test_5k_cord_subscribers_join_next_1200channel
-542. test_5k_cord_subscribers_join_recv_1500channel
-543. test_5k_cord_subscribers_join_jump_1500channel
-544. test_5k_cord_subscribers_join_next_1500channel
-545. test_10k_cord_subscribers_join_recv_100channel
-546. test_10k_cord_subscribers_join_jump_100channel
-547. test_10k_cord_subscribers_join_next_100channel
-548. test_100k_cord_subscribers_join_recv_100channel
-549. test_100k_cord_subscribers_join_jump_100channel
-550. test_100k_cord_subscribers_join_next_100channel
-551. test_10k_cord_subscribers_join_recv_400channel
-552. test_10k_cord_subscribers_join_jump_400channel
-553. test_10k_cord_subscribers_join_next_400channel
-554. test_10k_cord_subscribers_join_recv_800channel
-555. test_10k_cord_subscribers_join_jump_800channel
-556. test_10k_cord_subscribers_join_next_800channel
-557. test_10k_cord_subscribers_join_recv_1200channel
-558. test_10k_cord_subscribers_join_jump_1200channel
-559. test_10k_cord_subscribers_join_next_1200channel
-560. test_10k_cord_subscribers_join_recv_1500channel
-561. test_10k_cord_subscribers_join_jump_1500channel
-562. test_10k_cord_subscribers_join_next_1500channel
-563. test_100k_cord_subscribers_join_recv_1500channel
-564. test_100k_cord_subscribers_join_jump_1500channel
-565. test_100k_cord_subscribers_join_next_1500channel
-566. test_cord_subscriber_voltha_tls
-567. test_cord_subscriber_voltha_tls_igmp
-568. test_cord_subscriber_voltha_tls_igmp_3
-
-## DHCPRELAY
-
-569. test_dhcpRelay_1request
-570. test_dhcpRelay_1request_with_invalid_source_mac_broadcast
-571. test_dhcpRelay_1request_with_invalid_source_mac_multicast
-572. test_dhcpRelay_1request_with_invalid_source_mac_zero
-573. test_dhcpRelay_Nrequest
-574. test_dhcpRelay_1release
-575. test_dhcpRelay_Nrelease
-576. test_dhcpRelay_starvation
-577. test_dhcpRelay_same_client_multiple_discover
-578. test_dhcpRelay_same_client_multiple_request
-579. test_dhcpRelay_client_desired_address
-580. test_dhcpRelay_client_desired_address_out_of_pool
-581. test_dhcpRelay_nak_packet
-582. test_dhcpRelay_client_requests_specific_lease_time_in_discover
-583. test_dhcpRelay_client_request_after_reboot
-584. test_dhcpRelay_after_server_reboot
-585. test_dhcpRelay_specific_lease_time_only_in_discover_but_not_in_request_packet
-586. test_dhcpRelay_specific_lease_time_only_in_request_but_not_in_discover_packet
-587. test_dhcpRelay_client_renew_time
-588. test_dhcpRelay_client_rebind_time
-589. test_dhcpRelay_client_expected_subnet_mask
-590. test_dhcpRelay_client_sends_dhcp_request_with_wrong_subnet_mask
-591. test_dhcpRelay_client_expected_router_address
-592. test_dhcpRelay_client_sends_dhcp_request_with_wrong_router_address
-593. test_dhcpRelay_client_expected_broadcast_address
-594. test_dhcpRelay_client_sends_dhcp_request_with_wrong_broadcast_address
-595. test_dhcpRelay_client_expected_dns_address
-596. test_dhcpRelay_client_sends_request_with_wrong_dns_address
-597. test_dhcpRelay_transactions_per_second
-598. test_dhcpRelay_consecutive_successes_per_second
-599. test_dhcpRelay_clients_per_second
-600. test_dhcpRelay_consecutive_successful_clients_per_second
-601. test_dhcpRelay_concurrent_transactions_per_second
-602. test_dhcpRelay_concurrent_consecutive_successes_per_second
-603. test_dhcpRelay_concurrent_clients_per_second
-604. test_dhcpRelay_client_conflict
-
-## ACL
-
-605. test_acl_allow_rule
-606. test_acl_allow_rule_with_24_bit_mask
-607. test_acl_deny_rule
-608. test_acl_deny_rule_with_24_bit_mask
-609. test_acl_add_remove_rule
-610. test_acl_add_remove_all_rules
-611. test_acl_remove_all_rules_without_add
-612. test_acl_allow_and_deny_rule_for_same_src_and_dst_ip
-613. test_acl_allow_rules_for_matched_dst_ips
-614. test_acl_with_matching_src_and_dst_ip_traffic
-615. test_acl_with_matching_24bit_mask_src_and_dst_ip_traffic
-616. test_acl_with_non_matching_src_and_dst_ip_traffic
-617. test_acl_deny_rule_with_matching_src_and_dst_ip_traffic
-618. test_acl_deny_rule_with_src_and_dst_ip_applying_24_bit_mask_for_matching_traffic
-619. test_acl_deny_rule_with_non_matching_src_and_dst_ip_traffic
-620. test_acl_allow_and_deny_rules_with_matching_src_and_dst_ip_traffic
-621. test_acl_for_l4_acl_rule
-622. test_acl_for_remove_l4_rule
-623. test_acl_for_remove_l4_rules
-624. test_acl_adding_specific_l4_and_all_l4_allow_rule
-625. test_acl_adding_all_l4_and_specific_l4_allow_rule
-626. test_acl_with_specific_l4_and_all_l4_deny_rule
-627. test_acl_with_all_l4_and_specific_l4_deny_rule
-628. test_acl_with_specific_l4_deny_and_all_l4_allow_rule
-629. test_acl_deny_all_l4_and_allow_specific_l4_rule
-630. test_acl_tcp_port_allow_rule_for_matching_and_non_matching_traffic
-631. test_acl_udp_port_allow_rule_for_matching_and_non_matching_traffic
-632. test_acl_icmp_port_allow_rule_for_matching_and_non_matching_traffic
-633. test_acl_tcp_port_deny_rule_for_matching_and_non_matching_traffic
-634. test_acl_udp_port_deny_rule_for_matching_and_non_matching_traffic
-635. test_acl_icmp_port_deny_rule_for_matching_and_non_matching_traffic
-636. test_acl_two_allow_rules_for_tcp_port_matching_traffic
-637. test_acl_two_allow_rules_for_udp_ports_matching_traffic
-638. test_acl_two_allow_rules_for_src_ips_dst_ips_and_l4_ports_matching_traffic
-639. test_acl_allow_and_deny_rules_for_src_ips_dst_ips_and_l4_ports_matching_traffic
-
-## FLOWS
-
-640. test_flow_mac
-641. test_flow_ip
-642. test_flow_tcp_port
-643. test_flow_udp_port
-644. test_flow_vlan
-645. test_flow_ipv6
-646. test_flow_ipv6_flow_label
-647. test_flow_ipv6_extension_header
-648. test_flow_ipv6_available_extension_headers
-649. test_flow_dscp
-650. test_flow_available_dscp
-651. test_flow_ecn
-652. test_flow_available_ecn
-653. test_flow_available_dscp_and_ecn
-654. test_flow_icmp
-655. test_flow_icmp_different_types
-656. test_flow_icmpv6_EchoRequest
-657. test_flow_icmpv6_EchoReply
-658. test_flow_icmpv6_DestUnreachable
-659. test_flow_icmpv6_PacketTooBig
-660. test_flow_icmpv6_TimeExceeded
-661. test_flow_icmpv6_ParameterProblem
-662. test_flow_icmpv6_ND_Target_address
-663. test_flow_icmpv6_ND_SLL
-664. test_flow_icmpv6_NA_TLL
-665. test_flow_ipv6_and_icmpv6
-666. test_5_flow_constant_dst_mac
-667. test_500_flow_constant_dst_mac
-668. test_1k_flow_constant_dst_mac
-669. test_10k_flow_constant_dst_mac
-670. test_100k_flow_constant_dst_mac
-671. test_1000k_flow_constant_dst_mac
-672. test_5_flow_constant_src_mac
-673. test_500_flow_mac
-674. test_1k_flow_mac
-675. test_10k_flow_mac
-676. test_100k_flow_mac
-677. test_1000k_flow_mac
-678. test_rate_100_flow_mac
-679. test_rate_500_flow_mac
-680. test_rate_1k_flow_mac
-681. test_500_flow_ip
-682. test_1k_flow_ip
-683. test_10k_flow_ip
-684. test_100k_flow_ip
-685. test_1000k_flow_ip
-686. test_500_flow_tcp_port
-687. test_1k_flow_tcp_port
-688. test_10k_flow_tcp_port
-689. test_500_flow_udp_port
-690. test_1k_flow_udp_port
-691. test_10k_flow_udp_port
-
-## AAA-TLS
-
-692. test_eap_tls
-693. test_eap_tls_with_no_cert
-694. test_eap_tls_with_invalid_cert
-695. test_eap_tls_Nusers_with_same_valid_cert
-696. test_eap_tls_with_invalid_session_id
-697. test_eap_tls_with_random_gmt_unix_time
-698. test_eap_tls_with_invalid_content_type
-699. test_eap_tls_with_invalid_record_fragment_length
-700. test_eap_tls_with_invalid_id_in_identifier_response_packet
-701. test_eap_tls_with_invalid_id_in_client_hello_packet
-702. test_eap_tls_without_sending_client_hello
-703. test_eap_tls_with_aaa_app_deactivation
-704. test_eap_tls_with_incorrect_cipher_suite_length_field
-705. test_eap_tls_with_incorrect_compression_methods_length_field
-706. test_eap_tls_with_invalid_source_mac_broadcast
-707. test_eap_tls_with_invalid_source_mac_multicast
-708. test_eap_tls_with_invalid_source_mac_zero
-709. test_eap_tls_with_restart_of_radius_server
-710. test_eap_tls_with_incorrect_handshake_type_client_hello
-711. test_eap_tls_with_incorrect_handshake_type_certificate_request
-712. test_eap_tls_with_incorrect_tlsrecord_certificate_request
-713. test_eap_tls_with_invalid_handshake_length_client_hello
-714. test_eap_tls_clientkeyex_replace_with_serverkeyex
-715. test_eap_tls_1k_sessions_with_diff_mac
-716. test_eap_tls_5k_sessions_with_diff_mac
-
-## CLUSTER
-
-717. test_cluster_controller_restarts
-718. test_cluster_graceful_controller_restarts
-719. test_cluster_single_controller_restarts
-720. test_cluster_restarts
-721. test_cluster_formation_and_verification
-722. test_cluster_adding_members
-723. test_cluster_removing_master
-724. test_cluster_removing_one_member
-725. test_cluster_removing_two_members
-726. test_cluster_removing_N_members
-727. test_cluster_adding_and_removing_members
-728. test_cluster_removing_and_adding_member
-729. test_cluster_restart
-730. test_cluster_master_restart
-731. test_cluster_master_ip_after_master_restart
-732. test_cluster_one_member_restart
-733. test_cluster_two_members_restart
-734. test_cluster_state_with_N_members_restart
-735. test_cluster_state_with_master_change
-736. test_cluster_with_vrouter_routes_in_cluster_members
-737. test_cluster_with_vrouter_and_master_down
-738. test_cluster_with_vrouter_and_restarting_master
-739. test_cluster_deactivating_vrouter_app
-740. test_cluster_deactivating_vrouter_app_and_making_master_down
-741. test_cluster_for_vrouter_app_and_making_member_down
-742. test_cluster_for_vrouter_app_and_restarting_member
-743. test_cluster_for_vrouter_app_restarting_cluster
-744. test_cluster_for_flows_of_udp_port_and_making_master_down
-745. test_cluster_state_changing_master_and_flows_of_ecn
-746. test_cluster_flow_for_ipv6_extension_header_and_master_restart
-747. test_cluster_with_igmp_include_exclude_modes_and_restarting_master
-748. test_cluster_with_igmp_include_exclude_modes_and_making_master_down
-749. test_cluster_with_igmp_include_mode_checking_traffic_recovery_time_after_master_is_down
-750. test_cluster_state_with_igmp_leave_group_after_master_change
-751. test_cluster_state_with_igmp_join_before_and_after_master_change
-752. test_cluster_with_eap_tls_traffic
-753. test_cluster_for_eap_tls_traffic_before_and_after_master_change
-754. test_cluster_for_eap_tls_traffic_before_and_after_making_master_down
-755. test_cluster_for_eap_tls_with_no_cert_before_and_after_member_is_restarted
-756. test_cluster_proxyarp_master_change_and_app_deactivation
-757. test_cluster_with_proxyarp_and_one_member_down
-758. test_cluster_with_proxyarp_and_concurrent_requests_with_multiple_host_and_different_interfaces
-759. test_cluster_with_acl_rule_before_master_change_and_remove_acl_rule_after_master_change
-760. test_cluster_verifying_acl_rule_in_new_master_after_current_master_is_down
-761. test_cluster_with_acl_traffic_before_and_after_two_members_down
-762. test_cluster_with_dhcpRelay_releasing_dhcp_ip_after_master_change
-763. test_cluster_with_dhcpRelay_and_verify_dhcp_ip_after_master_down
-764. test_cluster_with_dhcpRelay_and_simulate_client_by_changing_master
-765. test_cluster_with_cord_subscriber_joining_next_channel_before_and_after_cluster_restart
-766. test_cluster_with_cord_subscriber_join_next_channel_before_and_after_cluster_mastership_is_withdrawn
-767. test_cluster_with_cord_subscriber_join_recv_traffic_from_10channels_and_making_one_cluster_member_down
-768. test_cluster_with_cord_subscriber_joining_next_10channels_making_two_cluster_members_down
-769. test_cluster_with_multiple_ovs_switches
-770. test_cluster_state_in_multiple_ovs_switches
-771. test_cluster_verifying_multiple_ovs_switches_after_master_is_restarted
-772. test_cluster_verifying_multiple_ovs_switches_with_one_master_down
-773. test_cluster_verifying_multiple_ovs_switches_with_current_master_withdrawing_mastership
-774. test_cluster_verifying_multiple_ovs_switches_and_restarting_cluster
-
-## SCALE
-
-775. test_scale_for_vsg_vm_creations
-776. test_scale_for_vcpe_creations
-777. test_scale_of_subcriber_vcpe_creations_in_single_vsg_vm
-778. test_scale_for_cord_subscriber_creation_and_deletion
-779. test_cord_for_scale_of_subscriber_containers_per_compute_node
-780. test_eap_pap
-
-## PROXYARP
-
-781. test_proxyarp_with_1_host
-782. test_proxyarp_with_10_hosts
-783. test_proxyarp_with_50_hosts
-784. test_proxyarp_app_with_disabling_and_re_enabling
-785. test_proxyarp_nonexisting_host
-786. test_proxyarp_removing_host
-787. test_proxyarp_concurrent_requests_with_multiple_host_and_different_interfaces
-788. test_proxyarp_disabling_enabling_app_initiating_concurrent_requests
-789. test_proxyarp_with_existing_and_non_existing_hostIPs_initiating_concurrent_requests
-
-## IGMP
-
-790. test_igmp_join_verify_traffic
-791. test_igmp_leave_verify_traffic
-792. test_igmp_leave_join_loop
-793. test_igmp_1group_join_latency
-794. test_igmp_2group_join_latency
-795. test_igmp_Ngroup_join_latency
-796. test_igmp_join_rover_all
-797. test_igmp_join_rover
-798. test_igmp_query
-799. test_igmp_2joins_1leave
-800. test_igmp_2joins_1leave_and_join_again
-801. test_igmp_not_in_src_list
-802. test_igmp_change_to_exclude_src_list
-803. test_igmp_include_to_allow_src_list
-804. test_igmp_include_to_block_src_list
-805. test_igmp_change_to_include_src_list
-806. test_igmp_exclude_to_allow_src_list
-807. test_igmp_exclude_to_block_src_list
-808. test_igmp_new_src_list
-809. test_igmp_block_old_src_list
-810. test_igmp_include_empty_src_list
-811. test_igmp_exclude_empty_src_list
-812. test_igmp_join_sourceip_0_0_0_0
-813. test_igmp_invalid_join_packet
-814. test_igmp_join_data_received_during_subscriber_link_toggle
-815. test_igmp_join_data_received_during_channel_distributors_link_toggle
-816. test_igmp_invalid_class_d_ip_for_join_packet
-817. test_igmp_invalid_class_d_ip_as_srclist_ip_for_join_packet
-818. test_igmp_general_query_received_traffic
-819. test_igmp_query_received_on_joining_interface
-820. test_igmp_for_periodic_query_received_on_joining_interface
-821. test_igmp_for_periodic_query_received_and_checking_entry_deleted
-822. test_igmp_member_query_interval_and_expiry_for_rejoining_interface
-823. test_igmp_leave_received_group_and_source_specific_query
-824. test_igmp_change_to_exclude_src_list_and_check_for_group_source_specific_query
-825. test_igmp_change_to_include_src_list_and_check_for_general_query
-826. test_igmp_allow_new_src_list_and_check_for_general_query
-827. test_igmp_block_old_src_list_and_check_for_group_source_specific_query
-828. test_igmp_include_to_allow_src_list_and_check_for_general_query
-829. test_igmp_include_to_block_src_list_and_check_for_group_source_specific_query
-830. test_igmp_exclude_to_allow_src_list_and_check_for_general_query
-831. test_igmp_exclude_to_block_src_list_and_check_for_group_source_specific_query
-832. test_igmp_include_exclude_modes
-833. test_igmp_allow_new_source_mode
-834. test_igmp_include_to_exclude_mode_change
-835. test_igmp_exclude_to_include_mode_change
-836. test_igmp_to_include_mode_with_null_source
-837. test_igmp_to_include_mode
-838. test_igmp_blocking_old_source_mode
-839. test_igmp_multiple_joins_and_data_verification_with_100_groups
-840. test_igmp_multiple_joins_with_data_verification_and_leaving_100_groups
-841. test_igmp_group_source_for_only_config_with_1000_entries
-842. test_igmp_from_exclude_to_include_mode_with_100_groups
-843. test_igmp_with_multiple_joins_and_data_verify_with_1000_groups
-844. test_igmp_with_multiple_joins_and_data_verify_with_5000_groups
-845. test_igmp_send_data_to_non_registered_group
-846. test_igmp_traffic_verification_for_registered_group_with_no_join_sent
-847. test_igmp_toggling_app_activation
-848. test_igmp_with_mismatch_for_dst_ip_and_mac_in_data_packets
-849. test_igmp_registering_invalid_group
-850. test_igmp_registering_invalid_source
-
-## VOLTHA
-
-851. test_olt_enable_disable
-852. test_ponsim_enable_disable
-853. test_subscriber_with_voltha_for_eap_tls_authentication
-854. test_subscriber_with_voltha_for_eap_tls_authentication_failure
-855. test_subscriber_with_voltha_for_eap_tls_authentication_using_invalid_cert
-856. test_subscriber_with_voltha_for_multiple_invalid_authentication_attempts
-857. test_subscriber_with_voltha_for_eap_tls_authentication_with_aaa_app_deactivation
-858. test_subscriber_with_voltha_for_eap_tls_authentication_restarting_radius_server
-859. test_subscriber_with_voltha_for_eap_tls_authentication_with_disabled_olt
-860. test_subscriber_with_voltha_for_eap_tls_authentication_disabling_uni_port
-861. test_subscriber_with_voltha_for_eap_tls_authentication_carrying_out_multiple_times_toggling_of_uni_port
-862. test_subscriber_with_voltha_for_eap_tls_authentication_restarting_olt
-863. test_subscriber_with_voltha_for_eap_tls_authentication_performing_multiple_times_restarting_olt
-864. test_subscriber_with_voltha_for_eap_tls_authentication_restarting_onu
-865. test_subscriber_with_voltha_for_eap_tls_authentication_performing_multiple_times_restart_of_onu
-866. test_two_subscriberss_with_voltha_for_eap_tls_authentication
-867. test_two_subscriberss_with_voltha_for_eap_tls_authentication_using_same_certificates
-868. test_two_subscriberss_with_voltha_for_eap_tls_authentication_initiating_invalid_tls_packets_for_one_subscriber
-869. test_two_subscriberss_with_voltha_for_eap_tls_authentication_initiating_invalid_cert_for_one_subscriber
-870. test_two_subscriberss_with_voltha_for_eap_tls_authentication_with_one_uni_port_disabled
-871. test_subscriber_with_voltha_for_dhcp_request
-872. test_subscriber_with_voltha_for_dhcp_request_with_invalid_broadcast_source_mac
-873. test_subscriber_with_voltha_for_dhcp_request_with_invalid_multicast_source_mac
-874. test_subscriber_with_voltha_for_dhcp_request_with_invalid_source_mac
-875. test_subscriber_with_voltha_for_dhcp_request_and_release
-876. test_subscriber_with_voltha_for_dhcp_starvation_positive_scenario
-877. test_subscriber_with_voltha_for_dhcp_starvation_negative_scenario
-878. test_subscriber_with_voltha_for_dhcp_sending_multiple_discover
-879. test_subscriber_with_voltha_for_dhcp_sending_multiple_request
-880. test_subscriber_with_voltha_for_dhcp_requesting_desired_ip_address
-881. test_subscriber_with_voltha_for_dhcp_requesting_desired_out_of_pool_ip_address
-882. test_subscriber_with_voltha_deactivating_dhcp_app_in_onos
-883. test_subscriber_with_voltha_for_dhcp_renew_time
-884. test_subscriber_with_voltha_for_dhcp_rebind_time
-885. test_subscriber_with_voltha_for_dhcp_toggling_olt
-886. test_subscriber_with_voltha_for_dhcp_with_multiple_times_disabling_of_olt
-887. test_subscriber_with_voltha_for_dhcp_toggling_olt
-888. test_subscriber_with_voltha_for_dhcp_toggling_olt_multiple_times
-889. test_subscriber_with_voltha_for_dhcp_disabling_onu_port
-890. test_subscriber_with_voltha_for_dhcp_disabling_onu_port_multiple_times
-891. test_subscriber_with_voltha_for_dhcp_toggling_onu_port
-892. test_subscriber_with_voltha_for_dhcp_toggling_onu_port_multiple_times
-893. test_two_subscribers_with_voltha_for_dhcp_discover
-894. test_two_subscribers_with_voltha_for_dhcp_multiple_discover
-895. test_two_subscribers_with_voltha_for_dhcp_and_with_multiple_discover_for_one_subscriber
-896. test_two_subscribers_with_voltha_for_dhcp_discover_and_desired_ip_address_for_one_subscriber
-897. test_two_subscribers_with_voltha_for_dhcp_discover_within_and_without_dhcp_pool_ip_addresses
-898. test_two_subscribers_with_voltha_for_dhcp_disabling_onu_port_for_one_subscriber
-899. test_two_subscribers_with_voltha_for_dhcp_toggling_onu_port_for_one_subscriber
-900. test_two_subscribers_with_voltha_for_dhcp_disabling_olt
-901. test_two_subscribers_with_voltha_for_dhcp_toggling_olt
-902. test_two_subscribers_with_voltha_for_dhcp_with_paused_olt
-903. test_subscriber_with_voltha_for_dhcpRelay_dhcp_request
-904. test_subscriber_with_voltha_for_dhcpRelay_dhcp_request_with_invalid_broadcast_source_mac
-905. test_subscriber_with_voltha_for_dhcpRelay_dhcp_request_with_invalid_multicast_source_mac
-906. test_subscriber_with_voltha_for_dhcpRelay_dhcp_request_with_invalid_source_mac
-907. test_subscriber_with_voltha_for_dhcpRelay_dhcp_request_and_release
-908. test_subscriber_with_voltha_for_dhcpRelay_starvation
-909. test_subscriber_with_voltha_for_dhcpRelay_starvation_negative_scenario
-910. test_subscriber_with_voltha_for_dhcpRelay_sending_multiple_discover
-911. test_subscriber_with_voltha_for_dhcpRelay_sending_multiple_request
-912. test_subscriber_with_voltha_for_dhcpRelay_requesting_desired_ip_address
-913. test_subscriber_with_voltha_for_dhcpRelay_requesting_desired_out_of_pool_ip_address
-914. test_subscriber_with_voltha_for_dhcpRelay_deactivating_dhcpRelay_app_in_onos
-915. test_subscriber_with_voltha_for_dhcpRelay_renew_time
-916. test_subscriber_with_voltha_for_dhcpRelay_rebind_time
-917. test_subscriber_with_voltha_for_dhcpRelay_disable_olt_in_voltha
-918. test_subscriber_with_voltha_for_dhcpRelay_toggling_olt_in_voltha
-919. test_subscriber_with_voltha_for_dhcpRelay_disable_onu_port_in_voltha
-920. test_subscriber_with_voltha_for_dhcpRelay_disable_enable_onu_port_in_voltha
-921. test_two_subscribers_with_voltha_for_dhcpRelay_discover
-922. test_two_subscribers_with_voltha_for_dhcpRelay_multiple_discover
-923. test_two_subscribers_with_voltha_for_dhcpRelay_multiple_discover_for_one_subscriber
-924. test_two_subscribers_with_voltha_for_dhcpRelay_discover_desired_ip_address_for_one_subscriber
-925. test_two_subscribers_with_voltha_for_dhcpRelay_discover_in_range_and_out_of_range_from_dhcp_pool_ip_addresses
-926. test_two_subscribers_with_voltha_for_dhcpRelay_disable_onu_port_for_one_subscriber
-927. test_two_subscribers_with_voltha_for_dhcpRelay_toggle_onu_port_for_one_subscriber
-928. test_two_subscribers_with_voltha_for_dhcpRelay_disable_olt_detected_in_voltha
-929. test_two_subscribers_with_voltha_for_dhcpRelay_toggle_olt_detected_in_voltha
-930. test_two_subscribers_with_voltha_for_dhcpRelay_pause_olt_detected_in_voltha
-
-## CHANNEL-SURFING
-
-931. test_subscriber_join_recv_channel
-932. test_subscriber_join_jump_channel
-933. test_subscriber_join_next_channel
-934. test_subscriber_authentication_with_invalid_certificate_and_channel_surfing
-935. test_subscriber_authentication_with_no_certificate_and_channel_surfing
-936. test_subscriber_authentication_with_self_signed_certificate_and_channel_surfing
-937. test_subscriber_authentication_with_dhcp_discover_and_channel_surfing
-938. test_subscriber_authentication_with_dhcp_client_reboot_scenario_and_channel_surfing
-939. test_subscriber_authentication_with_dhcp_server_reboot_scenario_and_channel_surfing
-940. test_subscriber_authentication_with_dhcp_client_rebind_and_channel_surfing
-941. test_subscriber_authentication_with_dhcp_starvation_scenario_and_channel_surfing
-942. test_subscriber_authentication_with_multiple_dhcp_discover_for_same_subscriber_and_channel_surfing
-943. test_subscriber_authentication_with_multiple_dhcp_request_for_same_subscriber_and_channel_surfing
-944. test_subscriber_authentication_with_dhcp_client_requested_ip_and_channel_surfing
-945. test_subscriber_authentication_with_dhcp_non_offered_ip_and_channel_surfing
-946. test_subscriber_authentication_with_dhcp_request_out_of_pool_ip_by_client_and_channel_surfing
-947. test_subscriber_authentication_with_dhcp_specified_lease_time_functionality_and_channel_surfing
-948. test_subscriber_join_recv_100channels
-949. test_subscriber_join_recv_400channels
-950. test_subscriber_join_recv_800channels
-951. test_subscriber_join_recv_1200channels
-952. test_subscriber_join_recv_1500channels
-953. test_subscriber_join_jump_100channels
-954. test_subscriber_join_jump_400channels
-955. test_subscriber_join_jump_800channels
-956. test_subscriber_join_jump_1200channel
-957. test_subscriber_join_jump_1500channels
-958. test_subscriber_join_next_100channels
-959. test_subscriber_join_next_400channels
-960. test_subscriber_join_next_800channels
-961. test_subscriber_join_next_1200channels
-962. test_subscriber_join_next_1500channels
-
-## MININET
-
-963. test_creation_of_topology
-964. test_creation_of_single_switch_topology
-965. test_creation_of_linear_topology
-966. test_creation_of_tree_topology
-967. test_executing_commands_from_mininet_host
-968. test_verifying_pingall_from_mininet
-969. test_initiating_pingall_from_mininet_with_onos_app_deactivation
-970. test_verifying_mininet_hosts_in_onos_controller
-971. test_verifying_tcp_bandwidth_measure_between_mininet_hosts_using_iperf
-972. test_verifying_udp_bandwidth_measure_between_mininet_hosts_using_iperf
-973. test_verifying_tcp_bandwidth_between_mininet_hosts_using_iperf_with_one_host_removed
-974. test_verifying_udp_bandwidth_between_mininet_hosts_using_iperf_with_one_host_removed
-975. test_hosts_assigned_with_non_default_ip_address
-976. test_hosts_assigned_with_non_default_ip_address_in_different_subnets
-977. test_verifying_pingall_with_connection_remove_between_switches
-978. test_verifying_pingall_with_removing_one_mininet_host
-979. test_verifying_pingall_with_removing_one_mininet_switch
-980. test_verifying_mininet_switch_status_in_onos_controller
-981. test_verify_host_status_in_onos_controller_with_removing_one_mininet_host
-982. test_verifying_pushing_mac_flows_from_onos_controller_to_mininet_switches
-983. test_verifying_pushing_ipv4_flows_from_onos_controller_to_mininet_switches
-984. test_verifying_pushing_ipv6_flows_from_onos_controller_to_mininet_switches
-985. test_topology_created_with_50_switches_in_onos_controller
-986. test_topology_created_with_200_switches_in_onos_controller
-987. test_verifying_nodes_removed_in_mininet_status_in_onos_controller
-
-## NET-CONDITIONS
-
-988. test_netCondition_with_delay_between_igmp_join_and_data_recv
-989. test_netCondition_with_delay_between_data_recv_and_igmp_join
-990. test_netCondition_with_delay_between_igmp_leave_and_data
-991. test_netCondition_in_eap_tls_with_delay_between_positive_IdReq_and_tlsHelloReq
-992. test_netCondition_in_eap_tls_with_delay_between_IdReq_and_tlsHelloReq
-993. test_netCondition_in_eap_tls_with_delay_between_tlsHelloReq_and_eapTlsCertReq
-994. test_netCondition_in_eap_tls_with_delay_between_TlsCertReq_and_TlsChangeCipherSpec
-995. test_netCondition_in_eap_tls_with_no_cert_and_delay_between_IdReq_and_HelloReq
-996. test_netCondition_in_eap_tls_with_delay_and_no_cert_between_tlsHelloReq_and_eapTlsCertReq
-997. test_netCondition_in_eap_tls_with_delay_and_no_cert_between_TlsCertReq_and_TlsChangeCipherSpec
-998. test_netCondition_in_eap_tls_with_invalid_cert_and_delay_between_IdReq_and_HelloReq
-999. test_netCondition_in_eap_tls_with_invalid_cert_and_delay_between_tlsHelloReq_and_eapTlsCertReq
-1000. test_netCondition_in_eap_tls_with_invalid_cert_delay_between_TlsCertReq_and_TlsChangeCipherSpec
-1001. test_netCondition_in_multiple_eap_tls_requests_with_delay_between_IdReq_and_HelloReq
-1002. test_netCondition_with_multiple_authentication_and_delay_between_complete_authentication
-1003. test_netCondition_with_multiple_authentication_and_delay_between_every_100_tls_burst
-1004. test_netCondition_with_delay_between_mac_flow_and_traffic
-1005. test_netCondition_with_delay_between_ip_flow_and_traffic
-1006. test_netCondition_with_delay_between_tcp_port_flow_and_traffic
-1007. test_netCondition_with_delay_between_udp_port_flow_and_traffic
-1008. test_netCondition_with_delay_between_multiple_igmp_joins_and_data_for_multiple_subscribers
-1009. test_netCondition_with_delay_between_multiple_igmp_joins_and_data_from_multiple_subscribers_with_low_multicast_data_rate
-1010. test_netCondition_with_delay_between_multiple_igmp_joins_and_data_for_same_subscriber
-1011. test_netCondition_with_delay_between_same_igmp_joins_and_data_from_multiple_subscriber
-1012. test_netCondition_with_delay_between_multiple_igmp_joins_and_data_from_same_sourcelist_for_multiple_subscriber
-1013. test_netCondition_with_throttle_between_multiple_igmp_joins_and_data_from_multiple_subscribers
-1014. test_netCondition_with_invalid_igmp_type_multiple_igmp_joins_and_data_from_multiple_subscribers
-1015. test_netCondition_with_invalid_record_type_multiple_igmp_joins_and_data_from_multiple_subscribers
-1016. test_netCondition_with_invalid_ttl_and_multiple_igmp_joins_and_data_from_multiple_subscribers
-1017. test_netCondition_in_multiple_eap_tls_sessions_with_out_of_order_exchanges_between_serverHello_and_client_packet
-1018. test_netCondition_in_multiple_eap_tls_session_with_out_of_order_exchanges_in_eapTlsCertReq_packets
-1019. test_netCondition_in_multiple_eap_tls_sessions_with_out_of_order_eapTlsChangeCipherSpec_packets
-1020. test_netCondition_in_multiple_eap_tls_sessions_dropping_eapTlsHelloReq_packets
-1021. test_netCondition_in_multiple_eap_tls_sessions_dropping_eapTlsChangeCipherSpec_packets
-1022. test_netCondition_in_eapol_tls_with_invalid_eapol_version_field_in_client_auth_packet
-1023. test_netCondition_in_eapol_tls_with_invalid_eapol_tls_type_field_in_client_auth_packet
-1024. test_netCondition_in_eapol_tls_with_invalid_eapol_type_ID_field_in_client_auth_packet
-1025. test_netCondition_in_eapol_tls_with_invalid_eapol_response_field_in_client_auth_packet
-1026. test_netCondition_in_eap_tls_with_invalid_eap_content_type_field_in_client_auth_packet
-1027. test_netCondition_in_eap_tls_with_invalid_tls_version_field_in_client_auth_packet
-1028. test_netCondition_in_eap_tls_with_invalid_tls_cipher_suite_field_in_client_auth_packet
-1029. test_netCondition_in_eap_tls_with_id_mismatch_in_identifier_field_in_client_auth_packet
-1030. test_netCondition_in_eap_tls_with_id_mismatch_in_client_hello_auth_packet
-1031. test_netCondition_in_eap_tls_with_invalid_client_hello_handshake_type_auth_packet
-1032. test_netCondition_in_eap_tls_with_invalid_client_cert_req_handshake_auth_packet
-1033. test_netCondition_in_eap_tls_with_invalid_client_key_ex_replacing_server_key_ex
-1034. test_netCondition_in_eap_tls_with_valid_client_and_emulating_server_packets_without_radius_server_container
-1035. test_netCondition_in_eap_tls_with_valid_client_and_dropped_server_eapid_response_packet
-1036. test_netCondition_in_eap_tls_with_valid_client_and_invalid_server_eapid_response_packet
-1037. test_netCondition_in_eap_tls_with_valid_client_and_dropped_server_hello_packet
-1038. test_netCondition_in_eap_tls_with_valid_client_and_invalid_server_hello_packet
-1039. test_netCondition_in_eap_tls_with_valid_client_and_dropped_client_certficate_access_challenge_server_packet
-1040. test_netCondition_in_eap_tls_with_valid_client_and_invalid_client_certficate_access_challenge_server_packet
-1041. test_netCondition_in_eap_tls_with_valid_client_and_dropped_client_certficate_with_2nd_fragment_access_challenge_server_packet
-1042. test_netCondition_in_eap_tls_with_valid_client_and_invalid_client_certficate_with_2nd_fragment_access_challenge_server_packet
-1043. test_netCondition_in_eap_tls_with_valid_client_and_dropped_client_certficate_with_3rd_fragment_access_challenge_server_packet
-1044. test_netCondition_in_eap_tls_with_valid_client_and_invalid_client_certficate_with_3rd_fragment_access_challenge_server_packet
-1045. test_netCondition_in_eap_tls_with_valid_client_and_dropped_cipher_suite_request_server_packet
-1046. test_netCondition_in_eap_tls_with_valid_client_and_invalid_cipher_suite_request_server_packet
-1047. test_netCondition_in_eap_tls_with_valid_client_and_dropped_access_accept_server_packet
-1048. test_netCondition_in_eap_tls_with_valid_client_and_invalid_access_accept_server_packet
diff --git a/docs/testcases.md b/docs/testcases.md
deleted file mode 100644
index df5025a..0000000
--- a/docs/testcases.md
+++ /dev/null
@@ -1,249 +0,0 @@
-# CORD POD Test-cases
-
-This is a rough sketch of planned test-cases, organized in areas. Regard it as
-a wish-list.
-
-Feel free to contribute to the list and also use the list to get idea(s) where
-test implementation is needed.
-
-## Test-Cases
-
-Test-cases are organized in the following categories:
-
-* Deployment tests
-* Baseline readiness tests
-* Functional end-user tests
-* Transient, fault, HA tests
-* Scale tests
-* Security tests
-* Soak tests
-
-Some test-cases may re-use other test-cases as part of more complex scenarios.
-
-### Deployment Tests
-
-The scope and objective of these test-cases is to run the automated deployment
-process on a "pristine" CORD POD and verify that at the end the system gets
-into a known (verifiable) baseline state, as well as that the feedback from the
-automated deployment process is consistent with the outcome (no false positives
-or negatives).
-
-Positive test-cases:
-
-* Bring-up and verify basic infrastructure assumptions
- * Head-end is available, configured correctly, and available for software
- load
- * Compute nodes are available and configured correctly, and available for
- software load
-* Execute automated deployment of CORD infrastructure and verify baseline
- state. Various options needs to be supported:
- * Single head-node setup (no clustering)
- * Triple-head-node setup (clustered)
- * Single data-plane up-link from servers (no high availability)
- * Dual data-plane up-link from servers (with high availability)
-
-Negative test-cases:
-
-* Verify that deployment automation detects missing equipment
-* Verify that deployment notifies operator of missing configuration
-* Verify that deployment automation detects missing cable
-* Verify that deployment automation detects mis-cabling of fabric and provides
- useful feedback to remedy the issue
-* Verify that deployment automation detects mis-cabling of servers and provides
- useful feedback to remedy the issue
-
-### Baseline Readiness Tests
-
-* Verify API availability (XOS, ONOS, OpenStack, etc.)
-* Verify software process inventory (of those processes that are covered by the
- baseline bring-up)
-
-### Functional End-User Tests
-
-Positive test-cases:
-
-* Verify that a new OLT can be added to the POD and it is properly initialized
-* Verify that a new ONU can be added to the OLT and it becomes visible in the
- system
-* Verify that a ONU port going down triggers unprovisioning of service for a
- subscriber
-* Verify that a new RG can authenticate and gets admitted to the system
- (receives an IP address, deployment dependent)
-* Verify that the RG can access the Intranet and the Internet
-* Verify that the RG receives periodic IGMP Query messages and forwards to set
- top boxes.
-* Verify that the RG can join a multicast channel and starts receiving bridge
- flow
-* Verify that the RG, after joining, starts receiving multicast flow within
- tolerance interval
-* Verify that the RG can join multiple multicast streams simultaneously
-* Verify that the RG receives periodic IGMP reports
-
-Complex test-cases:
-
-* Measure channel surfing experience
-* Replacing RG for existing subscriber
-* Moving existing subscriber to a new address (same RG, new location)
-* Rate at which new subscribers can be added to / removed from the system
-
-Negative test-cases:
-
-* Verify that a subscriber that is not registered cannot join the network
-* Verify that a subscriber RG cannot be added unless it is on the
- pre-prescribed port (OLT/ONU port?)
-* Verify that a subscriber that has no Internet access cannot reach the
- Internet
-* Verify that a subscriber with limited channel access cannot subscribe to
- disabled/prohibited channels
-* Verify that a subscriber identity cannot be re-used at a different RG (no two
- RGs with the same certificate can ever be logged into the system)
-
-### Transient, fault, HA Tests
-
-In this block, test-cases should cover the following scenarios:
-
-Hardware disruption scenarios cycling scenarios:
-
-In the following scenarios, in cases of non-HA setups, the system shall at
-least recover after the hardware component is restored. In HA scenarios, the
-system shall be able to ride these scenarios through without service interrupt.
-
-* Power cycling OLT
-* Power cycling ONU
-* Re-starting RG
-* Power cycling any server (one at a time)
-* Power cycling any fabric switch
-* Power cycling any of the VMs
-* Power cycling management switch
-* Replacing a server-to-leaf cable
-* Replacing a leaf-to-spine cable
-
-In HA scenarios, the following shall result in only degraded service, but not
-loss of service:
-
-* Powering off a server (and keep it powered off)
-* Powering off a spine fabric switch
-* Powering off a leaf fabric switch
-* Removing a server-to-leaf cable (emulating DAC failure)
-* Removing a leaf-to-spine cable (emulating DAC failure)
-* Powering off management switch
-* Powering back each of the above
-
-Process cycling scenarios:
-
-* Restarting any of the processes
-* Killing any of the processes (system shall recover with auto-restart)
-* Killing and restoring containers
-* Relocation scenarios [TBD]
-
-Additive scenarios:
-
-* Add a new spine switch to the system
-* Add a new compute server to the system
-* Add a new head node to the system
-
-### Scale Tests
-
-Test load input dimensions to track against:
-
-* Number of subscribers
-* Number of routes pushed to CORD POD
-* Number of NBI API sessions
-* Number of NBI API requests
-* Subscriber channel change rate
-* Subscriber aggregate traffic load to Internet
-
-In addition to healthy operation, the following is the list contains what needs
-to be measured quantitatively, as a function of input load:
-
-* CPU utilization per each server
-* Disk utilization per each server
-* Memory utilization per each server
-* Network utilization at various capture points (fabric ports to start with)
-* Channel change "response time" (how long it takes to start receiving bridge
- traffic as well as real multicast feed)
-* Internet access round-trip time
-* CPU/DISK/Memory/Network trends in relationship to number of subscribers
-* After removal of all subscribers system should be "identical" to the new
- install state (or reasonably similar)
-
-### Security Tests
-
-The purpose of these tests is to detect vulnerabilities across the various
-surfaces of CORD, including:
-
-* PON ports (via ONU ports)
-* NBI APIs
-* Internet up-link
-* CORD POD-Local penetration tests
- * Via patch cable into management switch
- * Via fabric ports
- * Via unused NIC ports of server(s)
- * Via local console (only if secure boot is enabled)
-
-Tests shall include:
-
-* Port scans on management network: only a pre-defined list of ports shall be
- open
-* Local clustering shall be VLAN-isolated from the management network
-* Qualys free scan
-* SSH vulnerability scans
-* SSL certificate validation
-
-[TBD: define more specific test scenarios]
-
-In addition, proprietary scans, such as Nessus Vulnerability Scan will be
-performed prior to major releases by commercial CORD vendor Ciena.
-
-### Soak Tests
-
-This is really one comprehensive multi-faceted test run on the POD, involving
-the following steps:
-
-Preparation phase:
-
-1. Deploy system using the automated deployment process
-2. Verify baseline acceptance
-3. Admit a preset number of RGs
-4. Subscribe to a pre-configured set of multicast feeds
-5. Start a nominal Internet access load pattern on each RG
-6. Optionally (per test config): start background scaled-up load (dpdk-pktgen
- based)
-7. Capture baseline resource usage (memory, disk utilization per server, per
- vital process)
-
-Soak phase (sustained for a preset time period (8h, 24h, 72h, etc.):
-
-1. Periodically monitor health of ongoing sessions (emulated RGs happy?)
-2. Periodically test presence of all processes
-3. Check for stable process ids (rolling id can be a sign of a restarted
- process)
-4. Periodically capture resource usage, including:
- * CPU load
- * process memory use
- * file descriptors
- * disk space
- * disk io
- * flow table entries in soft and fabric switches
-
-Final check:
-
-1. Final capture of resource utilization and health report
-
-## Baseline Acceptance Criteria
-
-The baseline acceptance is based on a list of criteria, including:
-
-On all servers involved in the POD:
-
-* Verify BIOS settings (indirectly)
-* Verify kernel boot options
-* Verify OS version
-* Verify kernel driver options for NICs (latest driver)
-* Verify kernel settings
-* Verify software inventory (presence and version) of following as applicable
-
- * DPDK version
- * ovs version
- * etc.
-
diff --git a/docs/validate_pods.md b/docs/validate_pods.md
index 4b9e191..aa2631e 100644
--- a/docs/validate_pods.md
+++ b/docs/validate_pods.md
@@ -4,33 +4,13 @@
installation of the POD, test jobs are triggered which validate the following
categories of tests
-* Post Installation Verification
* Functional Tests
-## Post Installation Tests
-
-These tests perform the following validations
-
-* Required services are running
-* All deployments are successfully rolled out and matches replicas to available replicas
-* All pods are running
-* Pods have external connectivity
-* Pods can ping the kube-system namespace
-* Nodes are healthy (checking “ready”, “outofdisk”, “memorypressure”, “diskpressure”)
-* Required containers are in running state
-
-To execute the test, perform the following from the client machine
-
-```bash
-cd cord-tester/src/test/diag
-robot SanityK8Pod.robot
-```
## Functional Tests
-Control tests can be executed on the POD once the
-sanity checks are successful.
+Control tests can be executed on the POD once it has been successfully deployed.
### Executing Control Plane Tests
@@ -54,33 +34,17 @@
```bash
cd cord-tester/src/test/cord-api/Tests/
robot VOLTDevice_Test.txt
-robot RCORDLite_E2ETest.txt
```
### Data Plane Tests
-Data plane tests include validations of both top-down and zero-touch approaches as well as workflow validations. Follow the guide above to edit the properties file before running the tests.
-
-**Validating top-down and zero-touch approaches**
-
-`Subscriber_StatusChecks.txt` validates subscriber status and end-to-end ping. Execute the following commands to run the test.
-```bash
-cd cord-tester/src/test/cord-api/Tests/
-robot -v init_state:disabled -v INITIAL_STATUS:FAIL -v ENABLE_STATUS:PASS -e zerotouch Subscriber_StatusChecks.txt
-```
-Remember to change the values (ip, gateway, username, password, etc.) in the `Variables` section of the script to point the test to the source and destination hosts in your environment before running it.
-
-Similarly, run the follownig commands to validate zero-touch approach. Note that the arguments passed to the test script are different from the top-down approach.
-```bash
-cd cord-tester/src/test/cord-api/Tests/
-robot -v init_state:awaiting-auth -v INITIAL_STATUS:FAIL -v ENABLE_STATUS:FAIL -v MACIP_STATUS:PASS Subscriber_StatusChecks.txt
-```
+Data plane tests include the workflow validations. Follow the guide above to edit the properties file before running the tests.
**Validating AT&T workflow**
-Test scripts and input data for validating AT&T workflow are under `cord-tester/src/test/cord-api/Tests/WorkflowValidations`. The same test script e.g. `ATT_Test001.robot` works with different POD setups. Instead of hardcoding the POD specific variables in the test script, it relies on a separated configuration file which describes POD setup. To create a configuration file for your POD please take a look at [this example](https://github.com/opencord/pod-configs/blob/master/deployment-configs/flex-pod1-olt.yaml).
+Test scripts and input data for validating AT&T workflow are under `cord-tester/src/test/cord-api/Tests/WorkflowValidations`. The same test script e.g. `ATT_Test001.robot` works with different POD setups. Instead of hardcoding the POD specific variables in the test script, it relies on a separated configuration file which describes POD setup. To create a configuration file for your POD please take a look at [this example](https://github.com/opencord/pod-configs/blob/master/deployment-configs/flex-ocp-cord.yaml).
-Input data are stored under `cord-tester/src/test/cord-api/Tests/WorkflowValidations/data/`. Please create a new folder with the name of your POD and copy and data files from e.g. `flex-pod1-olt` folder and edit them with the correct values on your POD.
+Input data are stored under `cord-tester/src/test/cord-api/Tests/WorkflowValidations/data/`. Please create a new folder with the name of your POD and copy and data files from e.g. `flex-ocp-cord` folder and edit them with the correct values on your POD.
Also make sure that the variables in the test script (e.g. `ATT_Test001.robot`) are correct. Specifically, verify that `${POD_NAME}` is the same as the folder name you created above, and `${KUBERNETES_CONF}` is pointing to your Kubernetes configuration file.
diff --git a/src/test/cord-api/Tests/WorkflowValidations/pod-configs b/src/test/cord-api/Tests/WorkflowValidations/pod-configs
new file mode 160000
index 0000000..0e96bf7
--- /dev/null
+++ b/src/test/cord-api/Tests/WorkflowValidations/pod-configs
@@ -0,0 +1 @@
+Subproject commit 0e96bf7d84a9ea2a978ef8901324123104430dac