| commit | b8ed2d5096d68baa3c07a9ba97997128f7a6587f | [log] [tgz] |
|---|---|---|
| author | Suchitra Vemuri <suchitra@opennetworking.org> | Mon Sep 30 13:22:51 2019 -0700 |
| committer | Andy Bavier <andy@opennetworking.org> | Mon Sep 30 14:12:32 2019 -0700 |
| tree | ada997bf96c886c7c514bd413f45f8033463a998 | |
| parent | 9c24d2b25b6bca56857506025fc5e68f51abffaa [diff] |
organizing file structure Change-Id: I1e2a6ac2a9fb42f4924411a1d2b5317d921f1863
Automated test-suites to validate the stability/functionality of VOLTHA. Tests that reside in here should be written in Robot Framework and Python.
Intended use includes:
Python virtualenv
voltctl - a command line tool to access VOLTHA. Reference - voltctl
kubectl - a command line tool to access your Kubernetes Clusers. Reference
voltctl and kubectl must be properly configured on your system prior to any test executions. The kind-voltha environment will install and configure these tools for you; see below.
Directory is structured as follows:
├── tests └── sanity/ // basic tests that should always pass. Will be used as gating-patchsets └── functional/ // feature/functionality tests that should be implemented as new features get developed └── libraries // shared test keywords (functions) across various test suites └── variables // shared variables across various test suites
An easy way to bring up VOLTHA + BBSim for testing is by using kind-voltha. To set up a minimal environment, first install Docker and the Go programming language. Then run the following commands:
git clone https://github.com/ciena/kind-voltha cd kind-voltha EXTRA_HELM_FLAGS="--set defaults.image_tag=voltha-2.1” TYPE=minimal WITH_RADIUS=y WITH_BBSIM=y INSTALL_ONOS_APPS=y CONFIG_SADIS=y ./voltha up source minimal-env.sh
The defaults.image_tag value above is used to specify which VOLTHA branch images to pull from Docker Hub.
Assuming that you have brought up VOLTHA as described above, to run the the sanity tests:
git clone https://github.com/opencord/voltha-system-tests make -C voltha-system-tests sanity-kind
This test execution will generate three report files in voltha-system-tests/tests/sanity (output.xml, report.html, log.html). View the report.html page in a browser to analyze the results.
The make sanity-kind target is equivalent to the following:
ROBOT_PORT_ARGS="-v ONOS_REST_PORT:8181 -v ONOS_SSH_PORT:8101" \ ROBOT_TEST_ARGS="--exclude notready --critical sanity" \ ROBOT_MISC_ARGS="-v num_onus:1" \ make sanity
If you are running the tests in another environment, you can run make sanity with the arguments appropriate for your environment. Look at variables.robot for a list of variables that you may need to override.
Most additions should be done by adding keywords to the libraries, then calling these keywords from the tests. Consult a guide on how to write good Robot framework tests.
Make sure that make lint passes, which runs robotframework-lint on any new code that is created.