======= CI RUNS ======= CI Run for Specific Suite: -------------------------- 1. Initiate integration/E2E test: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Initiate test run for specific suite to ensure that the test suite is passing in devel or release branch or in feature branch Navigate to Actions tab in sootballs_test repo .. image:: _static/picture/ci_run/pic1.png :alt: CI Run :align: center :width: 600px .. raw:: html

Navigate to integration/E2E test tab in Action module .. image:: _static/picture/ci_run/pic2.png :alt: CI Run :align: center :width: 600px .. raw:: html

Steps to Run CI Workflow ^^^^^^^^^^^^^^^^^^^^^^^^ 1. Click run_workflow icon and fill the details like below, 2. Use workflow from --> this is always devel only. We don’t have to change this 3. Git reference for both rr_sootballs --> branch of rr_sootballs - If we need to run in devel, enter “devel” - If we need to run in release branch, enter release name - If we need to run in specific feature branch, enter the feature branch name 4. Git reference for sootballs_tests --> branch of sootballs_test repo (our code branch) 5. Tag of the sootballs image to test against --> tag of the rr_sootballs branch. - For example, for devel branch, “devel” is tag. - For release branch “3.5.0-rc1”, “3.5.0-rc0”, etc like, for our particular test branch “branch name” should be used. 6. Test suite to run --> path to the test suite should be entered in this 7. Timeout for the tests (minutes) --> default timeout will be 40. If that suite takes long time, we can change. .. image:: _static/picture/ci_run/pic3.png :alt: CI Run :align: center :width: 600px .. raw:: html

.. image::_static/picture/ci_run/pic4.png :alt: CI Run :align: center :width: 600px .. raw:: html

.. image:: _static/picture/ci_run/pic5.png :alt: CI Run :align: center :width: 600px .. raw:: html

.. image:: _static/picture/ci_run/pic6.png :alt: CI Run :align: center :width: 600px .. raw:: html

.. image:: _static/picture/ci_run/pic7.png :alt: CI Run :align: center :width: 600px .. raw:: html

.. image:: _static/picture/ci_run/pic8.png :alt: CI Run :align: center :width: 600px .. raw:: html

2. CI Run for Nightly Tests ~~~~~~~~~~~~~~~~~~~~~~~~~~~ Navigate to the Nightly tests tab and click workflow. Run the workflow in whichever branch we need. .. image:: _static/picture/ci_run/pic9.png :alt: CI Run :align: center :width: 600px .. raw:: html

3. CI Run for Confidence tests: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Navigate to Confidence tests tab and click workflow. In rr_sootballs reference we can give in which branch of rr_sootballs we are going to run the suite. In sootballs test, we can give in which branch of sootballs_tests we are going to run the suite. .. image:: _static/picture/ci_run/pic10.png :alt: CI Run :align: center :width: 600px .. raw:: html

4. CI Run for Performance tests: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Navigate to Performance tests tab and click workflow. In rr_sootballs reference we can give in which branch of rr_sootballs we are going to run the suite. In sootballs test, we can give in which branch of sootballs_tests we are going to run the suite. .. image:: _static/picture/ci_run/pic11.png :alt: CI Run :align: center :width: 600px .. raw:: html

5. Add every suite in run_all_nightly file to run in daily ci while adding a new suite everytime. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ .. image:: _static/picture/ci_run/pic12.png :alt: CI Run :align: center :width: 600px .. raw:: html