Report: fixes

[csit.git] / docs / report / introduction / test_environment_intro.rst

diff --git a/docs/report/introduction/test_environment_intro.rst b/docs/report/introduction/test_environment_intro.rst
index 1999906..10ba083 100644 (file)
--- a/docs/report/introduction/test_environment_intro.rst
+++ b/docs/report/introduction/test_environment_intro.rst
@@ -10,9 +10,12 @@ CSIT test environment versioning has been introduced to track
 modifications of the test environment.
 
 Any benchmark anomalies (progressions, regressions) between releases of
 modifications of the test environment.
 
 Any benchmark anomalies (progressions, regressions) between releases of

-a DUT application (e.g. VPP, DPDK, TRex), are determined by testing it in the
+a DUT application (e.g. VPP, DPDK), are determined by testing it in the

 same test environment, to avoid test environment changes clouding the
 picture.
 same test environment, to avoid test environment changes clouding the
 picture.

+To beter distinguish impact of test environment changes,
+we also execute tests without any SUT (just with TRex TG sending packets
+over a link looping back to TG).

 
 A mirror approach is introduced to determine benchmarking anomalies due
 to the test environment change. This is achieved by testing the same DUT
 
 A mirror approach is introduced to determine benchmarking anomalies due
 to the test environment change. This is achieved by testing the same DUT


@@ -98,4 +101,26 @@ Following is the list of CSIT versions to date:
   `CSIT <https://git.fd.io/csit/tree/?h=rls2110>`_).
 
   - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility
   `CSIT <https://git.fd.io/csit/tree/?h=rls2110>`_).
 
   - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility

-    matrix: `depends on testbed type <https://gerrit.fd.io/r/c/csit/+/33311>`_.
+    matrix.
+- Ver. 9 associated with CSIT rls2202 branch (`HW
+  <https://git.fd.io/csit/tree/docs/lab?h=rls2202>`_, `Linux
+  <https://s3-docs.fd.io/csit/rls2202/report/vpp_performance_tests/test_environment.html#sut-settings-linux>`_,
+  `TRex
+  <https://s3-docs.fd.io/csit/rls2202/report/vpp_performance_tests/test_environment.html#tg-settings-trex>`_,
+  `CSIT <https://git.fd.io/csit/tree/?h=rls2202>`_).
+
+  - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility
+    matrix.
+- Ver. 10 associated with CSIT rls2206 branch (`HW
+  <https://git.fd.io/csit/tree/docs/lab?h=rls2206>`_, `Linux
+  <https://s3-docs.fd.io/csit/rls2206/report/vpp_performance_tests/test_environment.html#sut-settings-linux>`_,
+  `TRex
+  <https://s3-docs.fd.io/csit/rls2206/report/vpp_performance_tests/test_environment.html#tg-settings-trex>`_,
+  `CSIT <https://git.fd.io/csit/tree/?h=rls2206>`_).
+
+  - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility
+    matrix.
+  - Mellanox 556A series firmware upgrade based on DPDK compatibility
+    matrix.
+  - Intel IceLake all core turbo frequency turned off. Current base frequency
+    is 2.6GHz.
\ No newline at end of file