From 6aeb3f1bbbda53855f9b0c9148c7e60201502e05 Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Wed, 18 Sep 2019 10:40:17 +0200 Subject: [PATCH] Report: Add disclaimer for reconf tests + Improve description for reconf tests Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c Signed-off-by: Tibor Frank (cherry picked from commit 2fc48e8d0a4712ec99dd2bb3a814ec9cb2bc12cf) --- docs/report/index.html.template | 1 + docs/report/introduction/methodology.rst | 1 + .../methodology_data_plane_throughput/index.rst | 1 - .../methodology_reconf.rst | 10 ++++++++-- docs/report/vpp_performance_tests/index.rst | 1 + .../nf_service_density/index.rst | 1 - .../vpp_performance_tests/reconf_tests/index.rst | 15 ++++++++++++++ .../vnf_service_chains_reconf.rst | 23 +++++++++++++++++----- 8 files changed, 44 insertions(+), 9 deletions(-) rename docs/report/introduction/{methodology_data_plane_throughput => }/methodology_reconf.rst (91%) create mode 100644 docs/report/vpp_performance_tests/reconf_tests/index.rst rename docs/report/vpp_performance_tests/{nf_service_density => reconf_tests}/vnf_service_chains_reconf.rst (83%) diff --git a/docs/report/index.html.template b/docs/report/index.html.template index 554dd9bd76..8a01129982 100644 --- a/docs/report/index.html.template +++ b/docs/report/index.html.template @@ -21,6 +21,7 @@ CSIT-1908 vpp_performance_tests/throughput_speedup_multi_core/index vpp_performance_tests/packet_latency_graphs/index vpp_performance_tests/soak_tests/index + vpp_performance_tests/reconf_tests/index vpp_performance_tests/nf_service_density/index vpp_performance_tests/http_server_performance/index vpp_performance_tests/comparisons/index diff --git a/docs/report/introduction/methodology.rst b/docs/report/introduction/methodology.rst index b111fe51d3..af9bfc661a 100644 --- a/docs/report/introduction/methodology.rst +++ b/docs/report/introduction/methodology.rst @@ -16,6 +16,7 @@ Test Methodology methodology_plrsearch methodology_packet_latency methodology_multi_core_speedup + methodology_reconf methodology_vpp_startup_settings methodology_kvm_vms_vhost_user methodology_lxc_drc_container_memif diff --git a/docs/report/introduction/methodology_data_plane_throughput/index.rst b/docs/report/introduction/methodology_data_plane_throughput/index.rst index 71af4a9add..487d300b5b 100644 --- a/docs/report/introduction/methodology_data_plane_throughput/index.rst +++ b/docs/report/introduction/methodology_data_plane_throughput/index.rst @@ -7,4 +7,3 @@ Data Plane Throughput methodology_mlrsearch_tests methodology_mrr_throughput methodology_plrsearch - methodology_reconf diff --git a/docs/report/introduction/methodology_data_plane_throughput/methodology_reconf.rst b/docs/report/introduction/methodology_reconf.rst similarity index 91% rename from docs/report/introduction/methodology_data_plane_throughput/methodology_reconf.rst rename to docs/report/introduction/methodology_reconf.rst index 8922b32b22..32e0fd7561 100644 --- a/docs/report/introduction/methodology_data_plane_throughput/methodology_reconf.rst +++ b/docs/report/introduction/methodology_reconf.rst @@ -1,7 +1,13 @@ .. _reconf_tests: -Reconf Tests -^^^^^^^^^^^^ +Reconfiguration Tests +--------------------- + +.. important:: + + **DISCLAIMER**: Described reconf test methodology is experimental, and + subject to change following consultation within csit-dev, vpp-dev + and user communities. Current test results should be treated as indicative. Overview ~~~~~~~~ diff --git a/docs/report/vpp_performance_tests/index.rst b/docs/report/vpp_performance_tests/index.rst index c5c3e6679d..0f09377732 100644 --- a/docs/report/vpp_performance_tests/index.rst +++ b/docs/report/vpp_performance_tests/index.rst @@ -9,6 +9,7 @@ VPP Performance throughput_speedup_multi_core/index packet_latency_graphs/index soak_tests/index + reconf_tests/index nf_service_density/index http_server_performance/index comparisons/index diff --git a/docs/report/vpp_performance_tests/nf_service_density/index.rst b/docs/report/vpp_performance_tests/nf_service_density/index.rst index 8c827ebcc3..4c3143b36d 100644 --- a/docs/report/vpp_performance_tests/nf_service_density/index.rst +++ b/docs/report/vpp_performance_tests/nf_service_density/index.rst @@ -25,4 +25,3 @@ resources. vnf_service_chains cnf_service_chains cnf_service_pipelines - vnf_service_chains_reconf diff --git a/docs/report/vpp_performance_tests/reconf_tests/index.rst b/docs/report/vpp_performance_tests/reconf_tests/index.rst new file mode 100644 index 0000000000..c5da438b29 --- /dev/null +++ b/docs/report/vpp_performance_tests/reconf_tests/index.rst @@ -0,0 +1,15 @@ + +.. raw:: latex + + \clearpage + +.. _reconfiguration_tests: + +Reconfiguration Tests +===================== + +See :ref:`reconf_tests` for methodology description of this test type. + +.. toctree:: + + vnf_service_chains_reconf diff --git a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains_reconf.rst b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst similarity index 83% rename from docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains_reconf.rst rename to docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst index 66b1af15d3..47934651bc 100644 --- a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains_reconf.rst +++ b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst @@ -30,10 +30,14 @@ .. _vnf_service_chains_reconf: -Reconfiguration of VNF Service Chains -===================================== +VNF Service Chains +================== -See :ref:`reconf_tests` for methodology description of this test type. +.. important:: + + **DISCLAIMER**: Presented test results should be taken with a pinch of + salt as they may not represent correctly the system behaviour due + to experimental nature of used test methodology (see :ref:`reconf_tests`). In each test, a single service chain is added, the re-configuration contains all the steps the initial chains got, except the last step @@ -41,8 +45,17 @@ contains all the steps the initial chains got, except the last step Additional information about graph data: -#. **Graph Title**: describes tested packet path including VNF workload - running in each VM. +#. **Graph Title**: describes tested VPP packet path. Format: + + - wire encapsulation ``dot1qip4vlxan``, + - VPP forwarding mode ``l2bd``, + - total number {Y} of service chains ``{Y}ch``, + - total number of chains being reconfigured ``1ach``, + - total number of vhost-user interfaces forwarding packets on VPP with {Y} + chains and {X} VMs per chain ``{2XY}vh`` (2 interfaces per {X} VMs per {Y} + chains), + total number {XY} of VNF VMs forwarding packets ``{XY}vm`` and finally + - VNF workload in VM ``testpmd``. #. **X-axis Labels**: indices of individual test suites as listed in Graph Legend. -- 2.16.6